[FEEDBACK] Local apps

#31
by kramp - opened
Hugging Face org

Please share your feedback about the Local Apps integration in model pages.

On compatible models , you'll be proposed to launch some local apps:

In your settings, you can configure the list of apps and their order:

The list of available local apps is defined in https://github.com/huggingface/huggingface.js/blob/main/packages/tasks/src/local-apps.ts

I think the tensor-core fp16 FLOPS should be used for GPUs supporting that. I note that V100 counts as way less than the theoretical 125 TFLOPS, listed e.g. here: https://images.nvidia.com/content/technologies/volta/pdf/tesla-volta-v100-datasheet-letter-fnl-web.pdf

Hey! Have you guys heard of LangFlow? It is a neat solution for developing AI-powered apps as well!

The GPU list is missing the RTX A4000 (16GB)

PR: https://github.com/huggingface/huggingface.js/pull/817

Would be nice to get ollama integration

I suggest adding Ollama as local app to run LLM's

I use GPT4All and it is not listed herein

Hugging Face org

@j1mc want to open a quick PR to add it?

Please add https://omlx.ai to local apps

Please add vmlx or MXL studio. https://mlx.studio/download/

Hi,

Missing from the hardware list:

  • NVIDIA RTX™ 5000 Ada Generation Laptop GPU (16GB GDDR6) powers advanced AI with 682 AI TOPS
  • Intel® Core™ i9 processor HX series (14th Gen)

go add it then

Please add vmlx or MXL studio. https://mlx.studio/download/

why not add it yourself?

Hi team! Submitted PR #2391 to add Zimmer (macOS & Windows local AI workspace supporting GGUF & MLX) to the local-apps registry: https://github.com/huggingface/huggingface.js/pull/2391. Video demo and test URLs are verified and included in the PR.

@gary149 sorry for the direct ping — I know the queue is long.

Flagging one thing that needs a maintainer action rather than a nudge: the Lint and Test workflows are sitting at action_required because this is my first PR to this repo, so CI has never run and the PR shows as BLOCKED.

Everything passes locally in packages/tasks — format:check, lint:check, check (tsc), and test (22/22). Happy to keep waiting, just wanted to make sure that gate wasn't the thing holding it up.

Sign up or log in to comment