Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

87

Base only

Active filters: arm-optimized

Arm/deit-tiny-int8-xnnpack-executorch

Image Classification • Updated 24 days ago • 390

Arm/resnet-50-int8-xnnpack-executorch

Image Classification • Updated 24 days ago • 724

Arm/resnet-18-int8-xnnpack-executorch

Image Classification • Updated 24 days ago • 519

Arm/squeezenet-1-1-int8-xnnpack-executorch

Image Classification • Updated 23 days ago • 223

Arm/shufflenet-v2-x1-0-int8-xnnpack-executorch

Image Classification • Updated 24 days ago • 426

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 23 days ago • 365

Arm/vit-base-int8-xnnpack-executorch

Image Classification • Updated 16 days ago • 822

Arm/swin-tiny-int8-xnnpack-executorch

Image Classification • Updated 24 days ago • 767

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 24 days ago • 702

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 3 days ago • 85

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 3 days ago • 60

Arm/yolov8s-int8-xnnpack-executorch

Object Detection • Updated 16 days ago • 220

Arm/whisper-tiny-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 24 days ago • 420

Arm/whisper-small-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 23 days ago • 199

Arm/whisper-base-int8-litert

Automatic Speech Recognition • Updated 24 days ago • 43

Arm/whisper-medium-int8-litert

Automatic Speech Recognition • Updated 24 days ago • 114

Arm/whisper-large-v3-int8-litert

Automatic Speech Recognition • Updated 23 days ago • 147

Arm/efficient-sam-s-int8-xnnpack-executorch

Image Segmentation • Updated 24 days ago • 68

Arm/yolov8s-seg-int8-xnnpack-executorch

Image Segmentation • Updated 23 days ago • 67

Arm/yolov7-seg-int8-xnnpack-executorch

Image Segmentation • Updated 23 days ago • 98

Arm/mobile-sam-int8-xnnpack-executorch

Image Segmentation • Updated 23 days ago • 65

Arm/minilm-l6-v2-int8-litert

Feature Extraction • Updated 24 days ago • 24

Arm/bge-base-en-v1.5-int8-litert

Feature Extraction • Updated 24 days ago • 20

Arm/nomic-embed-text-v1-int8-litert

Feature Extraction • Updated 24 days ago • 127

Arm/mobilenet-v3-small-int8-xnnpack-executorch

Image Classification • Updated 23 days ago • 231

Arm/qwen3-0-6b-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 24 days ago • 98

Arm/llama-3-2-3b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 24 days ago • 77

Arm/gemma-3-1b-base-onnx-genai-int4-emb-int8

Text Generation • Updated 24 days ago • 51

Arm/gemma-3-1b-instruct-onnx-genai-int4-emb-int8

Text Generation • Updated 24 days ago • 88

Arm/qwen2-5-1-5b-instruct-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 24 days ago • 83