Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

76

Base only

Active filters: arm-optimized

Arm/deit-tiny-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 208

Arm/resnet-50-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 324

Arm/resnet-18-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 248

Arm/squeezenet-1-1-int8-xnnpack-executorch

Image Classification • Updated 2 days ago • 112

Arm/shufflenet-v2-x1-0-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 98

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 2 days ago • 281

Arm/vit-base-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 1.21k

Arm/swin-tiny-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 298

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 3 days ago • 321

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 3 days ago • 20

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 3 days ago • 21

Arm/yolov8s-int8-xnnpack-executorch

Object Detection • Updated 3 days ago • 37

Arm/whisper-tiny-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 3 days ago • 45

Arm/whisper-small-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 2 days ago • 48

Arm/whisper-base-int8-litert

Automatic Speech Recognition • Updated 3 days ago • 20

Arm/whisper-medium-int8-litert

Automatic Speech Recognition • Updated 3 days ago • 7

Arm/whisper-large-v3-int8-litert

Automatic Speech Recognition • Updated 2 days ago • 16

Arm/efficient-sam-s-int8-xnnpack-executorch

Image Segmentation • Updated 3 days ago • 39

Arm/yolov8s-seg-int8-xnnpack-executorch

Image Segmentation • Updated 2 days ago • 35

Arm/yolov7-seg-int8-xnnpack-executorch

Image Segmentation • Updated 2 days ago • 34

Arm/mobile-sam-int8-xnnpack-executorch

Image Segmentation • Updated 2 days ago • 36

Arm/minilm-l6-v2-int8-litert

Feature Extraction • Updated 3 days ago • 8

Arm/bge-base-en-v1.5-int8-litert

Feature Extraction • Updated 3 days ago • 23

Arm/nomic-embed-text-v1-int8-litert

Feature Extraction • Updated 3 days ago • 6

Arm/mobilenet-v3-small-int8-xnnpack-executorch

Image Classification • Updated 2 days ago • 125

Arm/qwen3-0-6b-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 3 days ago • 48

Arm/llama-3-2-3b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 3 days ago • 24

Arm/gemma-3-1b-base-onnx-genai-int4-emb-int8

Text Generation • Updated 3 days ago • 21

Arm/gemma-3-1b-instruct-onnx-genai-int4-emb-int8

Text Generation • Updated 3 days ago • 25

Arm/qwen2-5-1-5b-instruct-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 3 days ago • 27