Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

100

Full-text search

Active filters: vllm

mistralai/Pixtral-12B-2409

Updated 5 days ago • 9 • 357

mistral-community/pixtral-12b-240910

Image-Text-to-Text • Updated 5 days ago • 377

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Aug 23 • 63.9k • 28

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated 4 days ago • 8.01k • 5

neuralmagic/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18 • 12.7k • 18

neuralmagic/Mixtral-8x22B-Instruct-v0.1-FP8

Text Generation • Updated Aug 12 • 497 • 1

neuralmagic/Phi-3-medium-128k-instruct-FP8

Text Generation • Updated Aug 12 • 34.8k • 5

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 22 • 1.47k • 28

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated 5 days ago • 2.11k • 8

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 5 days ago • 14.3k • 20

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated 5 days ago • 141k • 20

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated 6 days ago • 2.15k • 10

neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated 10 days ago • 452 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated 10 days ago • 215 • 1

neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • Updated 4 days ago • 1.9k • 1

neuralmagic/Phi-3.5-mini-instruct-FP8-KV

Text Generation • Updated 5 days ago • 161 • 1

Inferless/deciLM-7B-GPTQ

Text Generation • Updated Jan 4 • 6 • 1

Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Jan 4 • 20 • 2

Inferless/Mixtral-8x7B-v0.1-int8-GPTQ

Text Generation • Updated Jan 25 • 10 • 2

neuralmagic/Mixtral-8x7B-Instruct-v0.1-FP8

Text Generation • Updated Jul 18 • 1.38k • 2

neuralmagic/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19 • 20.4k • 6

neuralmagic/Meta-Llama-3-70B-Instruct-FP8

Text Generation • Updated Jul 18 • 5.65k • 10

neuralmagic/Qwen2-72B-Instruct-FP8

Text Generation • Updated Jul 18 • 1.11k • 9

neuralmagic/Qwen2-0.5B-Instruct-FP8

Text Generation • Updated Jul 18 • 412 • 2

neuralmagic/Qwen2-1.5B-Instruct-FP8

Text Generation • Updated Jul 18 • 94

neuralmagic/Qwen2-7B-Instruct-FP8

Text Generation • Updated Jul 18 • 678 • 1

nm-testing/SparseLlama-3-8B-pruned_50.2of4-FP8

Text Generation • Updated Jun 25 • 18

FlorianJc/Hermes-2-Pro-Mistral-7B-vllm-fp8

Text Generation • Updated Jul 17 • 15

FlorianJc/openchat-3.6-8b-20240522-vllm-fp8

Text Generation • Updated Jul 17 • 6

FlorianJc/Llama3-ChatQA-1.5-8B-vllm-fp8

Text Generation • Updated Jul 17 • 3