Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

4,055

Full-text search

Active filters: pt

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 4.11k • 37

SillyTilly/mistralai_Mistral-Nemo-Base-2407

Text Generation • Updated Jul 18 • 239 • 1

QuantFactory/Mistral-Nemo-Instruct-2407-GGUF

Updated Jul 26 • 15k • 45

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 393k • 59

meta-llama/Llama-3.1-405B-FP8

Text Generation • Updated Sep 25 • 1.58k • 97

Alibaba-NLP/gte-multilingual-reranker-base

Text Classification • Updated Aug 12 • 10.8k • 48

bartowski/Mistral-Nemo-Instruct-2407-exl2

Text Generation • Updated Jul 22 • 87 • 4

mlx-community/Meta-Llama-3.1-8B-Instruct-4bit

Text Generation • Updated Jul 23 • 6.68k • 12

mlx-community/Meta-Llama-3.1-8B-Instruct-8bit

Text Generation • Updated 15 days ago • 1.59k • 6

mlx-community/Meta-Llama-3.1-70B-Instruct-8bit

Text Generation • Updated Jul 24 • 291 • 4

mlx-community/Meta-Llama-3.1-70B-8bit

Text Generation • Updated Jul 24 • 24 • 2

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 17.2k • 53

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 705k • 35

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 28 • 42.9k • 221

QuantFactory/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 26 • 1.83k • 12

Mozilla/Meta-Llama-3.1-8B-Instruct-llamafile

Updated 6 days ago • 3.35k • 37

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 1.49k • 10

SanctumAI/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Sep 11 • 244k • 16

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated 29 days ago • 131k • 32

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated 20 days ago • 2.13k • 4

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated 29 days ago • 50k • 32

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated 29 days ago • 2.22k • 31

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated 20 days ago • 390 • 14

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 9.34k • 11

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 28 • 3.65k • 36

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Jul 29 • 32.1k • 12

NousResearch/Meta-Llama-3.1-8B-Instruct

Text Generation • Updated Jul 24 • 198k • 28

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 50.2k • 17

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 78.2k • 19

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 26 • 684 • 6