Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,574

Full-text search

Active filters: 4-bit

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated 3 days ago • 9.74k • 30

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 2 days ago • 33.5k • 21

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated 3 days ago • 1.87k • 20

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated 3 days ago • 4.68k • 20

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 1 day ago • 21.9k • 16

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated 5 days ago • 3.55k • 26

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated 8 days ago • 9.43k • 19

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 3 days ago • 16k • 11

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated 3 days ago • 12.1k • 10

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 3 days ago • 737 • 10

unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated 1 day ago • 394 • 10

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated about 3 hours ago • 327 • 8

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 3 days ago • 501k • 160

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated 3 days ago • 639 • 7

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 1 day ago • 999 • 7

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated 3 days ago • 425 • 7

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 3 days ago • 365k • 112

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated 17 days ago • 679 • 7

radm/Athene-70B-AWQ

Text Generation • Updated 6 days ago • 581 • 4

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated 2 days ago • 768 • 4

unsloth/Mistral-Large-Instruct-2407-bnb-4bit

Text Generation • Updated 1 day ago • 113 • 4

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated 1 day ago • 86 • 4

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated 10 days ago • 3k • 224

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 12 days ago • 159k • 24

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • Updated 9 days ago • 302 • 5

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated 3 days ago • 5.69k • 3

MaziyarPanahi/SmolLM-1.7B-Instruct-GGUF

Text Generation • Updated 4 days ago • 564 • 3

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated about 19 hours ago • 442 • 3

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated 2 days ago • 312 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 917 • 552