Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,772

new Full-text search

Active filters: 4-bit

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 15 days ago • 315k • 107

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated about 5 hours ago • 193k • 84

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated 19 days ago • 26.7k • 96

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated 16 days ago • 39.4k • 34

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated 11 days ago • 68.6k • 47

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated about 10 hours ago • 68.5k • 56

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated 20 days ago • 51.2k • 67

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 12 days ago • 22.5k • 70

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated 10 days ago • 113k • 9

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated about 5 hours ago • 8.61k • 5

solidrust/Hermes-2-Pro-Llama-3-8B-AWQ

Text Generation • Updated 3 days ago • 71 • 5

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated about 1 month ago • 36.3k • 170

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated 16 days ago • 3.83k • 13

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 204k • 247

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 60.5k • 39

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Apr 4 • 40.4k • 152

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated 20 days ago • 24.9k • 69

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated 18 days ago • 11.9k • 24

MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.3-32k-GGUF

Text Generation • Updated 10 days ago • 1.13k • 9

MaziyarPanahi/Llama-3-8B-Instruct-v0.5-GGUF

Text Generation • Updated 1 day ago • 1.14k • 3

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 10.6k • 296

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 2.84k • 543

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 11.7k • 68

TheBloke/saiga_mistral_7b-GPTQ

Text Generation • Updated Nov 28, 2023 • 964 • 5

TheBloke/LLaMA2-13B-Psyfighter2-GPTQ

Text Generation • Updated Nov 30, 2023 • 687 • 16

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 673 • 12

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 10.1k • 39

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10 • 579 • 5

HuggingFaceM4/idefics2-8b-AWQ

Image-Text-to-Text • Updated 6 days ago • 2.85k • 22

PrunaAI/Meta-Llama-3-70b-instruct-AWQ-smashed

Text Generation • Updated 12 days ago • 545 • 9