Edit Models filters

text-generation-inference

4-bit precision

AutoTrain Compatible

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,210

Full-text search

Active filters: quantized

legraphista/Codestral-22B-v0.1-IMat-GGUF

Text Generation • Updated 2 days ago • 1.24k • 10

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 10 days ago • 179k • 33

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 18 days ago • 277k • 134

argmaxinc/whisperkit-coreml

Updated about 14 hours ago • 894 • 47

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated 28 days ago • 5.45k • 32

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated 9 days ago • 2.66k • 5

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated about 6 hours ago • 361 • 4

legraphista/K2-Chat-IMat-GGUF

Text Generation • Updated 1 day ago • 137 • 4

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated 28 days ago • 1.09k • 17

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 10k • 106

Mozilla/mxbai-embed-large-v1-llamafile

Feature Extraction • Updated 22 days ago • 3

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 20 days ago • 18.8k • 10

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated 6 days ago • 513 • 2

legraphista/internlm2-math-plus-1_8b-IMat-GGUF

Text Generation • Updated 5 days ago • 3.15k • 2

legraphista/internlm2-math-plus-7b-IMat-GGUF

Text Generation • Updated 5 days ago • 5.04k • 2

legraphista/internlm2-math-plus-20b-IMat-GGUF

Text Generation • Updated 5 days ago • 1.18k • 2

legraphista/Yuan2-M32-hf-IMat-GGUF

Text Generation • Updated 2 days ago • 361 • 2

legraphista/K2-IMat-GGUF

Text Generation • Updated 1 day ago • 142 • 2

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 148 • 2

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 1.24k • 37

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 4 days ago • 17

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated 28 days ago • 2.46k • 29

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27 • 257 • 12

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated 28 days ago • 1.3k • 33

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 4.84k • 74

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 8.12k • 20

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 5.29k • 51

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 15 days ago • 1.65k • 4

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated 26 days ago • 36.5k • 3

afrideva/kappa-3-phi-abliterated-GGUF

Text Generation • Updated 21 days ago • 1.45k • 2