Edit Models filters

text-generation-inference

4-bit precision

AutoTrain Compatible

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,195

Full-text search

Active filters: quantized

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 7 days ago • 104k • 31

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 15 days ago • 371k • 133

argmaxinc/whisperkit-coreml

Updated about 23 hours ago • 850 • 45

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated 6 days ago • 2.52k • 5

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated 25 days ago • 5.67k • 31

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 9.09k • 105

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 8k • 20

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 12 days ago • 1.58k • 4

Mozilla/mxbai-embed-large-v1-llamafile

Feature Extraction • Updated 18 days ago • 3

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2-GGUF

Text Generation • Updated 6 days ago • 2.81k • 2

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated 3 days ago • 269 • 2

legraphista/internlm2-math-plus-1_8b-IMat-GGUF

Text Generation • Updated 1 day ago • 3.03k • 2

legraphista/internlm2-math-plus-7b-IMat-GGUF

Text Generation • Updated 1 day ago • 4.77k • 2

legraphista/internlm2-math-plus-20b-IMat-GGUF

Text Generation • Updated 1 day ago • 316 • 2

MaziyarPanahi/MixTAO-7Bx2-MoE-Instruct-v7.0-GGUF

Text Generation • Updated Feb 4 • 257 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 2.58k • 37

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated 25 days ago • 2.3k • 29

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27 • 294 • 12

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated 25 days ago • 1.12k • 16

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Apr 15 • 1.71k • 27

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 46.5k • 28

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 6.61k • 74

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 3.45k • 17

AIFS/Llama3-4x8B-Time-Agents-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 35 • 1

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 12.1k • 51

MaziyarPanahi/Llama-3-8B-Instruct-v0.7-GGUF

Text Generation • Updated 12 days ago • 1.48k • 2

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated 23 days ago • 36.5k • 3

afrideva/Phi-3-mini-4k-grammar-correction-GGUF

Text Generation • Updated 17 days ago • 1.68k • 1

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 17 days ago • 16.2k • 9

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1-GGUF

Text Generation • Updated 6 days ago • 2.45k • 1