Edit Models filters

text-generation-inference

AutoTrain Compatible

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,085

Full-text search

Active filters: quantized

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 1 day ago • 471k • 118

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 3 days ago • 6.67k • 6

MaziyarPanahi/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated 3 days ago • 240 • 6

MaziyarPanahi/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated 3 days ago • 3.19k • 5

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF

Text Generation • Updated 8 days ago • 2.04k • 7

FantasiaFoundry/GGUF-Quantization-Script

Text Generation • Updated 2 days ago • 39

Lewdiculous/Model-Requests

Updated 2 days ago • 26

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated 11 days ago • 7.55k • 28

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 22 days ago • 24.2k • 72

alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2

Text Generation • Updated 6 days ago • 4 • 2

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated 5 days ago • 4.19k • 2

afrideva/Yi-1.5-6B-GGUF

Text Generation • Updated 3 days ago • 1.02k • 2

ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ

Text Generation • Updated Mar 5 • 4 • 6

MaziyarPanahi/Turdus-GPTQ

Text Generation • Updated Jan 18 • 12 • 5

MaziyarPanahi/WizardMath-7B-V1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 228 • 5

MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF

Text Generation • Updated Feb 4 • 202 • 2

Lewdiculous/Kunocchini-7b-128k-test-GGUF-Imatrix

Text Generation • Updated 11 days ago • 1.31k • 20

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 15 days ago • 16

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated 11 days ago • 1.97k • 27

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27 • 340 • 11

argmaxinc/whisperkit-coreml

Updated 1 day ago • 827 • 38

alokabhishek/Llama-2-7b-chat-hf-bnb-4bit

Text Generation • Updated Mar 16 • 44 • 2

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated 11 days ago • 2.53k • 32

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated 11 days ago • 995 • 14

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • Updated Mar 18 • 532 • 5

afrideva/NeuralReyna-Mini-1.8B-v0.3-GGUF

Text Generation • Updated Mar 25 • 248 • 1

MaziyarPanahi/Starling-LM-7B-beta-GPTQ

Text Generation • Updated Mar 29 • 666 • 4

Lewdiculous/Visual-LaylelemonMaidRP-7B-GGUF-IQ-Imatrix

Updated Mar 31 • 478 • 7

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated 30 days ago • 28.8k • 71

HuggingFaceM4/idefics2-8b-AWQ

Image-Text-to-Text • Updated 9 days ago • 3.7k • 23