Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

7,152

Full-text search

Active filters: llama-cpp

v8karlo/Llama-3.2-3B-Instruct-uncensored-Q8_0-GGUF

Updated 12 days ago • 140 • 1

mashima/EZO-Humanities-9B-gemma-2-it-Q8_0-GGUF

Text Generation • Updated 12 days ago • 23 • 1

bunnycore/Qwen-2.5-3b-Evol-CoT-V3-IQ4_NL-GGUF

Updated 11 days ago • 51 • 1

NikolayKozloff/Llama-eus-8B-Q8_0-GGUF

Text Generation • Updated 11 days ago • 17 • 1

NikolayKozloff/Llama-3.1-8B-Instruct-bnb-4bit-shqip-Q8_0-GGUF

Text Generation • Updated 11 days ago • 37 • 1

Jimbo-Joe/MN-BackyardAI-Party-12B-v1-Q8_0-GGUF

Updated 11 days ago • 54 • 1

Potatass/Replete-LLM-V2.5-Qwen-14b-Q4_K_M-GGUF

Updated 11 days ago • 7 • 1

Jimbo-Joe/MN-BackyardAI-Party-12B-v1-Q4_K_M-GGUF

Updated 11 days ago • 21 • 1

Abc7347/BlackSheep-Llama3.2-3B-Q4_K_M-GGUF

Updated 11 days ago • 721 • 3

ClaudioItaly/Memory-9-Q5_K_M-GGUF

Updated 11 days ago • 24 • 1

ClaudioItaly/Memory-9-Q4_K_M-GGUF

Updated 11 days ago • 58 • 1

arkenndoe/MN-12B-Vespa-x1-Q6_K-GGUF

Updated 10 days ago • 49 • 1

Triangle104/MN-BackyardAI-Party-12B-v1-Q4_K_S-GGUF

Updated 10 days ago • 25 • 1

Triangle104/MN-BackyardAI-Party-12B-v1-Q4_K_M-GGUF

Updated 10 days ago • 37 • 1

Triangle104/MN-BackyardAI-Party-12B-v1-Q5_K_S-GGUF

Updated 10 days ago • 27 • 1

Triangle104/MN-BackyardAI-Party-12B-v1-Q5_K_M-GGUF

Updated 10 days ago • 29 • 1

Triangle104/MN-BackyardAI-Party-12B-v1-Q6_K-GGUF

Updated 10 days ago • 29 • 1

Triangle104/MN-BackyardAI-Party-12B-v1-Q8_0-GGUF

Updated 9 days ago • 34 • 1

NikolayKozloff/gemma-2-2b-jpn-it-Q8_0-GGUF

Text Generation • Updated 9 days ago • 46 • 1

bunnycore/Qwen-2.5-7b-TitanFusion-v3-IQ4_NL-GGUF

Updated 9 days ago • 50 • 1

SteelQuants/MSM-MS-Cydrion-22B-Q6_K-GGUF

Updated 9 days ago • 80 • 2

aashish1904/gemma-2-2b-jpn-it-Q2_K-GGUF

Text Generation • Updated 9 days ago • 36 • 1

zelk12/recoilme-gemma-2-Ataraxy-9B-v0.1-Q6_K-GGUF

Text Generation • Updated 3 days ago • 29 • 2

SzilviaB/SzilviaB-Daredevil-LongWriter-8B_abliterated-Q8_0-GGUF

Updated 9 days ago • 30 • 2

dasChronos1/MSM-MS-Cydrion-22B-Q8_0-GGUF

Updated 9 days ago • 143 • 1

dasChronos1/Stheno-Hercules-3.1-8B-Q8_0-GGUF

Updated 9 days ago • 27 • 1

DreadPoor/WIP_TEST_PENDING_8-Q4_K_M-GGUF

Updated 8 days ago • 21 • 1

ZeroXClem/Stheno-Hercules-3.1-8B-Q4_0-GGUF

Updated 8 days ago • 40 • 1

ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B-Q8_0-GGUF

Updated 8 days ago • 27 • 1

ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B-Q4_0-GGUF

Updated 7 days ago • 111 • 1