Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

7,151

Full-text search

Active filters: llama-cpp

Silvelter/Bezaliel_p1.1-12B-Q6_K-GGUF

Updated 8 days ago • 37 • 1

darkc0de/Llama-3.2-3B-Instruct-abliterated-Q4_K_M-GGUF

Updated 8 days ago • 43 • 1

NikolayKozloff/Mistral-NeMo-Minitron-8B-Instruct-Q8_0-GGUF

Updated 8 days ago • 32 • 1

SaisExperiments/ProbSucks-4B-Q8_0-GGUF

Updated 8 days ago • 13 • 1

ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B-Q4_0-GGUF

Updated 7 days ago • 46 • 1

Triangle104/Stellar-Odyssey-12b-v0.0-Q4_K_S-GGUF

Updated 7 days ago • 15 • 1

Triangle104/Stellar-Odyssey-12b-v0.0-Q4_K_M-GGUF

Updated 7 days ago • 24 • 1

Triangle104/Stellar-Odyssey-12b-v0.0-Q5_K_S-GGUF

Updated 7 days ago • 18 • 1

Triangle104/Stellar-Odyssey-12b-v0.0-Q5_K_M-GGUF

Updated 7 days ago • 15 • 1

WSDW/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 147 • 1

djuna/L3.1-Promissum_Mane-8B-Della-calc-Q5_K_M-GGUF

Updated 5 days ago • 26 • 1

Alex01837178373/vikhr_nemo_orpo_dostoevsky_12b_slerp-Q4_K_M-GGUF

Updated 5 days ago • 57 • 1

Alex01837178373/vikhr_nemo_orpo_dostoevsky_12b_slerp-Q8_0-GGUF

Updated 5 days ago • 66 • 1

zelk12/recoilme-gemma-2-Ataraxy-9B-v0.1-t0.25-Q6_K-GGUF

Text Generation • Updated 3 days ago • 29 • 1

ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B-Q5_0-GGUF

Updated 5 days ago • 31 • 1

SvalTek/L3-ColdBrew-SpicyReflect-Q4_K_M-GGUF

Updated 5 days ago • 24 • 1

AELLM/gemma-2-aeria-9b-Q5_K_M-GGUF

Updated 4 days ago • 72 • 1

AELLM/gemma-2-inko-9b-Q5_K_M-GGUF

Updated 4 days ago • 28 • 1

zelk12/recoilme-gemma-2-Gutenberg-Doppel-9B-v0.1-Q6_K-GGUF

Text Generation • Updated 3 days ago • 26 • 1

zelk12/recoilme-gemma-2-Ataraxy-9B-v0.2-Q6_K-GGUF

Text Generation • Updated 3 days ago • 28 • 1

zelk12/recoilme-gemma-2-Ataraxy-9B-v0.1-t0.375-Q6_K-GGUF

Text Generation • Updated 3 days ago • 24 • 1

ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B-Q4_K_M-GGUF

Updated 4 days ago • 93 • 1

AELLM/gemma-2-aeria-infinity-9b-Q5_K_M-GGUF

Updated 4 days ago • 27 • 1

thidayatpiliang/Llama-3.2-3B-Instruct-uncensored-Q8_0-GGUF

Updated 3 days ago • 64 • 1

NikolayKozloff/Mistral-Nemo-Kurdish-Q6_K-GGUF

Updated 3 days ago • 23 • 1

NikolayKozloff/Mistral-Nemo-Kurdish-Q5_K_S-GGUF

Updated 3 days ago • 23 • 1

NikolayKozloff/Mistral-Nemo-Kurdish-Q5_K_M-GGUF

Updated 3 days ago • 26 • 1

NikolayKozloff/Mistral-Nemo-Kurdish-Instruct-Q5_K_M-GGUF

Updated 3 days ago • 23 • 1

NikolayKozloff/Mistral-Nemo-Kurdish-Instruct-Q5_K_S-GGUF

Updated 3 days ago • 23 • 1

soumitsr/flan-t5-large-Q4_K_M-GGUF

Text2Text Generation • Updated 3 days ago • 5 • 1