Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

Models

1,863

Full-text search

Active filters: llama-cpp

helloAI333/TinyLlama-Cinder-Agent-Rag-Q8_0-GGUF

Updated 5 days ago • 130 • 1

NikolayKozloff/RoLlama2-7b-Instruct-Q8_0-GGUF

Updated 5 days ago • 12 • 1

NikolayKozloff/RoLlama2-7b-Chat-Q8_0-GGUF

Updated 5 days ago • 12 • 1

NikolayKozloff/RoLlama2-7b-Base-Q8_0-GGUF

Updated 5 days ago • 12 • 1

NikolayKozloff/RoMistral-7b-Instruct-Q8_0-GGUF

Updated 5 days ago • 18 • 1

NikolayKozloff/Master-Yi-9B-Q4_0-GGUF

Updated 4 days ago • 24 • 1

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 30 • 1

NikolayKozloff/SambaLingo-Slovenian-Chat-Q4_K_M-GGUF

Updated 4 days ago • 412 • 1

NikolayKozloff/tyr-Q8_0-GGUF

Text Generation • Updated 4 days ago • 12 • 1

NikolayKozloff/Falcon2-5.5B-Dutch-Q4_0-GGUF

Updated 4 days ago • 651 • 1

NikolayKozloff/Llama-3-8b-ita-ties-Q8_0-GGUF

Updated 4 days ago • 25 • 1

NikolayKozloff/Yi-1.5-9B-Chat-16K-Q8_0-GGUF

Updated 3 days ago • 127 • 1

NikolayKozloff/Yi-1.5-9B-32K-Q6_K-GGUF

Updated 3 days ago • 65 • 1

NikolayKozloff/Yi-1.5-9B-32K-Q4_K_M-GGUF

Updated 3 days ago • 25 • 1

mudler/L3-8B-Stheno-v3.1-Q4_K_M-GGUF

Updated 3 days ago • 46 • 1

NikolayKozloff/Falcon2-5.5B-Swedish-Q8_0-GGUF

Updated 3 days ago • 11 • 1

NikolayKozloff/Falcon2-5.5B-Italian-Q8_0-GGUF

Updated 3 days ago • 18 • 1

NikolayKozloff/Alphacode-MALI-11B-Q8_0-GGUF

Text Generation • Updated 3 days ago • 11 • 1

NikolayKozloff/Alphacode-MALI-9B-Q8_0-GGUF

Text Generation • Updated 3 days ago • 14 • 1

NikolayKozloff/shisa-v1-llama3-8b-Q8_0-GGUF

Updated 3 days ago • 41 • 1

NikolayKozloff/llama-3-typhoon-v1.5-8b-instruct-Q6_K-GGUF

Text Generation • Updated 3 days ago • 27 • 1

ssmits/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 86 • 1

ssmits/Phi-3-medium-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 137 • 1

ssmits/Phi-3-medium-128k-instruct-Q6_K-GGUF

Text Generation • Updated 2 days ago • 73 • 1

ssmits/Phi-3-medium-4k-instruct-Q8_0-GGUF

Text Generation • Updated 2 days ago • 129 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-Q6_K-GGUF

Text Generation • Updated 2 days ago • 75 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-Q4_0-GGUF

Text Generation • Updated 2 days ago • 71 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 28 • 1

NikolayKozloff/Phi-3-medium-128k-instruct-Q4_0-GGUF

Text Generation • Updated 2 days ago • 43 • 1

NikolayKozloff/Phi-3-medium-128k-instruct-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 24 • 1