Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

6,763

Full-text search

Active filters: llama-cpp

fernandoruiz/Mistral-Nemo-Instruct-2407-Q4_K_S-GGUF

Updated Jul 22 • 9

victorbur/deepseek-coder-6.7B-kexer-Q8_0-GGUF

Updated Jul 22 • 6

Jianping746/DeepSeek-V2-Lite-Chat-Q6_K-GGUF

Jianping746/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF

nazimali/Mistral-Nemo-Instruct-2407-Q6_K-GGUF

Updated Jul 22 • 5

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

Updated Jul 22 • 7 • 1

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q6_K-GGUF

Updated Jul 22 • 7 • 1

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

Updated Jul 22 • 5 • 1

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q5_K_S-GGUF

Updated Jul 22 • 11 • 1

NikolayKozloff/SauerkrautLM-Nemo-12b-Instruct-Q8_0-GGUF

Updated Jul 22 • 2 • 1

victorbur/SpyazWeb_AI_DeepMind_Project-Q8_0-GGUF

Updated Jul 22 • 15

NikolayKozloff/SauerkrautLM-Nemo-12b-Instruct-Q6_K-GGUF

Updated Jul 22 • 16 • 1

NikolayKozloff/SauerkrautLM-Nemo-12b-Instruct-Q5_K_M-GGUF

Updated Jul 22 • 7 • 1

NikolayKozloff/SauerkrautLM-Nemo-12b-Instruct-Q5_K_S-GGUF

Updated Jul 22 • 8 • 1

bunnycore/L3-Intermix-v0.2-Q4_K_M-GGUF

martintomov/Meta-Llama-3-8B-Alternate-Tokenizer-Q4_K_S-GGUF

Text Generation • Updated Jul 22 • 1

inflatebot/helide-alpha-r4-Q8_0-GGUF

alanrios2001/deepseek-coder-7b-instruct-v1.5-Q6_K-GGUF

Updated Jul 22 • 1

spachava/DeepSeek-Coder-V2-Lite-Instruct-Q8_0-GGUF

Updated Jul 22 • 4

pseelam/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

Updated Jul 22 • 2

shisahni/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23 • 8

mjschock/open_llama_3b_v2-Q8_0-GGUF

Updated Jul 23 • 6 • 1

nvhf/Triplex-Q6_K-GGUF

Updated Jul 23 • 8

toktomo/Phi-3-medium-4k-instruct-Q8_0-GGUF

Text Generation • Updated Jul 23 • 4

biggesto/news_mistral_test-Q5_K_M-GGUF

elvispresniy/Qwen2-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23

linxsxs/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23

xsydorm00/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 23

bbebbea/Irbis-7b-v0.1-Q5_K_M-GGUF

Text Generation • Updated Jul 23 • 9

PioneerMNDR/t5_translate_en_ru_zh_small_1024-Q8_0-GGUF

Translation • Updated Jul 23 • 27