Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

2,427

Full-text search

Active filters: gguf-my-repo

win10/llama3-13.45b-Instruct-Q4_K_M-GGUF

Text Generation • Updated 10 days ago • 33

wegqrbeba/Meta-Llama-3-8B-Q5_K_M-GGUF

Text Generation • Updated 10 days ago • 30

cobrakenji/granite-20b-code-instruct-Q2_K-GGUF

Text Generation • Updated 10 days ago • 24

jimsweb/Meta-Llama-3-8B-Q8_0-GGUF

Text Generation • Updated 10 days ago • 34

Aloshe/Sheared-LLaMA-1.3B-Q8_0-GGUF

Updated 10 days ago • 152

mintaeng/Meta-Llama-3-8B-Q5_K_M-GGUF

Text Generation • Updated 10 days ago • 40

israellaguan/Tinyllama-moe4-Q8_0-GGUF

Updated 9 days ago • 211

kowlick/Codestral-22B-v0.1-Q8_0-GGUF

Updated 9 days ago • 48

eipi1-0/Qwen2-7B-Q4_K_M-GGUF

Text Generation • Updated 9 days ago • 37

SixOpen/Meta-Llama-3-8B-IQ3_M-GGUF

Text Generation • Updated 9 days ago • 411

SixOpen/Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated 9 days ago • 46

Ransss/YiffyEstopianMaid-13B-Q6_K-GGUF

Updated 9 days ago • 26

huangyt/module_v7-Q4_K_M-GGUF

Updated 9 days ago • 20

Jarbas/all-MiniLM-L6-v2-Q4_K_M-GGUF

Sentence Similarity • Updated 9 days ago • 26

ivar-vl/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated 9 days ago • 81

ccolicino/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

Updated 9 days ago • 25

eccheng/Phi-3-mini-128k-instruct-Q4_0-GGUF

Text Generation • Updated 9 days ago • 254

frcp/Ocelot-Ko-self-instruction-10.8B-v1.0-Q4_K_M-GGUF

Text Generation • Updated 8 days ago • 25

gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF

Text Generation • Updated 8 days ago • 422

frcp/gemma-summary-v01-Q4_K_M-GGUF

Text Generation • Updated 8 days ago • 196

qnixsynapse/Meta-Llama-3-8B-Instruct-IQ4_XS-GGUF

Text Generation • Updated 8 days ago • 76

waltervix/dolphin-2.9.2-qwen2-7b-Q4_K_M-GGUF

Updated 8 days ago • 46

farpluto/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated 8 days ago • 43

zhentaoyu/Llama-2-7b-chat-hf-Q4_0-GGUF

Text Generation • Updated 8 days ago • 403

evshiron/Llama-3-8B-Sydney-Q4_K_M-GGUF

Updated 8 days ago • 45

magiccpp/open_llama_3b_v2-Q8_0-GGUF

Updated 8 days ago • 376

huggingkot/dolphin-2.9.2-Phi-3-Medium-abliterated-Q4_K_M-GGUF

Updated 8 days ago • 26

pewapo6599/Llama3-Toxic-8B-imat-Q5_K_M-GGUF

Updated 6 days ago • 57

e2jhiubyiiyvw/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 8 days ago • 42

Tech-Meld/Hajax_Chat_1.0-Q3_K_S-GGUF

Updated 8 days ago • 353