Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

Models

1,763

Full-text search

Active filters: llama-cpp

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated 6 days ago • 694 • 23

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated 7 days ago • 625 • 7

NikolayKozloff/pip-code-bandit-Q8_0-GGUF

Text Generation • Updated 7 days ago • 171 • 4

NikolayKozloff/llama3_8b_chat_brainstorm-Q6_K-GGUF

Text Generation • Updated 7 days ago • 42 • 3

NikolayKozloff/SFR-Iterative-DPO-LLaMA-3-8B-R-Q8_0-GGUF

Updated 6 days ago • 329 • 3

NikolayKozloff/SFR-SFT-LLaMA-3-8B-R-Q8_0-GGUF

Updated 6 days ago • 342 • 3

YorkieOH10/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated 14 days ago • 603 • 6

upendrab/llama-3-sqlcoder-8b-Q4_K_M-GGUF

Text Generation • Updated 10 days ago • 104 • 3

cobrakenji/granite-34b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated 9 days ago • 249 • 2

NikolayKozloff/dao-9b-Q8_0-GGUF

Updated 6 days ago • 152 • 2

seawolf2357/Meta-Llama-3-70B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 42 • 2

NikolayKozloff/Yi-1.5-9B-32K-Q8_0-GGUF

Updated about 11 hours ago • 5 • 2

kpkiosk66/L3-8B-Stheno-v3.1-Q8_0-GGUF

Updated about 9 hours ago • 2

ggml-org/gemma-1.1-7b-it-Q4_0-GGUF

Updated Apr 5 • 50 • 1

hus960/openbuddy-qwen1.5-14b-v21.1-32k-Q4_K_M-GGUF

Text Generation • Updated 27 days ago • 344 • 2

m0javad/Meta-Llama-3-8B-Q8_0-GGUF

Text Generation • Updated 27 days ago • 54 • 1

RachidAR/Llama-3-8B-saiga-suzume-ties-Q6_K-GGUF

Text Generation • Updated 24 days ago • 78 • 2

newsletter/zephyr-7b-beta-Q6_K-GGUF

Text Generation • Updated 6 days ago • 31 • 1

bunnycore/kappa-3-phi-abliterated-Q5_K_M-GGUF

Updated 14 days ago • 397 • 2

mahiatlinux/kappa-3-phi-abliterated-Q4_K_M-GGUF

Updated 13 days ago • 280 • 1

mudler/prem-1B-chat-Q5_0-GGUF

Text Generation • Updated 11 days ago • 93 • 1

rjmalagon/Nxcode-CQ-7B-orpo-Q8_0-GGUF

Text Generation • Updated 11 days ago • 103 • 2

YorkieOH10/granite-20b-code-instruct-Q8_0-GGUF

Text Generation • Updated 11 days ago • 4.21k • 2

NikolayKozloff/neo_7b-Q8_0-GGUF

Updated 10 days ago • 60 • 5

JustData/Silver-Sun-v2-11B-Q8_0-GGUF

Updated 9 days ago • 16 • 1

LeroyDyer/Mixtral_AI_MasterMind_TheArchive-Q4_K_S-GGUF

Updated 6 days ago • 830 • 1

Ransss/Pantheon-RP-1.0-8b-Llama-3-Q8_0-GGUF

Updated 8 days ago • 81 • 1

newsletter/dolphin-2.7-mixtral-8x7b-Q6_K-GGUF

Updated 8 days ago • 65 • 1

newsletter/c4ai-command-r-v01-Q6_K-GGUF

Updated 8 days ago • 59 • 1

NikolayKozloff/Aura-Llama-Abliterated-Q8_0-GGUF

Updated 7 days ago • 223 • 2