Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

Models

1,493

Full-text search

Active filters: llama-cpp

NikolayKozloff/kappa-3-phi-abliterated-Q8_0-GGUF

Updated 6 days ago • 891 • 13

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated 2 days ago • 332 • 13

YorkieOH10/granite-34b-code-instruct-Q8_0-GGUF

Text Generation • Updated 6 days ago • 167 • 5

NikolayKozloff/granite-8b-code-base-Q8_0-GGUF

Text Generation • Updated 5 days ago • 158 • 5

Vikhrmodels/Vikhr-7B-instruct_0.4-GGUF

Updated 7 days ago • 6.25k • 5

YorkieOH10/granite-8b-code-instruct-Q8_0-GGUF

Text Generation • Updated 6 days ago • 342 • 4

NikolayKozloff/neo_7b-Q8_0-GGUF

Updated 2 days ago • 41 • 4

NikolayKozloff/mistral-orthogonalized-Q8_0-GGUF

Updated 6 days ago • 59 • 3

YorkieOH10/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 231 • 3

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated 2 days ago • 135 • 3

NikolayKozloff/Llama-3-8B-Instruct-Coder-Q8_0-GGUF

Updated 8 days ago • 128 • 5

NikolayKozloff/granite-3b-code-base-Q8_0-GGUF

Text Generation • Updated 5 days ago • 419 • 2

NikolayKozloff/granite-3b-code-instruct-Q8_0-GGUF

Text Generation • Updated 5 days ago • 581 • 2

NikolayKozloff/granite-20b-code-instruct-Q4_0-GGUF

Text Generation • Updated 5 days ago • 4.63k • 2

NikolayKozloff/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • Updated 5 days ago • 344 • 2

YorkieOH10/granite-20b-code-base-Q8_0-GGUF

Text Generation • Updated 3 days ago • 4.13k • 2

NikolayKozloff/Minerva-3B-Instruct-v1.0-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 256 • 2

tinybiggames/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 42 • 2

jdelpino-ai/multi_verse_model-Q8_0-GGUF

Updated Mar 30 • 8 • 1

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5 • 135 • 1

m0javad/PersianMind-v1.0-Q8_0-GGUF

Text Generation • Updated Apr 6 • 108 • 4

DavidAU/Gecko-7B-v0.1-DPO-Q4_K_M-GGUF

Updated about 1 month ago • 156 • 1

DavidAU/Maiden-Unquirked-20B-Q4_K_S-GGUF

Updated about 1 month ago • 21 • 1

DavidAU/DistiLabelOrca-TinyLLama-1.1B-Q8_0-GGUF

Question Answering • Updated 22 days ago • 157 • 1

ehristoforu/Gistral-16B-Q4_K_M-GGUF

Text Generation • Updated 21 days ago • 59 • 3

DavidAU/TinyDolphin-2.8-1.1b_oasst2_chatML_all_Cluster_dare_ties_v1-Q8_0-GGUF

Updated 20 days ago • 144 • 1

hus960/openbuddy-qwen1.5-14b-v21.1-32k-Q4_K_M-GGUF

Text Generation • Updated 19 days ago • 229 • 1

DavidAU/Meta-Llama-3-8B-Instruct-function-calling-json-mode-Q8_0-GGUF

Updated 17 days ago • 199 • 2

LeroyDyer/Mixtral_AI_CyberVoice-Q4_K_S-GGUF

Audio-to-Audio • Updated 17 days ago • 419 • 1

kat33/Llama-3-8B-Instruct-Gradient-1048k-Q6_K-GGUF

Text Generation • Updated 12 days ago • 31 • 2