Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

Models

2,369

Full-text search

Active filters: llama-cpp

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated 26 days ago • 1.68k • 28

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated 26 days ago • 1.45k • 18

Julia-Kovacs/SambaLingo-Hungarian-Base-70B-Q4_K_M-GGUF

Updated 9 days ago • 7 • 3

YorkieOH10/granite-8b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 6 • 416 • 7

SteelQuants/L3-Aethora-15B-Q4_K_M-GGUF

Updated 3 days ago • 141 • 2

NikolayKozloff/Qwen2-7B-Q8_0-GGUF

Text Generation • Updated 2 days ago • 46 • 2

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 127 • 2

SmartGitiCorp/PersianMind-v1.0-Q8_0-GGUF

Text Generation • Updated 7 days ago • 1.74k • 11

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Apr 11 • 194 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q4_K_M-GGUF

Updated Apr 12 • 129 • 1

boxomcfoxo/YiffyEstopianMaid-13B-GGUF

Updated Apr 19 • 421 • 2

Clevyby/Silicon-Masha-7B-Q5_K_S-GGUF

Text Generation • Updated May 2 • 39 • 1

DavidAU/TinyLlama-1.1B-2.5T-chat-and-function-calling-Q8_0-GGUF

Text Generation • Updated Apr 20 • 48 • 2

chenduo/Llama-3-Unholy-8B-e4-Q6_K-GGUF

Updated Apr 27 • 61 • 1

Azazelle/L3-RP_io-Q6_K-GGUF

Updated May 2 • 151 • 1

YorkieOH10/granite-20b-code-instruct-Q8_0-GGUF

Text Generation • Updated about 1 month ago • 4.23k • 3

tinybiggames/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 314 • 3

QiyuWu/DPO-Internlm2-1_8B-Q4_K_M-GGUF

Updated 25 days ago • 201 • 1

AlirezaF138/Llama-3-Persian-8B-LoRA-Q6_K-GGUF

Updated 18 days ago • 160 • 2

NikolayKozloff/tweety-7b-armenian-v24a-Q8_0-GGUF

Updated 8 days ago • 12 • 1

VlSav/saiga_phi3_medium_sft_m1_d2-Q4_K_M-GGUF

Updated 8 days ago • 12 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q5_K_M-GGUF

Text Generation • Updated 8 days ago • 100 • 2

NikolayKozloff/Nanbeige2-16B-Chat-Q4_K_M-GGUF

Text Generation • Updated 8 days ago • 66 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q4_K_S-GGUF

Text Generation • Updated 8 days ago • 12 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q4_0-GGUF

Text Generation • Updated 8 days ago • 10 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q5_K_S-GGUF

Text Generation • Updated 8 days ago • 23 • 1

NikolayKozloff/Nanbeige2-16B-Chat-Q5_0-GGUF

Text Generation • Updated 8 days ago • 12 • 1

waltervix/Llama-3-8B-Dolphin-Portuguese-v0.3-Q4_K_M-GGUF

Updated 8 days ago • 30 • 1

Svngoku/African-ultrachat-alpaca-Q5_K_M-GGUF

Updated 7 days ago • 34 • 1

NikolayKozloff/Wiedervereinigung-7b-dpo-laser-Q8_0-GGUF

Updated 8 days ago • 57 • 1