Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

15,110

Full-text search

Active filters: gguf

llmware/bling-phi-3-gguf

Updated 20 days ago • 676 • 9

hfl/llama-3-chinese-8b-instruct-v2-gguf

Updated 9 days ago • 5.49k • 14

qnguyen3/Master-Yi-9B-GGUF

Updated 3 days ago • 537 • 6

mradermacher/Smaug-Llama-3-70B-Instruct-i1-GGUF

Updated 1 day ago • 651 • 6

google/gemma-2b-it

Text Generation • Updated Apr 16 • 261k • 527

dranger003/c4ai-command-r-plus-iMat.GGUF

Text Generation • Updated 16 days ago • 18.6k • 114

Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • Updated 29 days ago • 205k • 75

IlyaGusev/saiga_llama3_8b_gguf

Text Generation • Updated 23 days ago • 33.7k • 50

aaditya/OpenBioLLM-Llama3-8B-GGUF

Text Generation • Updated 18 days ago • 8.88k • 28

dddump/Japanese-TextGen-MoE-TEST-2x7B-NSFW-gguf

Text Generation • Updated 4 days ago • 1.41k • 5

ddh0/Meta-Llama-3-8B-Instruct-bf16-GGUF

Text Generation • Updated 12 days ago • 1.85k • 42

bartowski/Hermes-2-Theta-Llama-3-8B-GGUF

Text Generation • Updated 4 days ago • 5.18k • 5

second-state/Yi-1.5-9B-Chat-16K-GGUF

Text Generation • Updated 1 day ago • 848 • 5

bartowski/Smaug-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 2 days ago • 279 • 5

bartowski/granite-34b-code-instruct-GGUF

Text Generation • Updated 2 days ago • 244 • 5

bartowski/Llama-3-Hercules-5.0-8B-GGUF

Text Generation • Updated 1 day ago • 3.87k • 5

nisten/phi3-medium-4k-gguf

Updated about 13 hours ago • 5

google/madlad400-10b-mt

Translation • Updated Apr 12 • 5.35k • 47

TheBloke/Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Dec 11, 2023 • 186k • 345

miqudev/miqu-1-70b

Updated Feb 4 • 132k • 970

lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 19 days ago • 230k • 152

cognitivecomputations/dolphin-2.9-llama3-8b-gguf

Updated 2 days ago • 19.7k • 67

mradermacher/llama-3-70B-instruct-uncensored-GGUF

Updated 17 days ago • 12.1k • 8

xtuner/llava-phi-3-mini-gguf

Image-to-Text • Updated 23 days ago • 14.8k • 76

cjpais/moondream2-llamafile

Image-Text-to-Text • Updated 13 days ago • 733 • 22

NexaAIDev/octopus-v4-gguf

Updated 15 days ago • 2.62k • 29

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-4bit

Text Generation • Updated 15 days ago • 4.05k • 11

bartowski/Llama-3-8B-Instruct-Coder-v2-GGUF

Text Generation • Updated 14 days ago • 15k • 28

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated 8 days ago • 892 • 11

bartowski/llama-3-70B-Instruct-abliterated-GGUF

Text Generation • Updated 6 days ago • 704 • 4