Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

2,398

Full-text search

Active filters: gguf-my-repo

Ransss/L3-8B-Stheno-v3.2-Q8_0-GGUF

Updated 14 days ago • 54 • 1

NikolayKozloff/Llama-2-7b-Ukrainian-Q8_0-GGUF

Text Generation • Updated 14 days ago • 25 • 1

v8karlo/UNCENSORED-Wukong-Phi-3-Instruct-Ablated-Q4_K_M-GGUF

Updated 13 days ago • 335 • 1

v8karlo/UNCENSORED-TinyDolphin-2.8.1-1.1b-Q4_K_M-GGUF

Updated 13 days ago • 112 • 2

v8karlo/UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

Text Generation • Updated 13 days ago • 212 • 1

v8karlo/UNCENSORED-TinyDolphin-3x-MoE-Q4_K_M-GGUF

Updated 13 days ago • 72 • 1

v8karlo/UNCENSORED-TinyLlama-1.1B-intermediate-step-1431k-3T-Q4_K_M-GGUF

Updated 13 days ago • 10 • 1

SteelQuants/L3-Aethora-15B-Q4_K_M-GGUF

Updated 13 days ago • 264 • 3

v8karlo/UNCENSORED-TinyDolphin-2.8-1.1b-Q5_K_M-GGUF

Updated 13 days ago • 10 • 2

v8karlo/UNCENSORED-TinyLlama-1.1B-intermediate-step-1431k-3T-Q5_K_M-GGUF

Updated 13 days ago • 58 • 1

NikolayKozloff/Qwen2-7B-Q8_0-GGUF

Text Generation • Updated 13 days ago • 151 • 2

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 13 days ago • 203 • 3

NikolayKozloff/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 13 days ago • 31 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated 13 days ago • 123 • 1

NikolayKozloff/Qwen2-7B-Q6_K-GGUF

Text Generation • Updated 13 days ago • 38 • 1

NikolayKozloff/Qwen2-7B-Q5_K_M-GGUF

Text Generation • Updated 13 days ago • 44 • 1

NikolayKozloff/Qwen2-7B-Q5_K_S-GGUF

Text Generation • Updated 13 days ago • 24 • 1

NikolayKozloff/Qwen2-7B-Q4_K_M-GGUF

Text Generation • Updated 13 days ago • 42 • 1

NikolayKozloff/Qwen2-7B-Q4_K_S-GGUF

Text Generation • Updated 13 days ago • 29 • 1

NikolayKozloff/Qwen2-7B-Q4_0-GGUF

Text Generation • Updated 13 days ago • 100 • 1

NikolayKozloff/Qwen2-7B-Q5_0-GGUF

Text Generation • Updated 13 days ago • 32 • 1

NikolayKozloff/L3-Aethora-15B-Q5_K_S-GGUF

Updated 12 days ago • 25 • 1

NikolayKozloff/L3-Aethora-15B-Q4_K_S-GGUF

Updated 12 days ago • 31 • 1

NikolayKozloff/L3-Aethora-15B-Q5_K_M-GGUF

Updated 12 days ago • 90 • 1

NikolayKozloff/L3-Aethora-15B-Q6_K-GGUF

Updated 12 days ago • 90 • 1

NikolayKozloff/L3-Aethora-15B-Q8_0-GGUF

Updated 12 days ago • 88 • 1

NikolayKozloff/L3-Aethora-15B-Q4_0-GGUF

Updated 12 days ago • 36 • 1

NikolayKozloff/L3-Aethora-15B-Q5_0-GGUF

Updated 12 days ago • 25 • 1

Nitral-AI/Hathor-L3-8B-v.01-Q5_K_M-GGUF

Updated 12 days ago • 83 • 1

Ayyystin/llama2_7b_chat_uncensored-Q4_0-GGUF

Updated 11 days ago • 462 • 1