Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,534

Full-text search

Active filters: instruct

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated 29 days ago • 39

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated 29 days ago • 34

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated 29 days ago • 36

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated 29 days ago • 31

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated 29 days ago • 32

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated 29 days ago • 35

Triangle104/Llama3.1-8B-Fireplace2-Q4_K_S-GGUF

Text Generation • Updated 29 days ago • 24

Triangle104/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated 29 days ago • 29

Triangle104/Llama3.1-8B-Fireplace2-Q5_K_S-GGUF

Text Generation • Updated 29 days ago • 32

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated 28 days ago • 442

mradermacher/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Updated 28 days ago • 493

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated 28 days ago • 697

mradermacher/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Updated 28 days ago • 636

mradermacher/BgGPT-Gemma-2-27B-IT-v1.0-GGUF

Updated 28 days ago • 548

mradermacher/BgGPT-Gemma-2-2.6B-IT-v1.0-i1-GGUF

Updated 28 days ago • 873

tensorblock/metharme-7b-GGUF

Text Generation • Updated 28 days ago • 188

mradermacher/BgGPT-Gemma-2-27B-IT-v1.0-i1-GGUF

Updated 28 days ago • 995

mradermacher/OpenBioLLM-Llama3-70B-GGUF

Updated 2 days ago • 408

mradermacher/OpenBioLLM-Llama3-70B-i1-GGUF

Updated 2 days ago • 1.26k

mav23/13B-HyperMantis-GGUF

Updated 27 days ago • 280

ZeroXClem/Qwen2.5-7B-HomerCreative-Mix-Q8_0-GGUF

Updated 27 days ago • 39

ZeroXClem/Qwen2.5-7B-HomerCreative-Mix-Q6_K-GGUF

Updated 27 days ago • 21

ZeroXClem/Qwen2.5-7B-HomerCreative-Mix-Q5_K_M-GGUF

Updated 27 days ago • 23

ZeroXClem/Qwen2.5-7B-HomerCreative-Mix-Q5_0-GGUF

Updated 27 days ago • 21

ZeroXClem/Qwen2.5-7B-HomerCreative-Mix-Q4_K_M-GGUF

Updated 27 days ago • 33

ZeroXClem/Qwen2.5-7B-HomerCreative-Mix-Q4_0-GGUF

Updated 27 days ago • 54

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q8_0-GGUF

Text Generation • Updated 27 days ago • 31

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q6_K-GGUF

Text Generation • Updated 27 days ago • 36

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q5_K_M-GGUF

Text Generation • Updated 27 days ago • 27

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q5_0-GGUF

Text Generation • Updated 27 days ago • 43