Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

75,232

Full-text search

Active filters: gguf

unsloth/Llama-3.3-70B-Instruct-GGUF

Updated 10 days ago • 27.4k • 52

city96/LTX-Video-gguf

Image-to-Video • Updated Dec 14, 2024 • 7.93k • 17

NousResearch/Hermes-3-Llama-3.2-3B-GGUF

Updated 30 days ago • 21.5k • 31

DavidAU/Gemma-The-Writer-Mighty-Sword-9B-GGUF

Text Generation • Updated 24 days ago • 1.99k • 12

AlicanKiraz0/SenecaLLM-Q4_K_M-GGUF

Updated 20 days ago • 820 • 15

prithivMLmods/SmolLM2-CoT-360M-GGUF

Text Generation • Updated 12 days ago • 509 • 15

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated 9 days ago • 108 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated 9 days ago • 25 • 7

bartowski/Rombos-Qwen2.5-Writer-32b-GGUF

Text Generation • Updated 6 days ago • 1.15k • 3

koboldcpp/tts

Updated about 3 hours ago • 170 • 3

TheBloke/CodeLlama-7B-GGUF

Text Generation • Updated Sep 27, 2023 • 5.85k • 111

TheBloke/Llama-2-7B-GGUF

Text Generation • Updated Oct 24, 2023 • 9.54k • 180

TheBloke/llama2_70b_chat_uncensored-GGUF

Updated Sep 27, 2023 • 5.75k • 44

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Updated Oct 19, 2023 • 39.7k • 84

Mozilla/llava-v1.5-7b-llamafile

Updated Aug 19, 2024 • 14.5k • 178

TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF

Updated Dec 14, 2023 • 31.8k • 610

defog/sqlcoder-7b-2

Text Generation • Updated Feb 12, 2024 • 56.2k • 307

google/gemma-7b-it

Text Generation • Updated Aug 14, 2024 • 115k • 1.15k

mixedbread-ai/mxbai-embed-large-v1

Feature Extraction • Updated Nov 26, 2024 • 1.49M • • 589

teddylee777/Llama-3-Open-Ko-8B-gguf

Text Generation • Updated May 20, 2024 • 1.16k • 42

listenrwt/chinese_light_novel_40k

Text Generation • Updated May 16, 2024 • 5 • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.92M • 74

QuantFactory/CodeLlama-7B-KStack-GGUF

Text Generation • Updated May 27, 2024 • 81 • 3

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26, 2024 • 3.04k • 48

bartowski/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 15, 2024 • 45.9k • 203

bartowski/gemma-2-27b-it-GGUF

Text Generation • Updated Aug 3, 2024 • 23.5k • 164

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Dec 1, 2024 • 47.5k • 165

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • Updated Jul 29, 2024 • 8.99k • 52

bartowski/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 5, 2024 • 56k • 47

openbmb/MiniCPM-V-2_6-gguf

Updated Aug 13, 2024 • 6.01k • 150