Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

70,239

Full-text search

Active filters: gguf

bartowski/QVQ-72B-Preview-GGUF

Image-Text-to-Text • Updated 8 days ago • 63.8k • 44

city96/FLUX.1-dev-gguf

Text-to-Image • Updated Aug 18, 2024 • 147k • 778

DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

Text Generation • Updated 13 days ago • 12.9k • 20

NexaAIDev/OmniAudio-2.6B

Audio-Text-to-Text • Updated 19 days ago • 8.34k • 208

matteogeniaccio/phi-4

Updated 19 days ago • 37.7k • 170

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated 2 days ago • 3.68k • 12

city96/HunyuanVideo-gguf

Text-to-Video • Updated 16 days ago • 46.4k • 52

calcuis/ltxv-gguf

Text-to-Video • Updated 3 days ago • 3.83k • 15

prithivMLmods/Deepthink-Reasoning-7B-GGUF

Text Generation • Updated 4 days ago • 424 • 9

prithivMLmods/Llama-Deepsync-3B-GGUF

Text Generation • Updated 3 days ago • 302 • 8

bartowski/Qwen2-VL-7B-Instruct-GGUF

Image-Text-to-Text • Updated 15 days ago • 9.22k • 24

prithivMLmods/Llama-Deepsync-1B-GGUF

Text Generation • Updated 3 days ago • 271 • 7

Lewdiculous/Captain-Eris-Diogenes_Twilight-V0.420-12B-GGUF-ARM-Imatrix

Updated 3 days ago • 639 • 7

prithivMLmods/Triangulum-10B-GGUF

Text Generation • Updated 1 day ago • 405 • 7

prithivMLmods/Triangulum-5B-GGUF

Text Generation • Updated about 17 hours ago • 124 • 7

Lewdiculous/experimental-lwd-Mirau-RP-14B-GGUF-IQ-Imatrix

Updated about 23 hours ago • 410 • 7

DavidAU/Gemma-The-Writer-Mighty-Sword-9B-GGUF

Text Generation • Updated 9 days ago • 777 • 7

prithivMLmods/Codepy-Deepthink-3B-GGUF

Text Generation • Updated 6 days ago • 660 • 6

bartowski/Lumimaid-Magnum-v4-12B-GGUF

Text Generation • Updated 4 days ago • 1.12k • 6

prithivMLmods/Deepsync-240-GGUF

Text Generation • Updated 3 days ago • 66 • 6

google/gemma-7b

Text Generation • Updated Jun 27, 2024 • 37.7k • 3.08k

vikhyatk/moondream2

Image-Text-to-Text • Updated Nov 15, 2024 • 157k • 765

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Dec 1, 2024 • 125k • 160

DavidAU/Gemma-The-Writer-N-Restless-Quill-10B-Uncensored-GGUF

Text Generation • Updated 9 days ago • 18k • 54

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 122k • 107

tensorart/stable-diffusion-3.5-medium-turbo

Text-to-Image • Updated 6 days ago • 8.78k • 28

Lewdiculous/Captain-Eris_Violet-V0.420-12B-GGUF-ARM-Imatrix

Updated 6 days ago • 1.59k • 12

DavidAU/Mistral-MOE-4X7B-Dark-MultiVerse-Uncensored-Enhanced32-24B-gguf

Text Generation • Updated 5 days ago • 1.84k • 5

Lewdiculous/Captain-Eris_Twighlight-V0.420-12B-GGUF-ARM-Imatrix

Updated 4 days ago • 1.16k • 5

bartowski/HuatuoGPT-o1-8B-GGUF

Text Generation • Updated 1 day ago • 661 • 5