Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

75,244

Full-text search

Active filters: gguf

TheDrummer/Theia-21B-v2-GGUF

Updated Sep 9, 2024 • 2.14k • 28

SporkySporkness/FLUX.1-Fill-dev-GGUF

Updated Nov 22, 2024 • 4.85k • 40

Old-Fisherman/SDXL_Finetune_GGUF_Files

Updated 8 days ago • 297 • 7

kz919/QwQ-0.5B-Distilled-SFT-gguf

Text Generation • Updated 7 days ago • 449 • 7

mradermacher/Phi-4-AbliteratedRP-i1-GGUF

Updated 6 days ago • 1.52k • 5

bartowski/Qwen2.5-72b-RP-Ink-GGUF

Text Generation • Updated 3 days ago • 1.08k • 5

bartowski/Wayfarer-12B-GGUF

Text Generation • Updated about 17 hours ago • 1.13k • 5

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 1.94M • 83

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Nov 5, 2024 • 10.7k • 62

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 28, 2024 • 41k • 233

city96/FLUX.1-schnell-gguf

Text-to-Image • Updated Aug 18, 2024 • 20.3k • 193

lllyasviel/FLUX.1-dev-gguf

Text-to-Image • Updated Aug 27, 2024 • 8.63k • 83

mikeyandfriends/PixelWave_FLUX.1-dev_03

Text-to-Image • Updated Nov 5, 2024 • 12k • 159

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 5 days ago • 54.9k • 119

NexaAIDev/OmniVLM-968M

Updated Dec 17, 2024 • 1.26k • 496

DavidAU/Llama-3.2-4X3B-MOE-Hell-California-Uncensored-10B-GGUF

Text Generation • Updated 28 days ago • 5.16k • 13

t-tech/T-lite-it-1.0-Q8_0-GGUF

Updated Dec 17, 2024 • 884 • 7

bartowski/c4ai-command-r7b-12-2024-abliterated-GGUF

Text Generation • Updated 13 days ago • 4.22k • 11

TheBloke/Llama-2-7B-Chat-GGUF

Text Generation • Updated Oct 14, 2023 • 67.5k • 450

TheBloke/Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Dec 9, 2023 • 25k • 518

metercai/SimpleSDXL2

Updated 1 day ago • 2.21k • 25

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 16.4k • 49

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 56.5k • 87

gpustack/bge-reranker-v2-m3-GGUF

Text Classification • Updated Sep 29, 2024 • 2.1k • 5

DavidAU/L3-DARKEST-PLANET-16.5B-GGUF

Text Generation • Updated 24 days ago • 3.65k • 49

city96/stable-diffusion-3.5-large-gguf

Text-to-Image • Updated Oct 23, 2024 • 5.69k • 88

mradermacher/Darkest-muse-v1-GGUF

Updated Oct 24, 2024 • 1.1k • 6

bartowski/Darkest-muse-v1-GGUF

Text Generation • Updated Oct 26, 2024 • 2.19k • 8

IlyaGusev/saiga_nemo_12b_gguf

Updated Nov 19, 2024 • 40.5k • 32

TheDrummer/Cydonia-22B-v1.3-GGUF

Updated Nov 21, 2024 • 8.06k • 22