Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,651

Full-text search

Active filters: imatrix

bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • Updated 9 days ago • 14k • 11

bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated 19 days ago • 134k • 73

arcee-ai/SuperNova-Medius-GGUF

Updated 17 days ago • 52.5k • 46

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated 26 days ago • 129k • 51

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 26 days ago • 108k • 66

bartowski/aya-expanse-8b-GGUF

Text Generation • Updated 10 days ago • 8.38k • 15

bartowski/Llama-3.1-Hawkish-8B-GGUF

Text Generation • Updated 7 days ago • 2.42k • 7

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Sep 3 • 14.2k • 113

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3 • 46.2k • 116

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 35.6k • 32

LWDCLS/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF-IQ-Imatrix-Request

Updated Jul 28 • 30.6k • 51

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 23k • 26

bartowski/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated Sep 19 • 15.5k • 40

bartowski/Replete-LLM-V2.5-Qwen-7b-GGUF

Text Generation • Updated 27 days ago • 29k • 11

bartowski/NuExtract-v1.5-GGUF

Text Generation • Updated 19 days ago • 14.9k • 6

bartowski/EVA-Qwen2.5-32B-v0.0-GGUF

Text Generation • Updated 11 days ago • 4.73k • 8

bartowski/aya-expanse-32b-GGUF

Text Generation • Updated 10 days ago • 14.2k • 8

bartowski/Behemoth-123B-v1.1-GGUF

Text Generation • Updated 8 days ago • 2.24k • 4

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

Updated 14 days ago • 1.67k • 2

bartowski/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Sep 15 • 17.3k • 47

mradermacher/Chronos-Gold-12B-1.0-i1-GGUF

Updated Sep 16 • 67.6k • 7

bartowski/c4ai-command-r-plus-08-2024-GGUF

Text Generation • Updated Aug 30 • 4.26k • 15

bartowski/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • Updated Sep 13 • 7.24k • 8

grapevine-AI/EZO-Qwen2.5-72B-Instruct-GGUF

Updated Sep 29 • 376 • 4

bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF

Text Generation • Updated 9 days ago • 8.48k • 17

mradermacher/MN-12B-Vespa-x1-i1-GGUF

Updated Oct 3 • 1.46k • 6

bartowski/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

Text Generation • Updated 30 days ago • 13.6k • 4

grapevine-AI/gemma-2-9b-it-SimPO-GGUF

Updated 22 days ago • 403 • 4

bartowski/Rombos-LLM-V2.6-Qwen-14b-GGUF

Text Generation • Updated 21 days ago • 36.6k • 9

bartowski/Pantheon-RP-Pure-1.6.2-22b-Small-GGUF

Text Generation • Updated 21 days ago • 2.86k • 8