Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

845

Full-text search

Active filters: imatrix

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Oct 8 • 161k • 62

bartowski/Qwen2.5.1-Coder-7B-Instruct-GGUF

Text Generation • Updated 15 days ago • 62k • 58

bartowski/Ministral-8B-Instruct-2410-GGUF

Text Generation • Updated about 1 month ago • 29k • 20

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 2 days ago • 5

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22 • 7.56k • 20

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 124k • 75

bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 16 • 126k • 86

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 31.4k • 45

bartowski/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated Sep 19 • 12.3k • 45

bartowski/Qwen2.5-14B_Uncensored_Instruct-GGUF

Text Generation • Updated Sep 22 • 65.8k • 27

bartowski/OpenCoder-8B-Instruct-GGUF

Text Generation • Updated 10 days ago • 2.99k • 4

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • Updated Jun 17 • 1.44k • 4

lmstudio-community/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 16 • 8.26k • 21

bartowski/gemma-2-9b-it-abliterated-GGUF

Text Generation • Updated Oct 7 • 7.66k • 21

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3 • 10.5M • 123

bartowski/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • Updated Sep 13 • 4.97k • 11

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.87M • 8

bartowski/Llama-3.1-8B-Stheno-v3.4-GGUF

Text Generation • Updated Sep 30 • 1.23k • 4

bartowski/SuperNova-Medius-GGUF

Text Generation • Updated Oct 13 • 20.7k • 38

bartowski/Pantheon-RP-Pure-1.6.2-22b-Small-GGUF

Text Generation • Updated Oct 13 • 2.46k • 10

bartowski/aya-expanse-8b-GGUF

Text Generation • Updated 28 days ago • 16k • 20

bartowski/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated 21 days ago • 1.39k • 3

bartowski/EVA-Qwen2.5-72B-v0.1-GGUF

Text Generation • Updated 14 days ago • 3.67k • 2

mradermacher/L3.1-Dark-Planet-SpinFire-Uncensored-8B-i1-GGUF

Updated 10 days ago • 1.16k • 4

telosnex/fllama

Updated Sep 25 • 600 • 6

Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF

Updated Oct 12 • 2.71k • 69

bartowski/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 10 • 2.43k • 5

dddump/Japanese-TextGen-Kage-v0.1-2x7B-gguf

Text Generation • Updated May 19 • 65 • 6

bartowski/Code-Llama-3-8B-GGUF

Text Generation • Updated May 7 • 562 • 8

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22 • 1.77k • 6