Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

161

Base only

Active filters: lm-studio

froggeric/Qwen-Fixed-Chat-Templates

Updated about 14 hours ago • 496

OBLITERATUS/Qwen3.6-27B-OBLITERATED

Text Generation • 27B • Updated 13 days ago • 27.5k • 144

mlx-community/Nemotron-3-Super-120B-A12B-MLX-6bit

Text Generation • 121B • Updated Mar 31 • 621 • 2

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated May 2 • 1.63k • 4

pankajpandey-dev/MiniCPM5-1B-Hindi-Instruct-v1-GGUF

Text Generation • 1B • Updated 7 days ago • 592 • 1

RootMonsteR/Qwen3.6-27B-Nemesis-GGUF

Text Generation • 27B • Updated 6 days ago • 368 • 1

pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2-GGUF

Text Generation • 4B • Updated 6 days ago • 261 • 1

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated about 9 hours ago • 304 • 1

Umranz/Lumina-Soft-1.2b-GGUF

1B • Updated about 16 hours ago • 1

alexander-model/gpt_model_safe

Text Generation • 21B • Updated Aug 28, 2025 • 7

dinhquangson/MonkeyOCR-pro-1.2B-Vision-GGUF

Image-Text-to-Text • 1B • Updated Sep 12, 2025 • 579 • 3

jsmith0475/sleeper-proxy-tinyllama-1.1b

Text Generation • 1B • Updated Sep 14, 2025 • 3 •

jsmith0475/sleeper-proxy-tinyllama-1.1b-gguf

Text Generation • 1B • Updated Sep 14, 2025 • 31 • 1

richardyoung/Qwen2.5-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated Mar 23 • 2.41k • 1

richardyoung/Qwen3-14B-abliterated-GGUF

Text Generation • 15B • Updated Mar 23 • 1.46k • 3

snowmead/qwen3-0.6b-rust-sft-GGUF

0.6B • Updated Dec 11, 2025 • 7

kingjux/ffmpeg-command-generator-gguf

0.5B • Updated Dec 14, 2025 • 13

SiddhJagani/NVIDIA-Nemotron-Nano-12B-v2-mlx-Q6

Text Generation • 12B • Updated Dec 26, 2025 • 754

HexQuant/Pars-Medical-o1-Llama-FFT-GGUF

Text Generation • 3B • Updated Dec 22, 2025 • 37 • 1

purplesquirrelnetworks/purple-squirrel-r1-gguf

Text Generation • 8B • Updated Feb 23 • 54

ermiaazarkhalili/Qwen2.5-0.5B-SFT-UltraChat-GGUF

0.5B • Updated Apr 18 • 90

ermiaazarkhalili/Qwen2.5-1.5B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 59

ermiaazarkhalili/Qwen3-0.6B-SFT-UltraChat-GGUF

0.6B • Updated Apr 18 • 19

ermiaazarkhalili/Qwen3-1.7B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 25

ermiaazarkhalili/Qwen2.5-3B-SFT-UltraChat-GGUF

3B • Updated Apr 18 • 87

ermiaazarkhalili/Qwen3-4B-SFT-UltraChat-GGUF

4B • Updated Apr 18 • 16

ermiaazarkhalili/LFM2-350M-GRPO-NuminaMath-10K-GGUF

Text Generation • 0.4B • Updated Apr 18 • 37

ermiaazarkhalili/LFM2-700M-GRPO-NuminaMath-10K-GGUF

Text Generation • 0.7B • Updated Apr 18 • 41

ermiaazarkhalili/LFM2-1.2B-GRPO-NuminaMath-10K-GGUF

Text Generation • 1B • Updated Apr 18 • 52

ermiaazarkhalili/Qwen2.5-0.5B-SFT-OpenHermes-2.5-100-GGUF

0.5B • Updated Apr 18 • 37