unsloth/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated Jun 8, 2025 • 32.9k • 69

Note { "format": "gguf", "minimum_memory": "2G" }

ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

3B • Updated Apr 30, 2025 • 19.9k • 8

Note { "format": "gguf", "is_vision": true, "vision_speed": 5, "minimum_memory": "2G" }

unsloth/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated Aug 14, 2025 • 36.1k • 193

Note { "format": "gguf", "is_vision": true, "vision_speed": 60, "minimum_memory": "2.5G" }

unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 16, 2025 • 65.9k • 429

Note { "format": "gguf", "minimum_memory": "5G" }

unsloth/Qwen3-4B-GGUF

Text Generation • 4B • Updated Jun 8, 2025 • 125k • 230

Note { "format": "gguf", "minimum_memory": "2.5G" }

unsloth/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 8, 2025 • 182k • 140

Note { "format": "gguf", "minimum_memory": "5G" }

taobao-mnn/Qwen2.5-VL-3B-Instruct-MNN

Text Generation • Updated May 7, 2025 • 130

Note { "format": "mnn", "is_vision": true, "vision_speed": 2, "minimum_memory": "3G" }

openbmb/MiniCPM-V-2_6-gguf

8B • Updated Feb 27, 2025 • 7.21k • 178

Note { "format": "gguf", "is_vision": true, "vision_speed": 10, "minimum_memory": "5G" }

mradermacher/MiniCPM4-8B-GGUF

8B • Updated Jun 10, 2025 • 201 • 4

Note { "format": "gguf", "minimum_memory": "5G" }

unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • 2B • Updated Apr 19, 2025 • 73.9k • 149

Note { "format": "gguf", "minimum_memory": "2G" }

taobao-mnn/DeepSeek-R1-0528-Qwen3-8B-MNN

Text Generation • Updated May 30, 2025 • 222 • 1

Note { "format": "mnn", "minimum_memory": "5G" }

taobao-mnn/Qwen3-4B-MNN

Text Generation • Updated Jul 16, 2025 • 60 • 3

Note { "format": "mnn", "minimum_memory": "2.5G" }

openbmb/MiniCPM-o-2_6-gguf

Any-to-Any • 8B • Updated Oct 5, 2025 • 1.37k • 119

Note { "format": "gguf", "is_vision": true, "vision_speed": 10, "minimum_memory": "6G" }

unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • 8B • Updated May 10, 2025 • 31.1k • 306

Note { "format": "gguf", "minimum_memory": "5G" }

unsloth/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated Aug 14, 2025 • 86.2k • 191

Note { "format": "gguf", "is_vision": true, "vision_speed": 80, "minimum_memory": "7G" }

mradermacher/llama4-dolphin-8B-GGUF

8B • Updated May 5, 2024 • 1.57k • 21

Note { "format": "gguf", "minimum_memory": "5G" }