Hugging Face's logo
unsloth 's Collections
Unsloth 4-bit Dynamic Quants
Gemma 3
DeepSeek R1 (All Versions)
Deepseek V3 (All Versions)
Phi-4 (All Versions)
Llama 3.2
Mistral-Small-24B-2501 (All Versions)
Llama 3.3 (All Versions)
Qwen2.5-VL (All Versions)
Qwen QwQ-32B Collection
Vision/multimodal Models
Llama 3.2 Vision
Qwen 2.5 Coder
Llama 3.1 Collection
Qwen 2.5
Load 4bit models 4x faster
4bit Instruct Models

Unsloth 4-bit Dynamic Quants

Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit

Upvote
61