4bit Instruct Models - a unsloth Collection

unsloth 's Collections

Llama 3.2 Vision

Load 4bit models 4x faster

4bit Instruct Models

4bit Instruct Models

updated 4 days ago

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 263k • 14
unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 102k • 10
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Sep 25 • 32k • 44
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 524k • 40
unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 86.4k • 128
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 19.4k • 26
unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3 • 6.83k • 24
unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 16.8k • 24
unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Sep 3 • 21.9k • 19
unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Sep 11 • 16.4k • 31
unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Sep 11 • 134k • 15
unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 2.67k • 41
unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3 • 3.95k • 4
unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3 • 3.32k • 13
unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3 • 1.45k • 18
unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4 • 1.13k • 3
unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4 • 157
unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4 • 2.04k • 2