Native bitsandbytes 4bit pre quantized models
Unsloth AI
company
AI & ML interests
Hey! We're focusing on making AI more accessible to everyone!
Organization Card
🦥Unsloth makes fine-tuning of LLMs 2.2x faster and use 80% less VRAM!
Join our Discord server! Our open source Github: https://github.com/unslothai/unsloth
| Unsloth support includes | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama 3.1 (8B) | ▶️ Start on Colab | 2.1x faster | 60% less |
| Gemma 2 (9B) | ▶️ Start on Colab | 2x faster | 63% less |
| Mistral Nemo (12B) | ▶️ Start on Colab | 2x faster | 60% less |
| Phi-3 (mini) | ▶️ Start on Colab | 2x faster | 50% less |
Collections
2
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • Updated • 16k • 11 -
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
Text Generation • Updated • 737 • 10 -
unsloth/gemma-2-9b-it-bnb-4bit
Text Generation • Updated • 113k • 8 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • Updated • 365k • 112
models
108
unsloth/Meta-Llama-3.1-405B-bnb-4bit
Text Generation
•
Updated
•
394
•
10
unsloth/Meta-Llama-3.1-70B-bnb-4bit
Text Generation
•
Updated
•
999
•
7
unsloth/Meta-Llama-3.1-8B
Text Generation
•
Updated
•
2.9k
•
7
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation
•
Updated
•
21.9k
•
16
unsloth/Mistral-Large-Instruct-2407-bnb-4bit
Text Generation
•
Updated
•
113
•
4
unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit
Text Generation
•
Updated
•
425
•
7
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
Text Generation
•
Updated
•
737
•
10
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
•
Updated
•
16k
•
11
unsloth/Meta-Llama-3.1-8B-Instruct
Text Generation
•
Updated
•
3.99k
•
14
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation
•
Updated
•
365k
•
112