Native bitsandbytes 4bit pre quantized models
![Unsloth AI's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
Unsloth AI
company
AI & ML interests
Hey! We're focusing on making AI more accessible to everyone!
Organization Card
🦥Unsloth makes fine-tuning of LLMs 2.2x faster and use 80% less VRAM!
Join our Discord server! Our open source Github: https://github.com/unslothai/unsloth
Unsloth support includes | Free Notebooks | Performance | Memory use |
---|---|---|---|
Llama 3.1 (8B) | ▶️ Start on Colab | 2.1x faster | 60% less |
Gemma 2 (9B) | ▶️ Start on Colab | 2x faster | 63% less |
Mistral Nemo (12B) | ▶️ Start on Colab | 2x faster | 60% less |
Phi-3 (mini) | ▶️ Start on Colab | 2x faster | 50% less |
Collections
2
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • Updated • 218k • 29 -
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
Text Generation • Updated • 9.49k • 15 -
unsloth/gemma-2-9b-it-bnb-4bit
Text Generation • Updated • 123k • 12 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • Updated • 155k • 121
models
123
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
Text Generation
•
Updated
•
9.49k
•
15
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Phi-3.5-mini-instruct-bnb-4bit
Text Generation
•
Updated
•
8.51k
•
7
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Phi-3.5-mini-instruct
Text Generation
•
Updated
•
1.36k
•
6
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Phi-3-mini-4k-instruct-bnb-4bit
Text Generation
•
Updated
•
53.3k
•
22
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/gemma-2-9b-it-bnb-4bit
Text Generation
•
Updated
•
123k
•
12
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation
•
Updated
•
155k
•
121
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/llama-3-8b-bnb-4bit
Text Generation
•
Updated
•
452k
•
171
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
•
Updated
•
218k
•
29
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation
•
Updated
•
296k
•
43
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/llama-3-8b-Instruct
Text Generation
•
Updated
•
40.6k
•
60