Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,9 @@ tags:
|
|
| 12 |
library_name: transformers
|
| 13 |
---
|
| 14 |
|
|
|
|
|
|
|
|
|
|
| 15 |
# QwQ-32B-Preview
|
| 16 |
|
| 17 |
## Introduction
|
|
|
|
| 12 |
library_name: transformers
|
| 13 |
---
|
| 14 |
|
| 15 |
+
### ***Unsloth's [Dynamic 4-bit Quants](https://unsloth.ai/blog/dynamic-4bit) selectively avoids quantizing certain parameters, greatly improving accuracy while keeping VRAM usage similar to BnB 4-bit.<br>See our full collection of Unsloth quants on [Hugging Face here.](https://huggingface.co/collections/unsloth/unsloth-4-bit-dynamic-quants-67503bb873f89e15276c44e7)***
|
| 16 |
+
<br>
|
| 17 |
+
|
| 18 |
# QwQ-32B-Preview
|
| 19 |
|
| 20 |
## Introduction
|