Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,10 @@ tags:
|
|
10 |
- transformers
|
11 |
---
|
12 |
|
13 |
-
## ***See [our collection](https://huggingface.co/collections/unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5) for versions of Deepseek-R1 including GGUF
|
|
|
|
|
|
|
14 |
### Instructions to run this model in llama.cpp:
|
15 |
Or you can view more detailed instructions here: [unsloth.ai/blog/deepseek-r1](https://unsloth.ai/blog/deepseek-r1)
|
16 |
1. Do not forget about `<|User|>` and `<|Assistant|>` tokens! - Or use a chat template formatter
|
|
|
10 |
- transformers
|
11 |
---
|
12 |
|
13 |
+
## ***See [our collection](https://huggingface.co/collections/unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5) for versions of Deepseek-R1 including GGUF & 4-bit formats.***
|
14 |
+
*Unsloth's DeepSeek-R1 [1.58-bit + 2-bit Dynamic Quants](https://unsloth.ai/blog/deepseekr1-dynamic) selectively avoids quantizing certain parameters, greatly increasing accuracy than standard 1-bit/2-bit.*
|
15 |
+
<br>
|
16 |
+
|
17 |
### Instructions to run this model in llama.cpp:
|
18 |
Or you can view more detailed instructions here: [unsloth.ai/blog/deepseek-r1](https://unsloth.ai/blog/deepseek-r1)
|
19 |
1. Do not forget about `<|User|>` and `<|Assistant|>` tokens! - Or use a chat template formatter
|