readme: add extra params
Browse files
README.md
CHANGED
|
@@ -111,7 +111,9 @@ deepseek2.attention.q_lora_rank=int:1536
|
|
| 111 |
deepseek2.attention.kv_lora_rank=int:512
|
| 112 |
deepseek2.expert_shared_count=int:2
|
| 113 |
deepseek2.expert_feed_forward_length=int:1536
|
|
|
|
| 114 |
deepseek2.leading_dense_block_count=int:1
|
|
|
|
| 115 |
```
|
| 116 |
|
| 117 |
A precompiled AVX2 version is avaliable at `llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip` in the root of this repo.
|
|
|
|
| 111 |
deepseek2.attention.kv_lora_rank=int:512
|
| 112 |
deepseek2.expert_shared_count=int:2
|
| 113 |
deepseek2.expert_feed_forward_length=int:1536
|
| 114 |
+
deepseek2.experts_weight_scale=int:16
|
| 115 |
deepseek2.leading_dense_block_count=int:1
|
| 116 |
+
rope.scaling.yarn_log_multiplier=float:0.0707
|
| 117 |
```
|
| 118 |
|
| 119 |
A precompiled AVX2 version is avaliable at `llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip` in the root of this repo.
|