Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ This is a merge of pre-trained language models created using [mergekit](https://
|
|
14 |
## Merge Details
|
15 |
### Merge Method
|
16 |
|
17 |
-
This model was merged using the passthrough merge method. Every layer is doubled in order, from Qwen/Qwen2.5-72B-Instruct, with the MLP layers +
|
18 |
|
19 |
### Models Merged
|
20 |
|
|
|
14 |
## Merge Details
|
15 |
### Merge Method
|
16 |
|
17 |
+
This model was merged using the passthrough merge method. Every layer is doubled in order, from Qwen/Qwen2.5-72B-Instruct, with the MLP layers + 3 output layers only copied once, creating 132B parameters. No additional fine-tune has been done in this merged model.
|
18 |
|
19 |
### Models Merged
|
20 |
|