Update README.md
Browse files
README.md
CHANGED
|
@@ -13,8 +13,8 @@ language:
|
|
| 13 |
- chi
|
| 14 |
library_name: transformers
|
| 15 |
---
|
| 16 |
-
#
|
| 17 |
-
**--This is a
|
| 18 |
|
| 19 |
**By attempting to merge the yi-34B (RPMerge, which I consider to be a better-performing version), to create a 70B-level Yi, what surprised me was that it didn't seem to exhibit the increased logical confusion and linguistic errors that many models with more than double the original parameter count do. It appeared to just get stronger with the increase in parameters. I also tried several other fine-tuned versions of Yi, and the results were satisfactory.**
|
| 20 |
|
|
|
|
| 13 |
- chi
|
| 14 |
library_name: transformers
|
| 15 |
---
|
| 16 |
+
# Yi-70B-200k-RPMerge-Franken
|
| 17 |
+
**--This is a 71B frankenmerge of [Yi-34B-200K-RPMerge](https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge) created by interleaving layers of [Yi-34B-200K-RPMerge](https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge) with itself using [mergekit](https://github.com/arcee-ai/mergekit).--**
|
| 18 |
|
| 19 |
**By attempting to merge the yi-34B (RPMerge, which I consider to be a better-performing version), to create a 70B-level Yi, what surprised me was that it didn't seem to exhibit the increased logical confusion and linguistic errors that many models with more than double the original parameter count do. It appeared to just get stronger with the increase in parameters. I also tried several other fine-tuned versions of Yi, and the results were satisfactory.**
|
| 20 |
|