Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ license_link: LICENSE
|
|
12 |
|
13 |
This model is merged using PoSE to extend Llama's context length to 64k.
|
14 |
|
15 |
-
|
16 |
|
17 |
It is difficult to expand the context when merging with mergekit. Of course, there may be a method that I don't know about... but I confirmed that what I listed as an indicator in the image above worked.
|
18 |
|
@@ -22,7 +22,6 @@ Since merging up to 256k is stretching the limits of my computer, I will try it
|
|
22 |
|
23 |
check below article about Reborn.
|
24 |
|
25 |
-
[Reborn Merge Method](https://medium.com/@puffanddmx82/reborn-elevating-model-adaptation-with-merging-for-superior-nlp-performance-f604e8e307b2)
|
26 |
|
27 |
## 🎡 Merge Details
|
28 |
|
|
|
12 |
|
13 |
This model is merged using PoSE to extend Llama's context length to 64k.
|
14 |
|
15 |
+
[Reborn Merge Method](https://medium.com/@puffanddmx82/reborn-elevating-model-adaptation-with-merging-for-superior-nlp-performance-f604e8e307b2) is made and proposed by JayLee aka "asiansoul"
|
16 |
|
17 |
It is difficult to expand the context when merging with mergekit. Of course, there may be a method that I don't know about... but I confirmed that what I listed as an indicator in the image above worked.
|
18 |
|
|
|
22 |
|
23 |
check below article about Reborn.
|
24 |
|
|
|
25 |
|
26 |
## 🎡 Merge Details
|
27 |
|