Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ MTP-7b Storywriter [75%] + MTP-7b Instruct [25%]
|
|
15 |
----
|
16 |
|
17 |
This was done under for the sake of testing the theory of how long context tunes affect attention when merged with a model that has been trained for a different purpose, on a shorter context span.
|
18 |
-
Different from the first merge (That sports a 50/50 ratio)
|
19 |
|
20 |
The end result is intended to be model that is capable of following the Instruct base's Assistant / Instruct / Helpful properties, while drawing some creativity for long prose.
|
21 |
|
|
|
15 |
----
|
16 |
|
17 |
This was done under for the sake of testing the theory of how long context tunes affect attention when merged with a model that has been trained for a different purpose, on a shorter context span.
|
18 |
+
Different from the first merge [(That sports a 50/50 ratio)](https://huggingface.co/TehVenom/mpt-7b-InstructAndStorywriting-50_50-Merge), this one is lopsided towards the Instruct base model to have another comparison point for the effects of CTX span merging, and to have a model that is primarily focused on Instruct.
|
19 |
|
20 |
The end result is intended to be model that is capable of following the Instruct base's Assistant / Instruct / Helpful properties, while drawing some creativity for long prose.
|
21 |
|