Update README.md
Browse files
README.md
CHANGED
@@ -29,13 +29,13 @@ parameters:
|
|
29 |
|
30 |
which creates this truncated triangular distribution:
|
31 |
|
32 |
-
![Dark-Miqu-Distribution.png](
|
33 |
|
34 |
altered to use this truncated triangular distribution instead:
|
35 |
|
36 |
-
![Dark-Miqu-Distribution-2.png](
|
37 |
|
38 |
-
This keeps the first 16 and last 16 layers unaltered (which ties in with what people have found for the frankenmerge interleave patterns), and potentially fixes the ["poor grammar"](https://huggingface.co/jukofyork/Dark-Miqu-70B/discussions/2) problem some people are
|
39 |
|
40 |
Luckily this change also doesn't necessitate the recreation of the whole merge from scratch, and we can just use this:
|
41 |
|
@@ -158,4 +158,60 @@ See the [Mergekit documentation](https://github.com/arcee-ai/mergekit) for more
|
|
158 |
|
159 |
# Example stories
|
160 |
|
161 |
-
The following mix of "dark" stories were generated using the Vicuna prompt format with no system message and temperature=0:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
|
30 |
which creates this truncated triangular distribution:
|
31 |
|
32 |
+
![Dark-Miqu-Distribution.png](Dusk-Miqu-Distribution-1.png)
|
33 |
|
34 |
altered to use this truncated triangular distribution instead:
|
35 |
|
36 |
+
![Dark-Miqu-Distribution-2.png](Dusk-Miqu-Distribution-2.png)
|
37 |
|
38 |
+
This keeps the first 16 and last 16 layers unaltered (which ties in with what people have found for the frankenmerge interleave patterns), and potentially fixes the ["poor grammar"](https://huggingface.co/jukofyork/Dark-Miqu-70B/discussions/2) problem some people are experiencing with [Dark-Miqu-70B](https://huggingface.co/jukofyork/Dark-Miqu-70B) (sadly I can't replicate this though...).
|
39 |
|
40 |
Luckily this change also doesn't necessitate the recreation of the whole merge from scratch, and we can just use this:
|
41 |
|
|
|
158 |
|
159 |
# Example stories
|
160 |
|
161 |
+
The following mix of "dark" stories were generated using the Vicuna prompt format with no system message and temperature=0:
|
162 |
+
|
163 |
+
## Dark fantasy stories
|
164 |
+
|
165 |
+
<details> <summary>Click to see spoiler</summary>
|
166 |
+
|
167 |
+
</details>
|
168 |
+
|
169 |
+
<details> <summary>Click to see spoiler</summary>
|
170 |
+
|
171 |
+
</details>
|
172 |
+
|
173 |
+
<details> <summary>Click to see spoiler</summary>
|
174 |
+
|
175 |
+
</details>
|
176 |
+
|
177 |
+
<details> <summary>Click to see spoiler</summary>
|
178 |
+
|
179 |
+
</details>
|
180 |
+
|
181 |
+
## Dark sci-fi stories
|
182 |
+
|
183 |
+
<details> <summary>Click to see spoiler</summary>
|
184 |
+
|
185 |
+
</details>
|
186 |
+
|
187 |
+
<details> <summary>Click to see spoiler</summary>
|
188 |
+
|
189 |
+
</details>
|
190 |
+
|
191 |
+
<details> <summary>Click to see spoiler</summary>
|
192 |
+
|
193 |
+
</details>
|
194 |
+
|
195 |
+
<details> <summary>Click to see spoiler</summary>
|
196 |
+
|
197 |
+
</details>
|
198 |
+
|
199 |
+
## Miscellaneous stories
|
200 |
+
|
201 |
+
<details> <summary>Click to see spoiler</summary>
|
202 |
+
|
203 |
+
</details>
|
204 |
+
|
205 |
+
<details> <summary>Click to see spoiler</summary>
|
206 |
+
|
207 |
+
</details>
|
208 |
+
|
209 |
+
<details> <summary>Click to see spoiler</summary>
|
210 |
+
|
211 |
+
</details>
|
212 |
+
|
213 |
+
<details> <summary>Click to see spoiler</summary>
|
214 |
+
|
215 |
+
</details>
|
216 |
+
|
217 |
+
Big thanks to: @sophosympatheia for working out the merge pattern, @Sao10K for creating Euryale and WinterGoddess, and @chargoddard for writing [Mergekit](https://github.com/arcee-ai/mergekit)!
|