jukofyork commited on
Commit
0f3742a
1 Parent(s): b9a3769

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -4
README.md CHANGED
@@ -29,13 +29,13 @@ parameters:
29
 
30
  which creates this truncated triangular distribution:
31
 
32
- ![Dark-Miqu-Distribution.png](https://cdn-uploads.huggingface.co/production/uploads/65995c45539c808e84c38bf1/guNF-5tEcKxeGVxyJcfCO.png)
33
 
34
  altered to use this truncated triangular distribution instead:
35
 
36
- ![Dark-Miqu-Distribution-2.png](https://cdn-uploads.huggingface.co/production/uploads/65995c45539c808e84c38bf1/62P3bxJkTgw_-6gqpqG2g.png)
37
 
38
- This keeps the first 16 and last 16 layers unaltered (which ties in with what people have found for the frankenmerge interleave patterns), and potentially fixes the ["poor grammar"](https://huggingface.co/jukofyork/Dark-Miqu-70B/discussions/2) problem some people are having with [Dark-Miqu-70B](https://huggingface.co/jukofyork/Dark-Miqu-70B) (sadly I can't replicate this though...).
39
 
40
  Luckily this change also doesn't necessitate the recreation of the whole merge from scratch, and we can just use this:
41
 
@@ -158,4 +158,60 @@ See the [Mergekit documentation](https://github.com/arcee-ai/mergekit) for more
158
 
159
  # Example stories
160
 
161
- The following mix of "dark" stories were generated using the Vicuna prompt format with no system message and temperature=0:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
  which creates this truncated triangular distribution:
31
 
32
+ ![Dark-Miqu-Distribution.png](Dusk-Miqu-Distribution-1.png)
33
 
34
  altered to use this truncated triangular distribution instead:
35
 
36
+ ![Dark-Miqu-Distribution-2.png](Dusk-Miqu-Distribution-2.png)
37
 
38
+ This keeps the first 16 and last 16 layers unaltered (which ties in with what people have found for the frankenmerge interleave patterns), and potentially fixes the ["poor grammar"](https://huggingface.co/jukofyork/Dark-Miqu-70B/discussions/2) problem some people are experiencing with [Dark-Miqu-70B](https://huggingface.co/jukofyork/Dark-Miqu-70B) (sadly I can't replicate this though...).
39
 
40
  Luckily this change also doesn't necessitate the recreation of the whole merge from scratch, and we can just use this:
41
 
 
158
 
159
  # Example stories
160
 
161
+ The following mix of "dark" stories were generated using the Vicuna prompt format with no system message and temperature=0:
162
+
163
+ ## Dark fantasy stories
164
+
165
+ <details> <summary>Click to see spoiler</summary>
166
+
167
+ </details>
168
+
169
+ <details> <summary>Click to see spoiler</summary>
170
+
171
+ </details>
172
+
173
+ <details> <summary>Click to see spoiler</summary>
174
+
175
+ </details>
176
+
177
+ <details> <summary>Click to see spoiler</summary>
178
+
179
+ </details>
180
+
181
+ ## Dark sci-fi stories
182
+
183
+ <details> <summary>Click to see spoiler</summary>
184
+
185
+ </details>
186
+
187
+ <details> <summary>Click to see spoiler</summary>
188
+
189
+ </details>
190
+
191
+ <details> <summary>Click to see spoiler</summary>
192
+
193
+ </details>
194
+
195
+ <details> <summary>Click to see spoiler</summary>
196
+
197
+ </details>
198
+
199
+ ## Miscellaneous stories
200
+
201
+ <details> <summary>Click to see spoiler</summary>
202
+
203
+ </details>
204
+
205
+ <details> <summary>Click to see spoiler</summary>
206
+
207
+ </details>
208
+
209
+ <details> <summary>Click to see spoiler</summary>
210
+
211
+ </details>
212
+
213
+ <details> <summary>Click to see spoiler</summary>
214
+
215
+ </details>
216
+
217
+ Big thanks to: @sophosympatheia for working out the merge pattern, @Sao10K for creating Euryale and WinterGoddess, and @chargoddard for writing [Mergekit](https://github.com/arcee-ai/mergekit)!