athirdpath commited on
Commit
a72625b
1 Parent(s): d20988d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ ---
7
+
8
+ <p align="center"><font size="5"> <b>An interesting experiment. Give it a shot.</b></font></p>
9
+ <p align="center"><font size="4"> <b>Seems to perfer Alpaca for instruct, and ChatML for storytelling.</b></font></p>
10
+ <p align="center"><font size="6"> <b>Examples with Alpaca</b></font></p>
11
+ <p align="center"><img src="https://iili.io/JzL3H9p.png"/>
12
+ <p align="center"><font size="5"><b><a href="https://iili.io/JzLFH0b.png">!!NSFW!! - Erotica Writing Example - !!NSFW!!</font></a></b></p>
13
+ <p align="center"><font size="6"> <b>Examples with ChatML</b></font></p>
14
+ <p align="center"><img src="https://iili.io/JzL2ySR.png"/>
15
+ <p align="center"><font size="5"><b><a href="https://iili.io/JzsUNIt.png">!!NSFW!! - Erotica Writing Example - !!NSFW!!</font></a></b></p>
16
+
17
+
18
+ ### Recipe
19
+ merge_method: dare_ties
20
+
21
+ - base_model: athirdpath/BigMistral-11b
22
+
23
+ - model: athirdpath/NeuralPivot-11b
24
+
25
+ weight: [0.50, 0.45, 0.30] / density: 0.30
26
+
27
+ - model: athirdpath/athirdpath/Eileithyia-20b
28
+
29
+ weight: [0.22, 0.27, 0.42] / density: [0.55, 0.52, 0.35]
30
+
31
+ - model: athirdpath/BigMistral-11b-GLUED
32
+
33
+ weight: 0.28 / density: 0.30
34
+
35
+ int8_mask: true
36
+
37
+ dtype: bfloat16