Undi95 commited on
Commit
e0a3d66
·
1 Parent(s): 62cf2de

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ ---
4
+
5
+ Merge:
6
+ ```shell
7
+ layer_slices:
8
+ - model: Gryphe/MythoMax-L2-13b
9
+ start: 0
10
+ end: 16
11
+ - model: Undi95/MM-ReMM-L2-20B-Part1
12
+ start: 8
13
+ end: 20
14
+ - model: Gryphe/MythoMax-L2-13b
15
+ start: 17
16
+ end: 32
17
+ - model: Undi95/MM-ReMM-L2-20B-Part1
18
+ start: 21
19
+ end: 40
20
+ ```
21
+
22
+ <!-- description start -->
23
+ ## Models used
24
+
25
+ - Gryphe/MythoMax-L2-13b
26
+ - Undi95/ReMM-v2.1-L2-13B
27
+ <!-- description end -->
28
+
29
+ Part1 = ReMM v2.1 merged /w MythoMax low weight to keep consistency. I call this "dilution" and result show consistency and coherency without repeat/loop beside the small amount of duplicated datas.
30
+
31
+ ## Prompt template: Alpaca
32
+
33
+ ```
34
+ Below is an instruction that describes a task. Write a response that completes the request.
35
+
36
+ ### Instruction:
37
+ {prompt}
38
+
39
+ ### Response:
40
+ ```