Aryanne commited on
Commit
f00814d
1 Parent(s): 5239ef5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -1
README.md CHANGED
@@ -11,4 +11,43 @@ widget:
11
  ---
12
 
13
  This a TinyLlama mix merge, experimental, using a custom merge method.
14
- More info on mergekit_config.yml
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  ---
12
 
13
  This a TinyLlama mix merge, experimental, using a custom merge method.
14
+ Should be better at RP.
15
+
16
+ ```
17
+ merge_method: task_swapping
18
+ base_model: Doctor-Shotgun/TinyLlama-1.1B-32k
19
+ models:
20
+ - model: cognitivecomputations/TinyDolphin-2.8.2-1.1b-laser
21
+ parameters:
22
+ weight: 0.75
23
+ diagonal_offset: 5
24
+ - model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
25
+ parameters:
26
+ weight: 0.85
27
+ diagonal_offset: 17
28
+ invert_offset: True
29
+ dtype: bfloat16
30
+ name: bye
31
+ ---
32
+ merge_method: task_swapping
33
+ base_model: Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct
34
+ models:
35
+ - model: vihangd/DopeyTinyLlama-1.1B-v1
36
+ parameters:
37
+ weight: 0.8
38
+ diagonal_offset: 3
39
+ invert_offset: False
40
+ dtype: bfloat16
41
+ name: hello
42
+ ---
43
+ merge_method: task_arithmetic
44
+ base_model: Doctor-Shotgun/TinyLlama-1.1B-32k
45
+ models:
46
+ - model: hello
47
+ parameters:
48
+ weight: 0.66
49
+ - model: bye+Anarchist/PIPPA_LORA_TinyLlama
50
+ parameters:
51
+ weight: 0.5
52
+ dtype: bfloat16
53
+ ```