Azazelle commited on
Commit
c5fa9f4
1 Parent(s): dee74a4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
 
 
 
 
2
  license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ tags:
4
+ - mistral
5
+ - merge
6
  license: cc-by-4.0
7
  ---
8
+ # Model Card for Maylin-7b
9
+ <!-- Provide a quick summary of what the model is/does. -->
10
+ DARE merge intended to help the Argetsu model be more coherent and less horny.
11
+
12
+ .yaml file for mergekit
13
+ ```.yaml:
14
+ models:
15
+ - model: mistralai/Mistral-7B-v0.1
16
+ # no parameters necessary for base model
17
+ - model: SanjiWatsuki/Sonya-7B #200
18
+ parameters:
19
+ weight: 0.45
20
+ density: 0.75
21
+ - model: Azazelle/Argetsu #175
22
+ parameters:
23
+ weight: 0.39
24
+ density: 0.70
25
+ - model: Azazelle/Tippy-Toppy-7b #100
26
+ parameters:
27
+ weight: 0.22
28
+ density: 0.52
29
+ merge_method: dare_ties
30
+ base_model: mistralai/Mistral-7B-v0.1
31
+ parameters:
32
+ int8_mask: true
33
+ dtype: bfloat16
34
+ ```