Azazelle commited on
Commit
d5cde26
1 Parent(s): 6636052

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
 
 
 
 
2
  license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ tags:
4
+ - mistral
5
+ - merge
6
  license: cc-by-4.0
7
  ---
8
+ # Model Card for Argetsu
9
+ <!-- Provide a quick summary of what the model is/does. -->
10
+ Experimental DARE (no idea if this is decent).
11
+
12
+ .yaml file for mergekit
13
+ ```.yaml:
14
+ models:
15
+ - model: Dans-DiscountModels/Dans-07YahooAnswers-7b
16
+ # no parameters necessary for base model
17
+ - model: Azazelle/Maylin-7b #200
18
+ parameters:
19
+ weight: 0.45
20
+ density: 0.75
21
+ - model: Azazelle/smol_bruin-7b #175
22
+ parameters:
23
+ weight: 0.39
24
+ density: 0.70
25
+ - model: SanjiWatsuki/Kunoichi-7B #100
26
+ parameters:
27
+ weight: 0.22
28
+ density: 0.52
29
+ merge_method: dare_ties
30
+ base_model: Dans-DiscountModels/Dans-07YahooAnswers-7b
31
+ parameters:
32
+ int8_mask: true
33
+ dtype: bfloat16
34
+ ```