Azazelle commited on
Commit
5977c69
1 Parent(s): e9088fc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
 
 
 
 
2
  license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ tags:
4
+ - mistral
5
+ - merge
6
  license: cc-by-4.0
7
  ---
8
+ # Model Card for Sina-Loki-7b-Merge
9
+ <!-- Provide a quick summary of what the model is/does. -->
10
+ Part of a series of experimental DARE merges.
11
+
12
+ .yaml file for mergekit
13
+ ```.yaml:
14
+ models:
15
+ - model: RatanRohith/SRBOSGPT-7B-slerp
16
+ # no parameters necessary for base model
17
+ - model: rishiraj/smol-7b #75
18
+ parameters:
19
+ weight: 0.2
20
+ density: 0.41
21
+ - model: SanjiWatsuki/openchat-3.5-1210-starling-slerp #125
22
+ parameters:
23
+ weight: 0.33
24
+ density: 0.54
25
+ - model: Azazelle/Dumb-Maidlet #200
26
+ parameters:
27
+ weight: 0.53
28
+ density: 0.71
29
+ merge_method: dare_ties
30
+ base_model: RatanRohith/SRBOSGPT-7B-slerp
31
+ parameters:
32
+ int8_mask: true
33
+ dtype: bfloat16
34
+ ```