Azazelle commited on
Commit
1bbd507
1 Parent(s): 4d28167

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -1,3 +1,30 @@
1
  ---
 
 
 
 
2
  license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ tags:
4
+ - mistral
5
+ - merge
6
  license: cc-by-4.0
7
  ---
8
+ # Model Card for Dumb-Maidlet
9
+ <!-- Provide a quick summary of what the model is/does. -->
10
+ Slerp merge of Noromaid-7b-v0.2, NSFW_DPO_Noromaid-7b, go-bruins-v2, and smol-7b.
11
+
12
+ .yaml file for mergekit
13
+ ```.yaml:
14
+ slices:
15
+ - sources:
16
+ - model: Azazelle/Half-NSFW_Noromaid-7b
17
+ layer_range: [0, 32]
18
+ - model: Azazelle/smol_bruin-7b
19
+ layer_range: [0, 32]
20
+ merge_method: slerp
21
+ base_model: mistralai/Mistral-7B-v0.1
22
+ parameters:
23
+ t:
24
+ - filter: self_attn
25
+ value: [0.22, 0.61, 0.46, 0.77, 1]
26
+ - filter: mlp
27
+ value: [0.78, 0.39, 0.54, 0.23, 0]
28
+ - value: 0.5 # fallback for rest of tensors
29
+ dtype: float16
30
+ ```