dddsaty commited on
Commit
2d68de9
1 Parent(s): d4b12ce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -1,3 +1,39 @@
1
  ---
2
  license: cc-by-nc-sa-4.0
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-sa-4.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
  ---
7
+
8
+ **Models**
9
+ - [Sakura-SOLAR-Instruct](https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct)
10
+ - [Sakura-SOLRCA-Math-Instruct-DPO-v2](https://huggingface.co/kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v2)
11
+ - [Sakura-SOLRCA-Instruct-DPO](https://huggingface.co/kyujinpy/Sakura-SOLRCA-Instruct-DPO)
12
+
13
+ **Merge Script**
14
+ ```
15
+ models:
16
+ - model: kyujinpy/Sakura-SOLAR-Instruct
17
+ parameters:
18
+ density: 1.0
19
+ weight: 1.0
20
+ - model: kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v2
21
+ parameters:
22
+ density: 0.5
23
+ weight: [0.33, 0.4, 0.33]
24
+ - model: kyujinpy/Sakura-SOLRCA-Instruct-DPO
25
+ parameters:
26
+ density: [0.33, 0.45, 0.66]
27
+ weight: 0.66
28
+ merge_method: dare_ties
29
+ base_model: kyujinpy/Sakura-SOLAR-Instruct
30
+ parameters:
31
+ normalize: true
32
+ int8_mask: true
33
+ dtype: bfloat16
34
+ tokenizer_source : union
35
+
36
+ ```
37
+
38
+ Original Author's HuggingFace profile :
39
+ - [kyujinpy](https://huggingface.co/kyujinpy)