dddsaty commited on
Commit
9a0917f
1 Parent(s): 4e61e1a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -20
README.md CHANGED
@@ -19,26 +19,6 @@ pipeline_tag: text-generation
19
  **Training Corpus**
20
  - [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
21
 
22
- **Merge Script**
23
- ```
24
- slices:
25
- - sources:
26
- - model: upstage/SOLAR-10.7B-Instruct-v1.0
27
- layer_range: [0, 48]
28
- - model: beomi/OPEN-SOLAR-KO-10.7B
29
- layer_range: [0, 48]
30
- merge_method: slerp
31
- base_model: upstage/SOLAR-10.7B-Instruct-v1.0
32
- parameters:
33
- t:
34
- - filter: self_attn
35
- value: [0, 0.5, 0.3, 0.7, 1]
36
- - filter: mlp
37
- value: [1, 0.5, 0.7, 0.3, 0]
38
- - value: 0.5 # fallback for rest of tensors
39
- dtype: float16
40
- ```
41
-
42
  **Score**
43
  |Average|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K|
44
  |:---:|:---:|:---:|:---:|:---:|:---:|:---:|
 
19
  **Training Corpus**
20
  - [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
21
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
  **Score**
23
  |Average|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K|
24
  |:---:|:---:|:---:|:---:|:---:|:---:|:---:|