spow12 commited on
Commit
cc2ae0a
1 Parent(s): c870478

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -1,6 +1,14 @@
1
  ---
2
  library_name: transformers
3
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
4
  language:
5
  - ko
6
  - en
@@ -14,6 +22,18 @@ language:
14
 
15
  This model is a Supervised fine-tuned version of [mistralai/Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) with DeepSpeed and trl for korean.
16
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ### Trained Data
18
 
19
  - Trained with public, private data (about 130K)
 
1
  ---
2
  library_name: transformers
3
  license: cc-by-nc-4.0
4
+
5
+ base_model:
6
+ - anthracite-org/magnum-v4-12b
7
+ - mistralai/Mistral-Nemo-Instruct-2407
8
+ - werty1248/Mistral-Nemo-NT-Ko-12B-dpo
9
+ tags:
10
+ - mergekit
11
+ - merge
12
  language:
13
  - ko
14
  - en
 
22
 
23
  This model is a Supervised fine-tuned version of [mistralai/Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) with DeepSpeed and trl for korean.
24
 
25
+ Merge methods.
26
+ ```yaml
27
+ models:
28
+ - model: anthracite-org/magnum-v4-12b
29
+ - model: mistralai/Mistral-Nemo-Instruct-2407
30
+ - model: spow12/Mistral-Nemo-Instruct-2407_sft_ver_4.4(private)
31
+ - model: werty1248/Mistral-Nemo-NT-Ko-12B-dpo
32
+ merge_method: model_stock
33
+ base_model: spow12/Mistral-Nemo-Instruct-2407_sft_ver_4.4(private)
34
+ dtype: bfloat16
35
+ ```
36
+
37
  ### Trained Data
38
 
39
  - Trained with public, private data (about 130K)