Arkana08 commited on
Commit
86c62e8
1 Parent(s): cf2b035

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +48 -48
README.md CHANGED
@@ -1,48 +1,48 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # output-model-directory
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using D:\Programs\mergekit-main\ModelsMerge\NIHAPPY as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * D:\Programs\mergekit-main\ModelsMerge\V-Blackroot
22
- * D:\Programs\mergekit-main\ModelsMerge\Mythorica
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- models:
30
- - model: D:\Programs\mergekit-main\ModelsMerge\Mythorica
31
- parameters:
32
- weight: 0.4
33
- density: 0.6
34
- - model: D:\Programs\mergekit-main\ModelsMerge\NIHAPPY
35
- parameters:
36
- weight: 0.35
37
- density: 0.7
38
- - model: D:\Programs\mergekit-main\ModelsMerge\V-Blackroot
39
- parameters:
40
- weight: 0.25
41
- density: 0.55
42
- merge_method: dare_ties
43
- base_model: D:\Programs\mergekit-main\ModelsMerge\NIHAPPY
44
- parameters:
45
- int8_mask: true
46
- dtype: bfloat16
47
-
48
- ```
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # output-model-directory
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using D:\Programs\mergekit-main\ModelsMerge\NIHAPPY as a base.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * D:\Programs\mergekit-main\ModelsMerge\V-Blackroot
22
+ * D:\Programs\mergekit-main\ModelsMerge\Mythorica
23
+
24
+ ### Configuration
25
+
26
+ The following YAML configuration was used to produce this model:
27
+
28
+ ```yaml
29
+ models:
30
+ - model: Arkana08/Mythorica-L3-8B
31
+ parameters:
32
+ weight: 0.4
33
+ density: 0.6
34
+ - model: Arkana08/NIHAPPY-L3.1-8B-v0.09
35
+ parameters:
36
+ weight: 0.35
37
+ density: 0.7
38
+ - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
39
+ parameters:
40
+ weight: 0.25
41
+ density: 0.55
42
+ merge_method: dare_ties
43
+ base_model: Arkana08/NIHAPPY-L3.1-8B-v0.09
44
+ parameters:
45
+ int8_mask: true
46
+ dtype: bfloat16
47
+
48
+ ```