saishf commited on
Commit
314d534
1 Parent(s): 2793805

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -42
README.md CHANGED
@@ -1,42 +1,43 @@
1
- ---
2
- base_model:
3
- - saishf/SOVLish-Maid-L3-8B
4
- - saishf/Ortho-SOVL-8B-L3
5
- - saishf/Merge-Mayhem-L3-V2
6
- - saishf/Merge-Mayhem-L3-V2.1
7
- library_name: transformers
8
- tags:
9
- - mergekit
10
- - merge
11
-
12
- ---
13
- # merge
14
-
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
-
17
- ## Merge Details
18
- ### Merge Method
19
-
20
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [saishf/Ortho-SOVL-8B-L3](https://huggingface.co/saishf/Ortho-SOVL-8B-L3) as a base.
21
-
22
- ### Models Merged
23
-
24
- The following models were included in the merge:
25
- * [saishf/SOVLish-Maid-L3-8B](https://huggingface.co/saishf/SOVLish-Maid-L3-8B)
26
- * [saishf/Merge-Mayhem-L3-V2](https://huggingface.co/saishf/Merge-Mayhem-L3-V2)
27
- * [saishf/Merge-Mayhem-L3-V2.1](https://huggingface.co/saishf/Merge-Mayhem-L3-V2.1)
28
-
29
- ### Configuration
30
-
31
- The following YAML configuration was used to produce this model:
32
-
33
- ```yaml
34
- models:
35
- - model: saishf/Ortho-SOVL-8B-L3
36
- - model: saishf/Merge-Mayhem-L3-V2
37
- - model: saishf/Merge-Mayhem-L3-V2.1
38
- - model: saishf/SOVLish-Maid-L3-8B
39
- merge_method: model_stock
40
- base_model: saishf/Ortho-SOVL-8B-L3
41
- dtype: bfloat16
42
- ```
 
 
1
+ ---
2
+ base_model:
3
+ - saishf/SOVLish-Maid-L3-8B
4
+ - saishf/Ortho-SOVL-8B-L3
5
+ - saishf/Merge-Mayhem-L3-V2
6
+ - saishf/Merge-Mayhem-L3-V2.1
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+
12
+ ---
13
+ # merge
14
+
15
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
+
17
+ ## Merge Details
18
+ This model is a merge of all of my SOVL models, in the hopes to create the most unhinged and wild model possible.
19
+ ### Merge Method
20
+
21
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [saishf/Ortho-SOVL-8B-L3](https://huggingface.co/saishf/Ortho-SOVL-8B-L3) as a base.
22
+
23
+ ### Models Merged
24
+
25
+ The following models were included in the merge:
26
+ * [saishf/SOVLish-Maid-L3-8B](https://huggingface.co/saishf/SOVLish-Maid-L3-8B)
27
+ * [saishf/Merge-Mayhem-L3-V2](https://huggingface.co/saishf/Merge-Mayhem-L3-V2)
28
+ * [saishf/Merge-Mayhem-L3-V2.1](https://huggingface.co/saishf/Merge-Mayhem-L3-V2.1)
29
+
30
+ ### Configuration
31
+
32
+ The following YAML configuration was used to produce this model:
33
+
34
+ ```yaml
35
+ models:
36
+ - model: saishf/Ortho-SOVL-8B-L3
37
+ - model: saishf/Merge-Mayhem-L3-V2
38
+ - model: saishf/Merge-Mayhem-L3-V2.1
39
+ - model: saishf/SOVLish-Maid-L3-8B
40
+ merge_method: model_stock
41
+ base_model: saishf/Ortho-SOVL-8B-L3
42
+ dtype: bfloat16
43
+ ```