zeroblu3 commited on
Commit
650a92b
1 Parent(s): c1c3be6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +59 -59
README.md CHANGED
@@ -1,59 +1,59 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # LewdPoppy
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the SLERP merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * E:\AI\mergekit-main\Nitral-AI_Poppy_Porpoise-0.72-L3-8B
22
- * E:\AI\mergekit-main\Undi95_Llama-3-LewdPlay-8B-evo
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- slices:
30
- - sources:
31
- - model: E:\AI\mergekit-main\Nitral-AI_Poppy_Porpoise-0.72-L3-8B
32
- layer_range:
33
- - 0
34
- - 32
35
- - model: E:\AI\mergekit-main\Undi95_Llama-3-LewdPlay-8B-evo
36
- layer_range:
37
- - 0
38
- - 32
39
- merge_method: slerp
40
- base_model: E:\AI\mergekit-main\Nitral-AI_Poppy_Porpoise-0.72-L3-8B
41
- parameters:
42
- t:
43
- - filter: self_attn
44
- value:
45
- - 0
46
- - 0.5
47
- - 0.3
48
- - 0.7
49
- - 1
50
- - filter: mlp
51
- value:
52
- - 1
53
- - 0.5
54
- - 0.7
55
- - 0.3
56
- - 0
57
- - value: 0.5
58
- dtype: bfloat16
59
- ```
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # LewdPoppy
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the SLERP merge method.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * Nitral-AI_Poppy_Porpoise-0.72-L3-8B
22
+ * Undi95_Llama-3-LewdPlay-8B-evo
23
+
24
+ ### Configuration
25
+
26
+ The following YAML configuration was used to produce this model:
27
+
28
+ ```yaml
29
+ slices:
30
+ - sources:
31
+ - model: E:\AI\mergekit-main\Nitral-AI_Poppy_Porpoise-0.72-L3-8B
32
+ layer_range:
33
+ - 0
34
+ - 32
35
+ - model: E:\AI\mergekit-main\Undi95_Llama-3-LewdPlay-8B-evo
36
+ layer_range:
37
+ - 0
38
+ - 32
39
+ merge_method: slerp
40
+ base_model: E:\AI\mergekit-main\Nitral-AI_Poppy_Porpoise-0.72-L3-8B
41
+ parameters:
42
+ t:
43
+ - filter: self_attn
44
+ value:
45
+ - 0
46
+ - 0.5
47
+ - 0.3
48
+ - 0.7
49
+ - 1
50
+ - filter: mlp
51
+ value:
52
+ - 1
53
+ - 0.5
54
+ - 0.7
55
+ - 0.3
56
+ - 0
57
+ - value: 0.5
58
+ dtype: bfloat16
59
+ ```