win10 commited on
Commit
94cc0f4
1 Parent(s): 339f522

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -54
README.md CHANGED
@@ -1,54 +1,60 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # 13B
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the passthrough merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- dtype: bfloat16
29
- merge_method: passthrough
30
- slices:
31
- - sources:
32
- - layer_range: [0, 8]
33
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
34
- - sources:
35
- - layer_range: [4, 12]
36
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
37
- - sources:
38
- - layer_range: [8, 16]
39
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
40
- - sources:
41
- - layer_range: [12, 20]
42
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
43
- - sources:
44
- - layer_range: [16, 24]
45
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
46
- - sources:
47
- - layer_range: [20, 28]
48
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
49
- - sources:
50
- - layer_range: [24, 32]
51
- model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
52
-
53
-
54
- ```
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: [Meta-Llama-3-8B-Instruct]
3
+ library_name: transformers
4
+ language:
5
+ - en
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - pytorch
9
+ - llama
10
+ - llama-3
11
+ - mergekit
12
+ - merge
13
+ license: llama3
14
+ ---
15
+ # 13B
16
+
17
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
+
19
+ ## Merge Details
20
+ ### Merge Method
21
+
22
+ This model was merged using the passthrough merge method.
23
+
24
+ ### Models Merged
25
+
26
+ The following models were included in the merge:
27
+ * F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
28
+
29
+ ### Configuration
30
+
31
+ The following YAML configuration was used to produce this model:
32
+
33
+ ```yaml
34
+ dtype: bfloat16
35
+ merge_method: passthrough
36
+ slices:
37
+ - sources:
38
+ - layer_range: [0, 8]
39
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
40
+ - sources:
41
+ - layer_range: [4, 12]
42
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
43
+ - sources:
44
+ - layer_range: [8, 16]
45
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
46
+ - sources:
47
+ - layer_range: [12, 20]
48
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
49
+ - sources:
50
+ - layer_range: [16, 24]
51
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
52
+ - sources:
53
+ - layer_range: [20, 28]
54
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
55
+ - sources:
56
+ - layer_range: [24, 32]
57
+ model: F:\text-generation-webui\models\meta-llama_Meta-Llama-3-8B-Instruct
58
+
59
+
60
+ ```