prithivMLmods commited on
Commit
0f7a333
·
verified ·
1 Parent(s): 104edba

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -5
README.md CHANGED
@@ -8,21 +8,23 @@ tags:
8
  - merge
9
 
10
  ---
11
- # merge
 
 
 
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
15
- ## Merge Details
16
- ### Merge Method
17
 
18
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [prithivMLmods/Calme-Ties2-78B](https://huggingface.co/prithivMLmods/Calme-Ties2-78B) as a base.
19
 
20
- ### Models Merged
21
 
22
  The following models were included in the merge:
23
  * [MaziyarPanahi/calme-2.4-rys-78b](https://huggingface.co/MaziyarPanahi/calme-2.4-rys-78b)
24
 
25
- ### Configuration
26
 
27
  The following YAML configuration was used to produce this model:
28
 
 
8
  - merge
9
 
10
  ---
11
+ # **Calme-Ties3-78B**
12
+
13
+ This model is a result of merging pre-trained language models using the TIES merge method, with prithivMLmods/Calme-Ties2-78B as the base model. The merged model includes MaziyarPanahi/calme-2.4-rys-78b, with both models contributing equally in terms of weight and density. The configuration features parameters such as normalization, int8 masking, and the use of a bfloat16 data type to enhance performance.
14
+ # **Merge**
15
 
16
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
 
18
+ # **Merge Method**
 
19
 
20
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [prithivMLmods/Calme-Ties2-78B](https://huggingface.co/prithivMLmods/Calme-Ties2-78B) as a base.
21
 
22
+ # **Models Merged**
23
 
24
  The following models were included in the merge:
25
  * [MaziyarPanahi/calme-2.4-rys-78b](https://huggingface.co/MaziyarPanahi/calme-2.4-rys-78b)
26
 
27
+ # **Configuration**
28
 
29
  The following YAML configuration was used to produce this model:
30