gmonsoon commited on
Commit
667c7f6
·
verified ·
1 Parent(s): 0be708b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -50
README.md CHANGED
@@ -4,58 +4,17 @@ base_model:
4
  - gmonsoon/Eunoia-Gemma-9B
5
  library_name: transformers
6
  tags:
7
- - mergekit
8
- - merge
9
-
 
 
10
  ---
11
  # merge
12
 
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [lunahr/SystemGemma2-9b-it](https://huggingface.co/lunahr/SystemGemma2-9b-it)
24
- * [gmonsoon/Eunoia-Gemma-9B](https://huggingface.co/gmonsoon/Eunoia-Gemma-9B)
25
-
26
- ### Configuration
27
 
28
- The following YAML configuration was used to produce this model:
29
 
30
- ```yaml
31
- slices:
32
- - sources:
33
- - model: lunahr/SystemGemma2-9b-it
34
- layer_range:
35
- - 0
36
- - 42
37
- - model: gmonsoon/Eunoia-Gemma-9B
38
- layer_range:
39
- - 0
40
- - 42
41
- merge_method: slerp
42
- base_model: lunahr/SystemGemma2-9b-it
43
- parameters:
44
- t:
45
- - filter: self_attn
46
- value:
47
- - 0
48
- - 0.5
49
- - 0.3
50
- - 0.7
51
- - 1
52
- - filter: mlp
53
- value:
54
- - 1
55
- - 0.5
56
- - 0.7
57
- - 0.3
58
- - 0
59
- - value: 0.5
60
- dtype: bfloat16
61
- ```
 
4
  - gmonsoon/Eunoia-Gemma-9B
5
  library_name: transformers
6
  tags:
7
+ - conversational
8
+ license: gemma
9
+ language:
10
+ - id
11
+ - en
12
  ---
13
  # merge
14
 
15
+ This is a merge of lunahr/SystemGemma2-9b-it and gmonsoon/Eunoia-Gemma-9B. The purpose of this merge is to add the system prompt that is already owned by SystemGemma2-9b-it with the Eunoia-Gemma-9B model which has better Indonesian language capabilities.
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
+ # demo
18
 
19
+ TBA
20
+ ```