jaspercatapang
commited on
Commit
•
09b7d36
1
Parent(s):
267522f
Update README.md
Browse files
README.md
CHANGED
@@ -7,14 +7,14 @@ tags:
|
|
7 |
- merge
|
8 |
|
9 |
---
|
10 |
-
#
|
11 |
|
12 |
-
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
13 |
|
14 |
## Merge Details
|
15 |
### Merge Method
|
16 |
|
17 |
-
This model
|
18 |
|
19 |
### Models Merged
|
20 |
|
|
|
7 |
- merge
|
8 |
|
9 |
---
|
10 |
+
# yi-bagel-2x34b-moe
|
11 |
|
12 |
+
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). For more information, kindly refer to the model cards from jondurbin linked in a section below.
|
13 |
|
14 |
## Merge Details
|
15 |
### Merge Method
|
16 |
|
17 |
+
This model is an expertimental merge using the [linear](https://arxiv.org/abs/2203.05482) merge method.
|
18 |
|
19 |
### Models Merged
|
20 |
|