lodrick-the-lafted
commited on
Commit
•
86dbef4
1
Parent(s):
bc545c6
Update README.md
Browse files
README.md
CHANGED
@@ -4,20 +4,11 @@ tags:
|
|
4 |
- moe
|
5 |
- merge
|
6 |
---
|
|
|
|
|
7 |
|
8 |
-
|
9 |
-
|
10 |
-
Yet another big mergekit abomination.
|
11 |
|
12 |
Still undergoing testing.
|
13 |
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
from transformers import AutoConfig, AutoModel, AutoTokenizer
|
19 |
-
config = AutoConfig.from_pretrained("your model name", revision=revision)
|
20 |
-
model = AutoModel.from_pretrained("your model name", revision=revision)
|
21 |
-
tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)
|
22 |
-
|
23 |
-
If this step fails, follow the error messages to debug your model before submitting it. It's likely your model has been improperly uploaded.
|
|
|
4 |
- moe
|
5 |
- merge
|
6 |
---
|
7 |
+
<img src=https://huggingface.co/lodrick-the-lafted/Grafted-Llama2-2x70B/blob/main/gl.png>
|
8 |
+
The Llamas are WinterGoddess + AuroraNights.
|
9 |
|
10 |
+
This is yet another mergekit abomination.
|
|
|
|
|
11 |
|
12 |
Still undergoing testing.
|
13 |
|
14 |
+
This is probably more of a "dense" MoE than a sparse one.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|