lodrick-the-lafted commited on
Commit
86dbef4
1 Parent(s): bc545c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -13
README.md CHANGED
@@ -4,20 +4,11 @@ tags:
4
  - moe
5
  - merge
6
  ---
 
 
7
 
8
- WinterGoddess + AuroraNights
9
-
10
- Yet another big mergekit abomination.
11
 
12
  Still undergoing testing.
13
 
14
- BOILERPLATE DON'T READ
15
-
16
-
17
-
18
- from transformers import AutoConfig, AutoModel, AutoTokenizer
19
- config = AutoConfig.from_pretrained("your model name", revision=revision)
20
- model = AutoModel.from_pretrained("your model name", revision=revision)
21
- tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)
22
-
23
- If this step fails, follow the error messages to debug your model before submitting it. It's likely your model has been improperly uploaded.
 
4
  - moe
5
  - merge
6
  ---
7
+ <img src=https://huggingface.co/lodrick-the-lafted/Grafted-Llama2-2x70B/blob/main/gl.png>
8
+ The Llamas are WinterGoddess + AuroraNights.
9
 
10
+ This is yet another mergekit abomination.
 
 
11
 
12
  Still undergoing testing.
13
 
14
+ This is probably more of a "dense" MoE than a sparse one.