brucethemoose
commited on
Commit
•
5fb9f53
1
Parent(s):
8d69df1
Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,22 @@
|
|
2 |
license: other
|
3 |
license_name: yi
|
4 |
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
|
|
|
|
|
|
|
5 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: other
|
3 |
license_name: yi
|
4 |
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
library_name: transformers
|
8 |
---
|
9 |
+
See: https://huggingface.co/01-ai/Yi-34B-200K
|
10 |
+
|
11 |
+
Yi-30B-200K quantized to 3.9bpw, which should allow for ~50K context on 24GB GPUs. Ask if you need another size.
|
12 |
+
|
13 |
+
Quantized with 8K rows on a mix of wikitext and my own RP stories.
|
14 |
+
|
15 |
+
Use with --enable-remote-code in text-gen-ui.
|
16 |
+
|
17 |
+
https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
|
18 |
+
|
19 |
+
---
|
20 |
+
license: other
|
21 |
+
license_name: yi
|
22 |
+
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
|
23 |
+
---
|