brucethemoose commited on
Commit
5fb9f53
1 Parent(s): 8d69df1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -2,4 +2,22 @@
2
  license: other
3
  license_name: yi
4
  license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
 
 
 
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: other
3
  license_name: yi
4
  license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
5
+ language:
6
+ - en
7
+ library_name: transformers
8
  ---
9
+ See: https://huggingface.co/01-ai/Yi-34B-200K
10
+
11
+ Yi-30B-200K quantized to 3.9bpw, which should allow for ~50K context on 24GB GPUs. Ask if you need another size.
12
+
13
+ Quantized with 8K rows on a mix of wikitext and my own RP stories.
14
+
15
+ Use with --enable-remote-code in text-gen-ui.
16
+
17
+ https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
18
+
19
+ ---
20
+ license: other
21
+ license_name: yi
22
+ license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
23
+ ---