Update README.md
Browse files
README.md
CHANGED
@@ -11,4 +11,8 @@ Use (max_seq_len = context):
|
|
11 |
|
12 |
If max_seq_len = 4096, compress_pos_emb = 2
|
13 |
|
14 |
-
If max_seq_len = 8192, compress_pos_emb = 4
|
|
|
|
|
|
|
|
|
|
11 |
|
12 |
If max_seq_len = 4096, compress_pos_emb = 2
|
13 |
|
14 |
+
If max_seq_len = 8192, compress_pos_emb = 4
|
15 |
+
|
16 |
+
If you have 2x24 GB VRAM GPUs cards, to not get Out of Memory errors at 8192 context, use:
|
17 |
+
|
18 |
+
gpu_split: 9,21
|