Update README.md
Browse files
README.md
CHANGED
|
@@ -13,4 +13,4 @@ Use compress_pos_emb = 8 for any context up to 16384 context.
|
|
| 13 |
|
| 14 |
If you have 2x24 GB VRAM GPUs cards, to not get Out of Memory errors at 16384 context, use:
|
| 15 |
|
| 16 |
-
gpu_split: 8.
|
|
|
|
| 13 |
|
| 14 |
If you have 2x24 GB VRAM GPUs cards, to not get Out of Memory errors at 16384 context, use:
|
| 15 |
|
| 16 |
+
gpu_split: 8.8,9.2
|