BRACKET
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ Quant|VRAM estimate|Additional
|
|
8 |
---|---|---
|
9 |
[4k_hb8_b8](https://huggingface.co/Beinsezii/Mythalion-13b-EXL2/tree/4k_hb8_b8)|18GB|Recommended!
|
10 |
[4k_hb6_b6](https://huggingface.co/Beinsezii/Mythalion-13b-EXL2/tree/4k_hb6_b6)|15GB|
|
11 |
-
4k_hb6_b5](https://huggingface.co/Beinsezii/Mythalion-13b-EXL2/tree/4k_hb6_b5)|13GB|Should fit in 12GB cards with 2k context
|
12 |
|
13 |
|
14 |
Breaking down the names:
|
|
|
8 |
---|---|---
|
9 |
[4k_hb8_b8](https://huggingface.co/Beinsezii/Mythalion-13b-EXL2/tree/4k_hb8_b8)|18GB|Recommended!
|
10 |
[4k_hb6_b6](https://huggingface.co/Beinsezii/Mythalion-13b-EXL2/tree/4k_hb6_b6)|15GB|
|
11 |
+
[4k_hb6_b5](https://huggingface.co/Beinsezii/Mythalion-13b-EXL2/tree/4k_hb6_b5)|13GB|Should fit in 12GB cards with 2k context
|
12 |
|
13 |
|
14 |
Breaking down the names:
|