Commit
•
c9c2fa5
1
Parent(s):
6dac01b
Update README.md
Browse filesThis is a 3.5bpw Exl2 quantization of anthracite-org/magnum-v2-123b using the provided measurements.json and ExLlamav2 v0.1.0+.
Allows for 16-24k context (Q4) with 64GB VRAM.
README.md
CHANGED
|
@@ -4,6 +4,6 @@ license_name: mistral-ai-research-license
|
|
| 4 |
license_link: https://mistral.ai/licenses/MRL-0.1.md
|
| 5 |
---
|
| 6 |
|
| 7 |
-
This is a 3.5bpw Exl2 quantization of anthracite-org/magnum-v2-123b using the provided measurements.json and
|
| 8 |
|
| 9 |
Allows for 16-24k context (Q4) with 64GB VRAM.
|
|
|
|
| 4 |
license_link: https://mistral.ai/licenses/MRL-0.1.md
|
| 5 |
---
|
| 6 |
|
| 7 |
+
This is a 3.5bpw Exl2 quantization of anthracite-org/magnum-v2-123b using the provided measurements.json and ExLlamav2 v0.1.0+.
|
| 8 |
|
| 9 |
Allows for 16-24k context (Q4) with 64GB VRAM.
|