WallStarer commited on
Commit
6dac01b
1 Parent(s): d68685c

Update README.md

Browse files

This is a 3.5bpw Exl2 quantization of anthracite-org/magnum-v2-123b using the provided measurements.json and ExLlama2 v0.1.0+.

Allows for 16-24k context (Q4) with 64GB VRAM.

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -4,6 +4,6 @@ license_name: mistral-ai-research-license
4
  license_link: https://mistral.ai/licenses/MRL-0.1.md
5
  ---
6
 
7
- This is a 3.5bpw Exllamav2 quantization of anthracite-org/magnum-v2-123b using the provided measurements.json.
8
 
9
- Should be good for 16-24k context (Q4) with 64GB VRAM.
 
4
  license_link: https://mistral.ai/licenses/MRL-0.1.md
5
  ---
6
 
7
+ This is a 3.5bpw Exl2 quantization of anthracite-org/magnum-v2-123b using the provided measurements.json and ExLlama2 v0.1.0+.
8
 
9
+ Allows for 16-24k context (Q4) with 64GB VRAM.