Quant-Cartel
/

WizardLM-2-8x22B-exl2-rpcal

Model card Files Files and versions Community

rAIfle commited on Apr 24

Commit

5419c03

•

1 Parent(s): f29ff63

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -27,6 +27,7 @@ Branches:
 - `main` -- `measurement.json`
 - `4.5b6h` -- 4.5bpw, 6bit lm_head
 - `4b6h` -- 4bpw, 6bit lm_head
 Original model link: (reuploaded, original source got taken down) [alpindale/WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B)

 - `main` -- `measurement.json`
 - `4.5b6h` -- 4.5bpw, 6bit lm_head
 - `4b6h` -- 4bpw, 6bit lm_head
+- `3.5b6h` -- 3.5bpw, 6bit lm_head
 Original model link: (reuploaded, original source got taken down) [alpindale/WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B)