| # Synthia-13B EXL2 | |
| Weights of [Synthia-13B](https://huggingface.co/migtissera/Synthia-13B) converted | |
| to [EXL2](https://github.com/turboderp/exllamav2#exl2-quantization) format. | |
| Each separate quant is in a different branch, like in The Bloke's GPTQ repos. | |
| ``` | |
| export BRANCH=6_0-bpw-h6 | |
| git clone --single-branch --branch ${BRANCH} https://huggingface.co/latimar/Synthia-13B-exl2 | |
| ``` | |
| There are the following branches: | |
| ``` | |
| 4_625-bpw-h6 | |
| 6_0-bpw-h6 | |
| ``` | |