File size: 452 Bytes
587076a
 
 
 
 
eadf5c0
 
 
4017bd5
 
 
 
 
 
 
 
 
eadf5c0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
# Synthia-13B EXL2

Weights of [Synthia-13B](https://huggingface.co/migtissera/Synthia-13B) converted
to [EXL2](https://github.com/turboderp/exllamav2#exl2-quantization) format.

Each separate quant is in a different branch, like in The Bloke's GPTQ repos.

```
export BRANCH=6_0-bpw-h6
git clone --single-branch --branch ${BRANCH} https://huggingface.co/latimar/Synthia-13B-exl2
```

There are the following branches:

```
4_625-bpw-h6
6_0-bpw-h6
```