File size: 343 Bytes
0f93e34
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
4-bit GPTQ quantization of [VicUnlocked-alpaca-30b](https://huggingface.co/Aeala/VicUnlocked-alpaca-30b)

**Important Note**: While this is trained on a cleaned ShareGPT dataset like Vicuna used, this was trained in the *Alpaca* format, so prompting should be something like:

```
### Instruction:

<prompt> (without the <>)

### Response:
```