4-bit GPTQ quantization of Enterredaas-33b
Important Note: This was trained in the Alpaca format, so prompting should be something like:
### Instruction:
<system prompt> (without the <>, this works like telling the AI what it is/purpose. i.e. like ChatGPT API's system prompt)
### Input:
<prompt> (without the <>)
### Response: