Description
Exllama 2 quant of tavtav/Rose-20B
Please make sure to read their description
6 BPW, Head bit set to 8
Prompt template: Custom format, or Alpaca
Custom format:
Since this is based on Noromaid i recommend the SillyTavern config files from NeverSleep:
Alpaca:
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
- Downloads last month
- 3