File size: 496 Bytes
1f7151c 2cb04b1 2e10a2e 2cb04b1 2e10a2e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
datasets:
- lemonilia/LimaRP
library_name: transformers
tags:
- roleplay
- text-generation-inference
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
My first exl2 quant of my favourite go-to roleplaying model. Can fit into my empty 24GB VRAM with 32k context in 8-bit cache. Might do a 4.25bpw quant later.
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
Promtp format: https://github.com/tatsu-lab/stanford_alpaca |