LemonadeRP-4.5.3 4bpw

Exllama quant of KatyTheCutie/LemonadeRP-4.5.3

7B roleplay focused model, creativity and less cliché is the focus of this merge.

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt format: Chatml

Based on the models going in to this I would assume Chatml is the appropriate format.

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord

ko-fi.com/kooten if you would like to support me

Downloads last month
12
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.