Kooten/Lelantos-Maid-DPO-7B-8bpw-exl2

Lelantos-Maid-DPO-7B 8bpw EXL2

Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.

Description

Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B

Other quants:

EXL2: 8bpw, 4bpw

Prompt format: ChatML

It is partly Noromaid so should be ChatML

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord