Kooten/Noromaid-7B-0.4-DPO-8bpw-exl2

Noromaid-7B-0.4-DPO 8bpw EXL2

Description

Exllama quant of NeverSleep/Noromaid-7B-0.4-DPO

Other quants:

EXL2: 8bpw, 6bpw, 4bpw

Prompt format: Chatml

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord