metadata
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- SanjiWatsuki/Lelantos-DPO-7B
- NeverSleep/Noromaid-7B-0.4-DPO
Lelantos-Maid-DPO-7B 8bpw EXL2
Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.
Description
Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B
Other quants:
Prompt format: ChatML
It is partly Noromaid so should be ChatML
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
Contact
Kooten on discord