README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - SanjiWatsuki/Lelantos-DPO-7B
  - NeverSleep/Noromaid-7B-0.4-DPO

Lelantos-Maid-DPO-7B 8bpw EXL2

Description

Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B

Other quants:

EXL2: 8bpw, 4bpw

Prompt format: ChatML

It is partly Noromaid so should be ChatML

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord