---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- SanjiWatsuki/Lelantos-DPO-7B
- NeverSleep/Noromaid-7B-0.4-DPO
---

# Lelantos-Maid-DPO-7B 4bpw EXL2
***Note:*** There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.

## Description
Exllama quant of [SanjiWatsuki/Lelantos-Maid-DPO-7B](https://huggingface.co/SanjiWatsuki/Lelantos-Maid-DPO-7B)

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/Lelantos-Maid-DPO-7B-8bpw-exl2), [4bpw](https://huggingface.co/Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2)

## Prompt format: ChatML
It is partly Noromaid so should be ChatML

```
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
```
## Contact
Kooten on discord