Kooten
/

Noromaid-7B-0.4-DPO-8bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Noromaid-7B-0.4-DPO 8bpw EXL2

Description

Exllama quant of NeverSleep/Noromaid-7B-0.4-DPO

Other quants:

EXL2: 8bpw, 6bpw, 4bpw

Prompt format: Chatml

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord

Downloads last month: 11

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.