Kooten/Noromaid-13b-v0.3-QUIP-2bit

Noromaid-13b-v0.3 2bit QUIP#

Description

QUIP quant of NeverSleep/Noromaid-13b-v0.3

I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and really tiny

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt Format

Silly Tavern Preset

Instruct template

Context template

Alpaca:

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Input:
{input}

### Response:

Contact

Kooten on discord