--- license: cc-by-nc-4.0 --- # Noromaid-13b-v0.3 2bit QUIP# ## Description QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3) I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and really tiny ## Other quants: EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2) ## Prompt Format ### Silly Tavern Preset [Instruct template](https://files.catbox.moe/nzygwn.json) [Context template](https://files.catbox.moe/l5hguf.json) ### Alpaca: ``` Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {prompt} ### Input: {input} ### Response: ``` ## Contact Kooten on discord