RichardErkhov/Undi95_-_MXLewdMini-L2-13B-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

MXLewdMini-L2-13B - GGUF

• Model creator: https://huggingface.co/Undi95/
• Original model: https://huggingface.co/Undi95/MXLewdMini-L2-13B/

Name	Quant method	Size
MXLewdMini-L2-13B.Q2_K.gguf	Q2_K	4.52GB
MXLewdMini-L2-13B.IQ3_XS.gguf	IQ3_XS	4.99GB
MXLewdMini-L2-13B.IQ3_S.gguf	IQ3_S	5.27GB
MXLewdMini-L2-13B.Q3_K_S.gguf	Q3_K_S	5.27GB
MXLewdMini-L2-13B.IQ3_M.gguf	IQ3_M	0.36GB
MXLewdMini-L2-13B.Q3_K.gguf	Q3_K	5.9GB
MXLewdMini-L2-13B.Q3_K_M.gguf	Q3_K_M	5.9GB
MXLewdMini-L2-13B.Q3_K_L.gguf	Q3_K_L	6.45GB
MXLewdMini-L2-13B.IQ4_XS.gguf	IQ4_XS	6.54GB
MXLewdMini-L2-13B.Q4_0.gguf	Q4_0	6.86GB
MXLewdMini-L2-13B.IQ4_NL.gguf	IQ4_NL	6.9GB
MXLewdMini-L2-13B.Q4_K_S.gguf	Q4_K_S	6.91GB
MXLewdMini-L2-13B.Q4_K.gguf	Q4_K	7.33GB
MXLewdMini-L2-13B.Q4_K_M.gguf	Q4_K_M	7.33GB
MXLewdMini-L2-13B.Q4_1.gguf	Q4_1	7.61GB
MXLewdMini-L2-13B.Q5_0.gguf	Q5_0	8.36GB
MXLewdMini-L2-13B.Q5_K_S.gguf	Q5_K_S	8.36GB
MXLewdMini-L2-13B.Q5_K.gguf	Q5_K	8.6GB
MXLewdMini-L2-13B.Q5_K_M.gguf	Q5_K_M	8.6GB
MXLewdMini-L2-13B.Q5_1.gguf	Q5_1	4.68GB
MXLewdMini-L2-13B.Q6_K.gguf	Q6_K	9.95GB
MXLewdMini-L2-13B.Q8_0.gguf	Q8_0	12.88GB

Original model description:

license: cc-by-nc-4.0

Merge:

[Xwin (0.66) + ReMM (0.33)] x [Xwin (0.33) + MLewd (0.66)]

The goal was to recreate https://huggingface.co/Undi95/MXLewd-L2-20B in 13B without using merge interlacing (will probably be a little less good).

Models used

• Undi95/MLewd-L2-13B-v2-3
• Undi95/ReMM-v2.1-L2-13B
• Xwin-LM/Xwin-LM-13B-V0.1

One part is ReMM (0.33) and Xwin (0.66)

One part is Xwin (0.33) and MLewd (0.66)

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that completes the request.

### Instruction:
{prompt}

### Response: