Edit model card

Qwen2-1.5B-Instruct-Abliterated-exl2

Model: Qwen2-1.5B-Instruct-Abliterated
Made by: trollek

Based on original model: Qwen2-1.5B-Instruct
Created by: Qwen

Quants

4bpw h6
4.25bpw h6
4.65bpw h6
5bpw h6
6bpw h6
8bpw h8

Quantization notes

Made with Exllamav2 0.1.5 with the default dataset.

Original model card

This is an abliterated version of Qwen2-1.5B-Instruct using the same procedure as augmxnt/Qwen2-7B-Instruct-deccp with their code on Github with some added lines from mlabonne/harmful_behaviors to the harmful.txt file.

I have not done anything else to the model. Yet.

Downloads last month
2
Inference API
Inference API (serverless) has been turned off for this model.

Model tree for cgus/Qwen2-1.5B-Instruct-abliterated-exl2

Quantized
this model