ArRENCE AI
webblocalai.com · Join Us On X · Hugging Face · GitHub · ArRENCE AI Chat

---

Available GGUF Quantizations

These are ready-to-use quantized versions for llama.cpp, Ollama, LM Studio, etc.

Quant	File	Size	Notes
Q4_K_M	DeepSeek-R1-Distill-Qwen-1.5B-OBLITERATED-Q4_K_M.gguf	~1.1 GB	Recommended balance
Q5_K_M	DeepSeek-R1-Distill-Qwen-1.5B-OBLITERATED-Q5_K_M.gguf	~1.29 GB	Higher quality
Q6_K	DeepSeek-R1-Distill-Qwen-1.5B-OBLITERATED -Q6_K.gguf	~1.5 GB	Near-original quality

DeepSeek-R1-Distill-Qwen-1.5B-OBLITERATED

This model was abliterated using the aggressive method via OBLITERATUS.

Detail	Value
Base model	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
Method	aggressive
Source	obliterate

How to Use

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("DeepSeek-R1-Distill-Qwen-1.5B-OBLITERATED")
tokenizer = AutoTokenizer.from_pretrained("DeepSeek-R1-Distill-Qwen-1.5B-OBLITERATED")

prompt = "Hello, how are you?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

About OBLITERATUS

OBLITERATUS is an open-source tool for removing refusal behavior from language models via activation engineering (abliteration). Learn more at github.com/elder-plinius/OBLITERATUS.