Holo-3.1-4B-Coder-OBLITERATED

This model was abliterated using the failspy method via OBLITERATUS.

Detail Value
Base model josephmayo/Holo-3.1-4B-Coder
Method failspy
Source obliterate

How to Use

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Holo-3.1-4B-Coder-OBLITERATED")
tokenizer = AutoTokenizer.from_pretrained("Holo-3.1-4B-Coder-OBLITERATED")

prompt = "Hello, how are you?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

About OBLITERATUS

OBLITERATUS is an open-source tool for removing refusal behavior from language models via activation engineering (abliteration). Learn more at github.com/elder-plinius/OBLITERATUS.

Downloads last month
19
Safetensors
Model size
4B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for usermma/Holo-3.1-4B-Coder-abliterated-failspy

Finetuned
(1)
this model
Quantizations
2 models

Space using usermma/Holo-3.1-4B-Coder-abliterated-failspy 1