Undi95
/

Unholy-8B-DPO-OAS

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is a TEST It was made with a custom Orthogonal Activation Steering script I shared HERE : https://huggingface.co/posts/Undi95/318385306588047#663609dc1818d469455c0222 (but be ready to put your hands in some fucked up code bro)

Step :

First I took Unholy (FT of L3 on Toxic Dataset)
Then I trained 2 epoch of DPO on top, with the SAME dataset (https://wandb.ai/undis95/Uncensored8BDPO/runs/3rg4rz13/workspace?nw=nwuserundis95)
Finally, I used OAS on top, bruteforcing the layer to get the best one (I don't really understand all of this, sorry)

Downloads last month: 24

Safetensors

Model size

8.03B params

Tensor type

F32

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Undi95/Unholy-8B-DPO-OAS

Merges

Quantizations

1 model