Edit model card

Experimental model doing a DPO training on top of Kunoichi-DPO-v2-7b, i.e. double-DPO.

Not suitable for any audience.

Downloads last month
68
Safetensors
Model size
7.24B params
Tensor type
BF16
·
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.