Edit model card

This model was aligned using DPO with a 1e-5 learning rate for 4000 steps

Downloads last month
2
Safetensors
Model size
582M params
Tensor type
F32
·
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.