Edit model card

This model was aligned using DPO with a 1e-5 learning rate for 4000 steps

Downloads last month
9
Safetensors
Model size
582M params
Tensor type
F32
·