This is DPO improved version of cloudyu/Mixtral_7Bx4_MOE_24B
DPO Trainer
Metrics improved by DPO
Files info