---
tags:
- yi
- moe
- DPO
license: apache-2.0
---



 * [This is DPO improved version of cloudyu/Yi-34Bx2-MoE-60B](https://huggingface.co/cloudyu/Yi-34Bx2-MoE-60B)

 * [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer)

 * metrics not test!