3d0181b 5c2d310 3d0181b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
--- tags: - yi - moe - DPO license: apache-2.0 --- * [This is DPO improved version of cloudyu/Yi-34Bx2-MoE-60B](https://huggingface.co/cloudyu/Yi-34Bx2-MoE-60B) * [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer) * metrics not test!
