Venus_DPO_50 / README.md
cloudyu's picture
Create README.md
2455ffd verified
|
raw
history blame
No virus
239 Bytes
---
license: mit
---
* [This is DPO improved version of cloudyu/Mixtral_11Bx2_MoE_19B](https://huggingface.co/cloudyu/Mixtral_11Bx2_MoE_19B)
* [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer)
* metrics not test!