---
license: apache-2.0
datasets:
- opencsg/UltraFeedback-chinese
language:

- zh
base_model:
- opencsg/csg-wukong-smoltalk-chinese
---
* We apply DPO to ``opencsg/csg-wukong-2b-smoltalk-chinese``, using ``ultrafeedback-chinese-binarized-lowest`` as the DPO dataset.
* Train 2 epochs, learning rate=5e-6, batchsize=128
* This model's evaluation score is higher than that one trained on ``ultrafeedback-chinese-binarized``