---
license: mit
---
take the mistral inst-v02 model and run dpo on it, 6000 epoch.
take the mistral inst-v02 model and run dpo on it, 6000 epoch.
take the mistral inst-v02 model and run dpo on it, 6000 epoch.
take the mistral inst-v02 model and run dpo on it, 6000 epoch.
take the mistral inst-v02 model and run dpo on it, 6000 epoch.