| license: mit | |
| This is a test DPO finetune of Microsoft phi-2 | |
| Two DPO datasets are used: | |
| Intel/orca_dpo_pairs | |
| argilla/ultrafeedback-binarized-preferences-cleaned | |
| Training was for 1 epoch as a qlora with Rank 64, Delta 128 | |
| license: mit | |
| This is a test DPO finetune of Microsoft phi-2 | |
| Two DPO datasets are used: | |
| Intel/orca_dpo_pairs | |
| argilla/ultrafeedback-binarized-preferences-cleaned | |
| Training was for 1 epoch as a qlora with Rank 64, Delta 128 | |