zephyr-7b-dpo-0k-15k-i1
This model is a fine-tuned version of DUAL-GPO/zephyr-7b-dpo-new-lora-v1-merged on the HuggingFaceH4/ultrafeedback_binarized dataset.
- Downloads last month
- 0
This model is a fine-tuned version of DUAL-GPO/zephyr-7b-dpo-new-lora-v1-merged on the HuggingFaceH4/ultrafeedback_binarized dataset.