---
license: apache-2.0
---

This model is a fine-tuned version of Zephyr-7B using IPO on the HuggingFaceH4/ultrafeedback_binarized dataset.