---
license: cc-by-nc-4.0
datasets:
- HuggingFaceH4/ultrafeedback_binarized
language:
- en
---

Trained for one epoch on ultrafeedback_binarized using cDPO. Evaluation pending.

Some initial benchmark results:
|  Task   |Version| Metric |Value |   |Stderr|
|---------|------:|--------|-----:|---|-----:|
|hellaswag|      0|acc     |0.6621|±  |0.0047|
|         |       |acc_norm|0.8525|±  |0.0035|
|arc_challenge|      0|acc     |0.6348|±  |0.0141|
|             |       |acc_norm|0.6698|±  |0.0137|
|winogrande|      0|acc   |0.7861|±  |0.0115|
|gsm8k|      0|acc   |0.5694|±  |0.0136|