metadata
license: cc-by-nc-4.0
datasets:
- HuggingFaceH4/ultrafeedback_binarized
language:
- en
Trained for one epoch on ultrafeedback_binarized using cDPO. Evaluation pending.
Some initial benchmark results:
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| hellaswag | 0 | acc | 0.6621 | ± | 0.0047 |
| acc_norm | 0.8525 | ± | 0.0035 | ||
| arc_challenge | 0 | acc | 0.6348 | ± | 0.0141 |
| acc_norm | 0.6698 | ± | 0.0137 | ||
| winogrande | 0 | acc | 0.7861 | ± | 0.0115 |
| gsm8k | 0 | acc | 0.5694 | ± | 0.0136 |