---
license: cc-by-4.0
---
# experiment

Finetune of Jon Durbin's Bagel DPO 7B with the Hercules 3.0 Dataset