---
license: mit
datasets:
- unalignment/toxic-dpo-v0.2
- Anthropic/hh-rlhf
- stanfordnlp/imdb
language:
- en
---

We train a collection of models under RLHF on the above datasets. We use DPO for hh-rlhf and unalignment, and train a PPO on completing IMDB prefixes with positive sentiment.