Update README.md
Browse files
README.md
CHANGED
@@ -4,9 +4,10 @@ language:
|
|
4 |
- en
|
5 |
---
|
6 |
|
7 |
-
GPT-J (with value head weights) trained on HH with PPO following [@reciprocated's](https://github.com/reciprocated) `trlx` example https://github.com/CarperAI/trlx/blob/2f90ba0ecd640ae18cd62adb5e934a4b779f534b/examples/hh/ppo_hh.py
|
8 |
|
9 |
-
|
|
|
10 |
|
11 |
Usage:
|
12 |
|
|
|
4 |
- en
|
5 |
---
|
6 |
|
7 |
+
GPT-J (with value head weights) trained on HH with PPO following [@reciprocated's](https://github.com/reciprocated) `trlx` example [here](https://github.com/CarperAI/trlx/blob/2f90ba0ecd640ae18cd62adb5e934a4b779f534b/examples/hh/ppo_hh.py)
|
8 |
|
9 |
+
- Dataset: [Dahoas/full-hh-rlhf](https://huggingface.co/datasets/Dahoas/full-hh-rlhf)
|
10 |
+
- Logs: https://wandb.ai/jon-tow/trlx/reports/hh-gpt-j--VmlldzozODE1NjAw
|
11 |
|
12 |
Usage:
|
13 |
|