lomahony commited on
Commit
136f952
1 Parent(s): a0cdf47

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -10,11 +10,14 @@ datasets:
10
  - Anthropic/hh-rlhf
11
  ---
12
 
13
- [Pythia-70m](https://huggingface.co/EleutherAI/pythia-70m) supervised finetuned with helpful subset of [Anthropic-hh-rlhf dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf) for 1 epoch.
14
 
15
- Checkpoints are also included.
 
 
16
 
17
  [wandb log](https://wandb.ai/lauraomahony999/sft-pythia/runs/3w7e3zmd)
18
 
19
- See [Pythia-70m](https://huggingface.co/EleutherAI/pythia-70m) for model details [(paper)](https://arxiv.org/abs/2101.00027).
 
20
 
 
10
  - Anthropic/hh-rlhf
11
  ---
12
 
13
+ [Pythia-70m](https://huggingface.co/EleutherAI/pythia-410m) supervised finetuned with helpful subset of [Anthropic-hh-rlhf dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf) for 1 epoch.
14
 
15
+ Checkpoints are also uploaded.
16
+
17
+ Fully reproducible finetuning code is available on [GitHub](https://github.com/lomahony/trlx-pythia/tree/main)
18
 
19
  [wandb log](https://wandb.ai/lauraomahony999/sft-pythia/runs/3w7e3zmd)
20
 
21
+ See [Pythia-70m](https://huggingface.co/EleutherAI/pythia-410m) for model details [(paper)](https://arxiv.org/abs/2101.00027).
22
+
23