lomahony commited on
Commit
57b7445
1 Parent(s): 38f529d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -10,11 +10,13 @@ datasets:
10
  - Anthropic/hh-rlhf
11
  ---
12
 
13
- [Pythia-70m](https://huggingface.co/EleutherAI/pythia-70m) supervised finetuned with helpful subset of [Anthropic-hh-rlhf dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf) for 1 epoch.
14
 
15
- Checkpoints are also included.
16
 
17
- [wandb log](https://wandb.ai/lauraomahony999/sft-pythia/runs/3w7e3zmd)
18
 
19
- See [Pythia-70m](https://huggingface.co/EleutherAI/pythia-70m) for model details [(paper)](https://arxiv.org/abs/2101.00027).
 
 
20
 
 
10
  - Anthropic/hh-rlhf
11
  ---
12
 
13
+ [Pythia-70m](https://huggingface.co/EleutherAI/pythia-410m) supervised finetuned with helpful subset of [Anthropic-hh-rlhf dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf) for 1 epoch.
14
 
15
+ Checkpoints are also uploaded.
16
 
17
+ Fully reproducible finetuning code is available on [GitHub](https://github.com/lomahony/trlx-pythia/tree/main)
18
 
19
+ [wandb log](https://wandb.ai/lauraomahony999/sft-pythia/runs/quq2097z)
20
+
21
+ See [Pythia-70m](https://huggingface.co/EleutherAI/pythia-410m) for model details [(paper)](https://arxiv.org/abs/2101.00027).
22