lomahony commited on
Commit
fe81eb3
1 Parent(s): 599729f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -10,15 +10,15 @@ datasets:
10
  - Anthropic/hh-rlhf
11
  ---
12
 
13
- [Pythia-70m](https://huggingface.co/EleutherAI/pythia-410m) supervised finetuned using TRLx library with the helpful subset of [Anthropic-hh-rlhf dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf) for 1 epoch.
14
 
15
  Checkpoints are also uploaded.
16
 
17
  Fully reproducible finetuning code is available on [GitHub](https://github.com/lomahony/trlx-pythia/tree/main)
18
 
19
- [wandb log](https://wandb.ai/lauraomahony999/sft-pythia/runs/3w7e3zmd)
20
 
21
- See [Pythia-70m](https://huggingface.co/EleutherAI/pythia-410m) for model details [(paper)](https://arxiv.org/abs/2101.00027).
22
 
23
  hf (pretrained=lomahony/pythia-70m-helpful-sft), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: 16
24
  | Tasks |Version|Filter|n-shot| Metric | Value | | Stderr |
 
10
  - Anthropic/hh-rlhf
11
  ---
12
 
13
+ [Pythia-70m](https://huggingface.co/EleutherAI/pythia-70m) supervised finetuned using TRLx library with the helpful subset of [Anthropic-hh-rlhf dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf) for 1 epoch.
14
 
15
  Checkpoints are also uploaded.
16
 
17
  Fully reproducible finetuning code is available on [GitHub](https://github.com/lomahony/trlx-pythia/tree/main)
18
 
19
+ [wandb log](https://wandb.ai/lauraomahony999/pythia-sft/runs/3w7e3zmd)
20
 
21
+ See [Pythia-70m](https://huggingface.co/EleutherAI/pythia-70m) for model details [(paper)](https://arxiv.org/abs/2101.00027).
22
 
23
  hf (pretrained=lomahony/pythia-70m-helpful-sft), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: 16
24
  | Tasks |Version|Filter|n-shot| Metric | Value | | Stderr |