Update README.md
Browse files
README.md
CHANGED
@@ -9,8 +9,8 @@ Dependencies:
|
|
9 |
|
10 |
- [pytorch](https://pytorch.org)
|
11 |
- [numpy](https://numpy.org/install/)
|
12 |
-
- `transformers` for huggingface transformers
|
13 |
-
- `datasets` for huggingface datasets (
|
14 |
- `tiktoken` for OpenAI's fast BPE code
|
15 |
- `wandb` for optional logging
|
16 |
- `tqdm` for progress bars
|
|
|
9 |
|
10 |
- [pytorch](https://pytorch.org)
|
11 |
- [numpy](https://numpy.org/install/)
|
12 |
+
- `transformers` for huggingface transformers
|
13 |
+
- `datasets` for huggingface datasets (preprocess OpenWebText test and validation bin)
|
14 |
- `tiktoken` for OpenAI's fast BPE code
|
15 |
- `wandb` for optional logging
|
16 |
- `tqdm` for progress bars
|