Update README.md
Browse files
README.md
CHANGED
@@ -7,13 +7,13 @@ pip install torch numpy transformers datasets tiktoken wandb tqdm
|
|
7 |
|
8 |
Dependencies:
|
9 |
|
10 |
-
- [pytorch](https://pytorch.org)
|
11 |
-
- [numpy](https://numpy.org/install/)
|
12 |
-
- `transformers` for huggingface transformers
|
13 |
-
- `datasets` for huggingface datasets
|
14 |
-
- `tiktoken` for OpenAI's fast BPE code
|
15 |
-
- `wandb` for optional logging
|
16 |
-
- `tqdm` for progress bars
|
17 |
|
18 |
## quick start
|
19 |
|
|
|
7 |
|
8 |
Dependencies:
|
9 |
|
10 |
+
- [pytorch](https://pytorch.org)
|
11 |
+
- [numpy](https://numpy.org/install/)
|
12 |
+
- `transformers` for huggingface transformers (to load GPT-2 checkpoints)
|
13 |
+
- `datasets` for huggingface datasets (if you want to download + preprocess OpenWebText)
|
14 |
+
- `tiktoken` for OpenAI's fast BPE code
|
15 |
+
- `wandb` for optional logging
|
16 |
+
- `tqdm` for progress bars
|
17 |
|
18 |
## quick start
|
19 |
|