Commit
•
5b0388c
1
Parent(s):
63d9f33
Update model card
Browse files
README.md
CHANGED
|
@@ -1,6 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# GPT Neo 1.3B
|
| 2 |
|
| 3 |
-
The GPT Neo model is pretrained on the The Pile dataset: an 825GiB English text corpus targeted at training large-scale language models.
|
| 4 |
It is an open source replication of OpenAI's GPT-3 model and is released in several checkpoints: the 1.3B and 2.7B variants.
|
| 5 |
|
| 6 |
It was released on EleutherAI's [GitHub page](https://github.com/EleutherAI/gpt-neo) the 21st of March 2021.
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language: en
|
| 3 |
+
datasets:
|
| 4 |
+
- The Pile
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
# GPT Neo 1.3B
|
| 8 |
|
| 9 |
+
The GPT Neo model is pretrained on the [The Pile](https://github.com/EleutherAI/the-pile) dataset: an 825GiB English text corpus targeted at training large-scale language models.
|
| 10 |
It is an open source replication of OpenAI's GPT-3 model and is released in several checkpoints: the 1.3B and 2.7B variants.
|
| 11 |
|
| 12 |
It was released on EleutherAI's [GitHub page](https://github.com/EleutherAI/gpt-neo) the 21st of March 2021.
|