---
language:
- eng
pipeline_tag: text-generation

Trained: Pretrain
Config file: 1.3B
Data: English News Dataset 2GB (177MB)
---
# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Pretrained GPT-NeoX model with 2.06GB English news dataset. Took about 2 hour and 10 minutes to reach 10,000 iterations. Trained on p3dn.24xlarge. 

## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->



- **Developed by:** Eunyoung Lee
- **Model type:** GPT-NeoX
- **Language(s) (NLP):** English