---
language:
- vi
pipeline_tag: text-generation

Trained: Pretrain
Config file: 19M 
Data: Viet 10% (177MB)
---
# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Pretrained GPT-NeoX model with 177MB vietnamese dataset. Took about 2 hour and 20 minutes to reach 4,000 iterations. Trained on p3.16xlarge. 

## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->



- **Developed by:** Eunyoung Lee
- **Model type:** GPT-NeoX
- **Language(s) (NLP):** Vietnamese