IndoGPT Model

IndoGPT is a state-of-the-art language model for Indonesian based on the GPT model. The pretrained model is trained using the GPT training objective.

All Pre-trained Models

Model #params Training data
indobenchmark/indogpt 117M Indo4B-Plus (23.79 GB of text)

Authors

IndoGPT was trained and evaluated by Samuel Cahyawijaya*, Genta Indra Winata*, Bryan Wilie*, Karissa Vincentio*, Xiaohong Li*, Adhiguna Kuncoro*, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung

Citation

If you use our work, please cite:

@article{cahyawijaya2021indonlg,
  title={IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation},
  author={Cahyawijaya, Samuel and Winata, Genta Indra and Wilie, Bryan and Vincentio, Karissa and Li, Xiaohong and Kuncoro, Adhiguna and Ruder, Sebastian and Lim, Zhi Yuan and Bahar, Syafri and Khodra, Masayu Leylia and others},
  journal={arXiv preprint arXiv:2104.08200},
  year={2021}
}
Downloads last month
65
Hosted inference API
Text Generation

Inference API has been turned off for this model.