| language: | |
| - id | |
| - en | |
| tags: | |
| - text generation | |
| - pytorch | |
| - causal-lm | |
| license: creativeml-openrail-m | |
| metrics: | |
| - perplexity | |
| pipeline_tag: text-generation | |
| # IndoChat-Tiny | |
| This model is a bilingual GPT2 model fine-tuned with instructions dataset (~100K English instructions and its ~100K Indonesian translation). | |
| The base model was a GPT2-Medium (345M params) which was pretrained with 75GB of Indonesian (99%) and English (1%) dataset. |