File size: 440 Bytes
961ce37
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
---
language:
- id
- en
tags:
- text generation
- pytorch
- causal-lm
license: creativeml-openrail-m
metrics:
- perplexity
pipeline_tag: text-generation
---

# IndoChat-Tiny

This model is a bilingual GPT2 model fine-tuned with instructions dataset (~100K English instructions and its ~100K Indonesian translation). 
The base model was a GPT2-Medium (345M params) which was pretrained with 75GB of Indonesian (99%) and English (1%) dataset.