cahya commited on
Commit
961ce37
1 Parent(s): 3039634

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - id
4
+ - en
5
+ tags:
6
+ - text generation
7
+ - pytorch
8
+ - causal-lm
9
+ license: creativeml-openrail-m
10
+ metrics:
11
+ - perplexity
12
+ pipeline_tag: text-generation
13
+ ---
14
+
15
+ # IndoChat-Tiny
16
+
17
+ This model is a bilingual GPT2 model fine-tuned with instructions dataset (~100K English instructions and its ~100K Indonesian translation).
18
+ The base model was a GPT2-Medium (345M params) which was pretrained with 75GB of Indonesian (99%) and English (1%) dataset.