tianyuz commited on
Commit
eb4f161
1 Parent(s): 58026e8
Files changed (2) hide show
  1. README.md +18 -0
  2. rinna.png +0 -0
README.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ # japanese-gpt2-medium
3
+
4
+ ![rinna-icon](./rinna.png)
5
+
6
+ This repository provides a medium-sized Japanese GPT-2 model trained on [Japanese CC-100](http://data.statmt.org/cc-100/ja.txt.xz). The model is provided by [rinna](https://corp.rinna.co.jp/).
7
+
8
+ # Use the model
9
+
10
+ *NOTE:* Use `T5Tokenizer` to initiate the tokenizer if AutoTokenizer encounters any errors.
11
+
12
+ ~~~~
13
+ from transformers import T5Tokenizer, AutoModelForCausalLM
14
+
15
+ tokenizer = T5Tokenizer.from_pretrained("rinna/japanese-gpt2-medium")
16
+
17
+ model = AutoModelForCausalLM.from_pretrained("rinna/japanese-gpt2-medium")
18
+ ~~~~
rinna.png ADDED