rinna
/

japanese-gpt2-medium

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

tianyuz commited on Apr 6, 2021

Commit

390d37c

•

1 Parent(s): 9b9b353

update readme

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -7,12 +7,12 @@ This repository provides a medium-sized Japanese GPT-2 model trained on [Japanes
 # Use the model
-*NOTE:* Use `T5Tokenizer` to initiate the tokenizer with argument `extra_ids=0`.
 ~~~~
 from transformers import T5Tokenizer, AutoModelForCausalLM
-tokenizer = T5Tokenizer.from_pretrained("rinna/japanese-gpt2-medium", extra_ids=0)
 model = AutoModelForCausalLM.from_pretrained("rinna/japanese-gpt2-medium")
 ~~~~

 # Use the model
+*NOTE:* Use `T5Tokenizer` to initiate the tokenizer.
 ~~~~
 from transformers import T5Tokenizer, AutoModelForCausalLM
+tokenizer = T5Tokenizer.from_pretrained("rinna/japanese-gpt2-medium")
 model = AutoModelForCausalLM.from_pretrained("rinna/japanese-gpt2-medium")
 ~~~~