tohoku-nlp
/

bert-base-japanese

Inference Endpoints

Model card Files Files and versions Community

bert-base-japanese / tokenizer_config.json

Thomas Wolf

Add tokenizer configuration

0d83b25 over 3 years ago

raw history blame

No virus

104 Bytes

	{
	"do_lower_case": false,
	"subword_tokenizer_type": "wordpiece",
	"word_tokenizer_type": "mecab"
	}