ybelkada
/

japanese-dummy-tokenizer

Inference Endpoints

Model card Files Files and versions Community

Younes Belkada commited on Apr 6, 2022

Commit

4e256ca

•

1 Parent(s): 2c7a271

add config

Files changed (1) hide show

japanese-dummy-tokenizer/config.json +5 -0

japanese-dummy-tokenizer/config.json ADDED Viewed

	@@ -0,0 +1,5 @@

+{
+    "_name_or_path": "ybelkada/japanese-dummy-tokenizer",
+    "vocab_size": 32000
+  }