Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ybelkada
/
japanese-dummy-tokenizer
like
1
Transformers
snow_simplified_japanese_corpus
English
Japanese
japanese
tokenizer
Inference Endpoints
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
japanese-dummy-tokenizer
/
tokenizer.py
Commit History
add python file
f2449c8
Younes Belkada
commited on
Apr 6, 2022
Add tokenizer file
f342985
Younes Belkada
commited on
Apr 6, 2022
