Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
lighttransport
/
japanese-tokenizer-cc100
like
2
Follow
Light Transport Entertainment Inc.
2
Japanese
License:
mit
Model card
Files
Files and versions
Community
main
japanese-tokenizer-cc100
2 contributors
History:
4 commits
syoyo
Update README.md
b914e30
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
598 Bytes
Update README.md
over 1 year ago
tokenizer-cc100-ja.json
Safe
1.2 MB
Initial.
over 1 year ago
train_jp_tokenizer.py
Safe
881 Bytes
Initial.
over 1 year ago
