line-corporation
/

line-distilbert-base-japanese

Model card Files Files and versions Community

line-distilbert-base-japanese / distilbert_japanese_tokenizer.py

Commit History

Allow only unidic_lite

1c89263

kajyuuen commited on Mar 22, 2023

Improve tokenizers (#1)

1220bcd

kajyuuen commited on Mar 22, 2023

Initial commit

a7345ac

kajyuuen commited on Mar 10, 2023