KoichiYasuoka commited on
Commit
972476c
1 Parent(s): 14628d8

use BertTokenizerFast

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ widget:
16
 
17
  ## Model Description
18
 
19
- This is a BERT model pre-trained on Japanese Wikipedia texts, derived from [bert-base-japanese-char-v2](https://huggingface.co/cl-tohoku/bert-base-japanese-char-v2). Character-embeddings are enhanced to include all 常用漢字/人名用漢字 characters. You can fine-tune `bert-base-japanese-char-extended` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/bert-base-japanese-upos), dependency-parsing, and so on.
20
 
21
  ## How to Use
22
 
16
 
17
  ## Model Description
18
 
19
+ This is a BERT model pre-trained on Japanese Wikipedia texts, derived from [bert-base-japanese-char-v2](https://huggingface.co/cl-tohoku/bert-base-japanese-char-v2). Character-embeddings are enhanced to include all 常用漢字/人名用漢字 characters using [BertTokenizerFast](https://huggingface.co/transformers/model_doc/bert.html#berttokenizerfast). You can fine-tune `bert-base-japanese-char-extended` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/bert-base-japanese-upos), dependency-parsing, and so on.
20
 
21
  ## How to Use
22