KoichiYasuoka
commited on
Commit
•
972476c
1
Parent(s):
14628d8
use BertTokenizerFast
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ widget:
|
|
16 |
|
17 |
## Model Description
|
18 |
|
19 |
-
This is a BERT model pre-trained on Japanese Wikipedia texts, derived from [bert-base-japanese-char-v2](https://huggingface.co/cl-tohoku/bert-base-japanese-char-v2). Character-embeddings are enhanced to include all 常用漢字/人名用漢字 characters. You can fine-tune `bert-base-japanese-char-extended` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/bert-base-japanese-upos), dependency-parsing, and so on.
|
20 |
|
21 |
## How to Use
|
22 |
|
|
|
16 |
|
17 |
## Model Description
|
18 |
|
19 |
+
This is a BERT model pre-trained on Japanese Wikipedia texts, derived from [bert-base-japanese-char-v2](https://huggingface.co/cl-tohoku/bert-base-japanese-char-v2). Character-embeddings are enhanced to include all 常用漢字/人名用漢字 characters using [BertTokenizerFast](https://huggingface.co/transformers/model_doc/bert.html#berttokenizerfast). You can fine-tune `bert-base-japanese-char-extended` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/bert-base-japanese-upos), dependency-parsing, and so on.
|
20 |
|
21 |
## How to Use
|
22 |
|