|
--- |
|
license: apache-2.0 |
|
language: ko |
|
tags: |
|
- fill-mask |
|
- korean |
|
- lassl |
|
mask_token: "[MASK]" |
|
widget: |
|
- text: 대한민국의 수도는 [MASK] 입니다. |
|
--- |
|
|
|
# LASSL bert-ko-small |
|
## How to use |
|
```python |
|
from transformers import AutoModel, AutoTokenizer |
|
model = AutoModel.from_pretrained("lassl/bert-ko-small") |
|
tokenizer = AutoTokenizer.from_pretrained("lassl/bert-ko-small") |
|
``` |
|
|
|
## Evaluation |
|
Evaulation results will be released soon. |
|
|
|
## Corpora |
|
This model was trained from 702,437 examples (whose have 3,596,465,664 tokens). 702,437 examples are extracted from below corpora. If you want to get information for training, you should see `config.json`. |
|
|
|
```bash |
|
corpora/ |
|
├── [707M] kowiki_latest.txt |
|
├── [ 26M] modu_dialogue_v1.2.txt |
|
├── [1.3G] modu_news_v1.1.txt |
|
├── [9.7G] modu_news_v2.0.txt |
|
├── [ 15M] modu_np_v1.1.txt |
|
├── [1008M] modu_spoken_v1.2.txt |
|
├── [6.5G] modu_written_v1.0.txt |
|
└── [413M] petition.txt |
|
``` |
|
|
