|
---
|
|
license: apache-2.0
|
|
language: ko
|
|
tags:
|
|
- fill-mask
|
|
- korean
|
|
- lassl
|
|
mask_token: "[MASK]"
|
|
widget:
|
|
- text: 대한민국의 수도는 [MASK] 입니다.
|
|
---
|
|
|
|
# LASSL bert-ko-base
|
|
## How to use
|
|
```python
|
|
from transformers import AutoModel, AutoTokenizer
|
|
model = AutoModel.from_pretrained("lassl/bert-ko-base")
|
|
tokenizer = AutoTokenizer.from_pretrained("lassl/bert-ko-base")
|
|
```
|
|
|
|
## Evaluation
|
|
Evaulation results will be released soon.
|
|
|
|
## Corpora
|
|
This model was trained from 702,437 examples (whose have 3,596,465,664 tokens). 702,437 examples are extracted from below corpora. If you want to get information for training, you should see `config.json`.
|
|
|
|
```bash
|
|
corpora/
|
|
├── [707M] kowiki_latest.txt
|
|
├── [ 26M] modu_dialogue_v1.2.txt
|
|
├── [1.3G] modu_news_v1.1.txt
|
|
├── [9.7G] modu_news_v2.0.txt
|
|
├── [ 15M] modu_np_v1.1.txt
|
|
├── [1008M] modu_spoken_v1.2.txt
|
|
├── [6.5G] modu_written_v1.0.txt
|
|
└── [413M] petition.txt
|
|
```
|
|
|
