metadata

language: ko
tags:
  - korean
  - lassl
mask_token: '[MASK]'
widget:
  - text: 대한민국의 수도는 [MASK] 입니다.

LASSL roberta-ko-small

Pretrained roberta-ko-small on korean language was trained by LASSL framework. Below performance was evaluated at 2021/12/15.

nsmc	klue_nli	klue_sts	korquadv1	klue_mrc	avg
87.8846	66.3086	83.8353	83.1780	42.4585	72.7330

How to use

from transformers import AutoModel, AutoTokenizer
model = AutoModel.from_pretrained("lassl/roberta-ko-small")
tokenizer = AutoTokenizer.from_pretrained("lassl/roberta-ko-small")