Albert base model for Korean

70GB Korean text dataset and 42000 lower-cased subwords are used
Check the model performance and other language models for Korean in github

from transformers import BertTokenizerFast, AlbertModel

tokenizer_albert = BertTokenizerFast.from_pretrained("kykim/albert-kor-base")
model_albert = AlbertModel.from_pretrained("kykim/albert-kor-base")

Downloads last month: 2,677

Inference Providers NEW

Fill-Mask

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kykim/albert-kor-base

Finetunes

1 model