RuLeanALBERT / README.md
mryab's picture
Update README.md
581ddd2
metadata
language: ru
license: apache-2.0

RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.

Read more about the model in this blog post (in Russian).

See its implementation, as well as the pretraining and finetuning code, at https://github.com/yandex-research/RuLeanALBERT.