---
language: ru
license: apache-2.0
---

RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.

See its implementation, as well as the pretraining and finetuning code, at [https://github.com/yandex-research/RuLeanALBERT](https://github.com/yandex-research/RuLeanALBERT).