File size: 442 Bytes
76f2dd6
 
 
9a08ef5
 
 
 
581ddd2
02e2f29
dd5b509
1
2
3
4
5
6
7
8
9
10
---
language: ru
license: apache-2.0
---

RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.

Read more about the model in [this blog post](https://habr.com/ru/company/yandex/blog/688234/) (in Russian).

See its implementation, as well as the pretraining and finetuning code, at [https://github.com/yandex-research/RuLeanALBERT](https://github.com/yandex-research/RuLeanALBERT).