## Model description

It is a monolingual transformers model pretrained on a large corpus of Hindi data in a self-supervised fashion.