ruBert-base / README.md
ai-forever's picture
Update README.md
9ed3880
metadata
language:
  - ru
tags:
  - PyTorch
  - Transformers
  - bert
  - exbert
pipeline_tag: fill-mask
thumbnail: https://github.com/sberbank-ai/model-zoo
license: apache-2.0

ruBert-large

Model was trained by SberDevices team.

  • Task: mask filling
  • Type: encoder
  • Tokenizer: bpe
  • Dict size: 120 138
  • Num Parameters: 178 M
  • Training Data Volume 30 GB