sunny3 commited on
Commit
9e0e3c7
2 Parent(s): 050e235 defa15e

Merge branch 'main' of https://huggingface.co/sagteam/rubert-base-cased-mcn into main

Browse files
Files changed (1) hide show
  1. README.md +3 -6
README.md CHANGED
@@ -3,10 +3,7 @@ language:
3
  - ru
4
  ---
5
 
6
- # rubert-base-cased
7
 
8
- RuBERT \(Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on the Russian part of Wikipedia and news data. We used this training data to build a vocabulary of Russian subtokens and took a multilingual version of BERT‑base as an initialization for RuBERT\[1\].
9
-
10
- 08.11.2021: upload model with MLM and NSP heads
11
-
12
- \[1\]: Kuratov, Y., Arkhipov, M. \(2019\). Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language. arXiv preprint [arXiv:1905.07213](https://arxiv.org/abs/1905.07213).
 
3
  - ru
4
  ---
5
 
6
+ # rubert-base-cased-mcn
7
 
8
+ Normalization model, based on rubert, for linking phrases to their MedDRA concepts.
9
+ See the Demo.ipynb on [our repo](https://github.com/sunny3/MedNorm) to see how it works.