tay-yozhik commited on
Commit
e7d29dc
1 Parent(s): a0b1e32

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -4,4 +4,20 @@ datasets:
4
  - tay-yozhik/SyntheticTexts
5
  language:
6
  - ru
7
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  - tay-yozhik/SyntheticTexts
5
  language:
6
  - ru
7
+ ---
8
+ # SyntheticRoBERTa
9
+
10
+ This is a pre-trained model of type [RoBERTa](https://arxiv.org/abs/1907.11692).
11
+ SyntheticRoBERTa is built on a dataset of texts in Russian, which were generated according to [the rules written in context-free grammar](https://github.com/GorbachevaTaisia/JSGF_generative_grammar).
12
+
13
+ # Evaluation
14
+
15
+ This model was evaluated on [RussianSuperGLUE tests](https://russiansuperglue.com/):
16
+ | Task | Result | Metrics |
17
+ |-------|----------|---------|
18
+ | LiDiRus | 0,0 | Matthews Correlation Coefficient |
19
+ | RCB | 0,091 / 0,158 | F1/Accuracy |
20
+ | PARus | 0,502 | Accuracy |
21
+ | TERRa | 0,487 | Accuracy |
22
+ | RUSSE | 0,587 | Accuracy |
23
+ | RWSD | 0,331 | Accuracy |