Commit
•
e7d29dc
1
Parent(s):
a0b1e32
Update README.md
Browse files
README.md
CHANGED
@@ -4,4 +4,20 @@ datasets:
|
|
4 |
- tay-yozhik/SyntheticTexts
|
5 |
language:
|
6 |
- ru
|
7 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
- tay-yozhik/SyntheticTexts
|
5 |
language:
|
6 |
- ru
|
7 |
+
---
|
8 |
+
# SyntheticRoBERTa
|
9 |
+
|
10 |
+
This is a pre-trained model of type [RoBERTa](https://arxiv.org/abs/1907.11692).
|
11 |
+
SyntheticRoBERTa is built on a dataset of texts in Russian, which were generated according to [the rules written in context-free grammar](https://github.com/GorbachevaTaisia/JSGF_generative_grammar).
|
12 |
+
|
13 |
+
# Evaluation
|
14 |
+
|
15 |
+
This model was evaluated on [RussianSuperGLUE tests](https://russiansuperglue.com/):
|
16 |
+
| Task | Result | Metrics |
|
17 |
+
|-------|----------|---------|
|
18 |
+
| LiDiRus | 0,0 | Matthews Correlation Coefficient |
|
19 |
+
| RCB | 0,091 / 0,158 | F1/Accuracy |
|
20 |
+
| PARus | 0,502 | Accuracy |
|
21 |
+
| TERRa | 0,487 | Accuracy |
|
22 |
+
| RUSSE | 0,587 | Accuracy |
|
23 |
+
| RWSD | 0,331 | Accuracy |
|