Mihai-Dan MAŞALA (25095)
commited on
Commit
•
7bd01ab
1
Parent(s):
364ef40
Update README
Browse files
README.md
CHANGED
@@ -69,33 +69,31 @@ Model | Dev | Test
|
|
69 |
-------|---------|----------
|
70 |
multilingual-BERT | 68.96 | 69.57
|
71 |
XLM-R-base | 71.26 | 71.71
|
72 |
-
|
73 |
RoBERT-small | 66.32 | 66.37
|
74 |
RoBERT-base | 70.89 | 71.61
|
75 |
RoBERT-large | 72.48 | 72.11
|
76 |
|
77 |
### Moldavian vs. Romanian Dialect and Cross-dialect Topic identification
|
78 |
|
79 |
-
We report results on [VarDial 2019](https://sites.google.com/view/vardial2019/campaign) Moldavian vs. Romanian Cross-dialect Topic identification Challenge, as Macro-averaged F1 score (in %)
|
80 |
|
81 |
Model | Dialect Classification | MD to RO | RO to MD
|
82 |
-
|
83 |
2-CNN + SVM | 93.40 | 65.09 | 75.21
|
84 |
Char+Word SVM | 96.20 | 69.08 | 81.93
|
85 |
BiGRU | 93.30 | 70.10 | 80.30
|
86 |
|
87 |
multilingual-BERT | 95.34 | 68.76 | 78.24
|
88 |
XLM-R-base | 96.28 | 69.93 | 8228
|
89 |
-
|
90 |
RoBERT-small | 95.67 | 69.01 | 80.40
|
91 |
RoBERT-base | 97.39 | 68.30 | 81.09
|
92 |
RoBERT-large | 97.78 | 69.91 | 83.65
|
93 |
|
94 |
### Diacritics Restoration
|
95 |
|
96 |
-
Challenge can be found [here](https://diacritics-challenge.speed.pub.ro/).
|
97 |
-
|
98 |
-
We report results on the official test set, as accuracies in %.
|
99 |
|
100 |
Model | word level | char level
|
101 |
-------|---------|----------
|
@@ -103,7 +101,7 @@ BiLSTM | 99.42 | -
|
|
103 |
CharCNN | 98.40 | 99.65
|
104 |
CharCNN + multilingual-BERT | 99.72 | 99.94
|
105 |
CharCNN + XLM-R-base | 99.76 | 99.95
|
106 |
-
CharCNN +
|
107 |
CharCNN + RoBERT-small | 99.73 | 99.94
|
108 |
CharCNN + RoBERT-base | 99.78 | 99.95
|
109 |
CharCNN + RoBERT-large | 99.76 | 99.95
|
69 |
-------|---------|----------
|
70 |
multilingual-BERT | 68.96 | 69.57
|
71 |
XLM-R-base | 71.26 | 71.71
|
72 |
+
BERT-base-ro | 70.49 | 71.02
|
73 |
RoBERT-small | 66.32 | 66.37
|
74 |
RoBERT-base | 70.89 | 71.61
|
75 |
RoBERT-large | 72.48 | 72.11
|
76 |
|
77 |
### Moldavian vs. Romanian Dialect and Cross-dialect Topic identification
|
78 |
|
79 |
+
We report results on [VarDial 2019](https://sites.google.com/view/vardial2019/campaign) Moldavian vs. Romanian Cross-dialect Topic identification Challenge, as Macro-averaged F1 score (in %).
|
80 |
|
81 |
Model | Dialect Classification | MD to RO | RO to MD
|
82 |
+
-------|---------|----------|----------|
|
83 |
2-CNN + SVM | 93.40 | 65.09 | 75.21
|
84 |
Char+Word SVM | 96.20 | 69.08 | 81.93
|
85 |
BiGRU | 93.30 | 70.10 | 80.30
|
86 |
|
87 |
multilingual-BERT | 95.34 | 68.76 | 78.24
|
88 |
XLM-R-base | 96.28 | 69.93 | 8228
|
89 |
+
BERT-base-ro | 96.20 | 69.93 | 78.79
|
90 |
RoBERT-small | 95.67 | 69.01 | 80.40
|
91 |
RoBERT-base | 97.39 | 68.30 | 81.09
|
92 |
RoBERT-large | 97.78 | 69.91 | 83.65
|
93 |
|
94 |
### Diacritics Restoration
|
95 |
|
96 |
+
Challenge can be found [here](https://diacritics-challenge.speed.pub.ro/). We report results on the official test set, as accuracies in %.
|
|
|
|
|
97 |
|
98 |
Model | word level | char level
|
99 |
-------|---------|----------
|
101 |
CharCNN | 98.40 | 99.65
|
102 |
CharCNN + multilingual-BERT | 99.72 | 99.94
|
103 |
CharCNN + XLM-R-base | 99.76 | 99.95
|
104 |
+
CharCNN + BERT-base-ro | 99.79 | 99.95
|
105 |
CharCNN + RoBERT-small | 99.73 | 99.94
|
106 |
CharCNN + RoBERT-base | 99.78 | 99.95
|
107 |
CharCNN + RoBERT-large | 99.76 | 99.95
|