Hugging Face's logo

sismetanin
/
sbert-ru-sentiment-krnd

Text Classification
Transformers
PyTorch
JAX
Russian
bert
sentiment analysis
Russian
SBERT-Large
Inference Endpoints
Model card Files Community
1
sismetanin commited on
Commit
c2ef661
•
1 Parent(s): 1a396eb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +261 -0
README.md ADDED
@@ -0,0 +1,261 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ <table>
3
+ <thead>
4
+ <tr>
5
+ <th rowspan="4">Model</th>
6
+ <th rowspan="4">Score<br></th>
7
+ <th rowspan="4">Rank</th>
8
+ <th colspan="12">Dataset</th>
9
+ </tr>
10
+ <tr>
11
+ <td colspan="6">SentiRuEval-2016<br></td>
12
+ <td colspan="2" rowspan="2">RuSentiment</td>
13
+ <td rowspan="2">KRND</td>
14
+ <td rowspan="2">LINIS Crowd</td>
15
+ <td rowspan="2">RuTweetCorp</td>
16
+ <td rowspan="2">RuReviews</td>
17
+ </tr>
18
+ <tr>
19
+ <td colspan="3">TC</td>
20
+ <td colspan="3">Banks</td>
21
+ </tr>
22
+ <tr>
23
+ <td>micro F<sub>1</sub></td>
24
+ <td>macro F<sub>1</sub></td>
25
+ <td>F<sub>1</sub></td>
26
+ <td>micro F<sub>1</sub></td>
27
+ <td>macro F<sub>1</sub></td>
28
+ <td>F<sub>1</sub></td>
29
+ <td>wighted F<sub>1</sub></td>
30
+ <td>F<sub>1</sub></td>
31
+ <td>F<sub>1</sub></td>
32
+ <td>F<sub>1</sub></td>
33
+ <td>F<sub>1</sub></td>
34
+ <td>F<sub>1</sub></td>
35
+ </tr>
36
+ </thead>
37
+ <tbody>
38
+ <tr>
39
+ <td>SOTA</td>
40
+ <td>n/s</td>
41
+ <td></td>
42
+ <td>76.71</td>
43
+ <td>66.40</td>
44
+ <td>70.68</td>
45
+ <td>67.51</td>
46
+ <td>69.53</td>
47
+ <td>74.06</td>
48
+ <td>78.50</td>
49
+ <td>n/s</td>
50
+ <td>73.63</td>
51
+ <td>60.51</td>
52
+ <td>83.68</td>
53
+ <td>77.44</td>
54
+ </tr>
55
+ <tr>
56
+ <td>XLM-RoBERTa-Large</td>
57
+ <td>76.37</td>
58
+ <td>1</td>
59
+ <td>82.26</td>
60
+ <td>76.36</td>
61
+ <td>79.42</td>
62
+ <td>76.35</td>
63
+ <td>76.08</td>
64
+ <td>80.89</td>
65
+ <td>78.31</td>
66
+ <td>75.27</td>
67
+ <td>75.17</td>
68
+ <td>60.03</td>
69
+ <td>88.91</td>
70
+ <td>78.81</td>
71
+ </tr>
72
+ <tr>
73
+ <td>SBERT-Large</td>
74
+ <td>75.43</td>
75
+ <td>2</td>
76
+ <td>78.40</td>
77
+ <td>71.36</td>
78
+ <td>75.14</td>
79
+ <td>72.39</td>
80
+ <td>71.87</td>
81
+ <td>77.72</td>
82
+ <td>78.58</td>
83
+ <td>75.85</td>
84
+ <td>74.20</td>
85
+ <td>60.64</td>
86
+ <td>88.66</td>
87
+ <td>77.41</td>
88
+ </tr>
89
+ <tr>
90
+ <td>MBARTRuSumGazeta</td>
91
+ <td>74.70</td>
92
+ <td>3</td>
93
+ <td>76.06</td>
94
+ <td>68.95</td>
95
+ <td>73.04</td>
96
+ <td>72.34</td>
97
+ <td>71.93</td>
98
+ <td>77.83</td>
99
+ <td>76.71</td>
100
+ <td>73.56</td>
101
+ <td>74.18</td>
102
+ <td>60.54</td>
103
+ <td>87.22</td>
104
+ <td>77.51</td>
105
+ </tr>
106
+ <tr>
107
+ <td>Conversational RuBERT</td>
108
+ <td>74.44</td>
109
+ <td>4</td>
110
+ <td>76.69</td>
111
+ <td>69.09</td>
112
+ <td>73.11</td>
113
+ <td>69.44</td>
114
+ <td>68.68</td>
115
+ <td>75.56</td>
116
+ <td>77.31</td>
117
+ <td>74.40</td>
118
+ <td>73.10</td>
119
+ <td>59.95</td>
120
+ <td>87.86</td>
121
+ <td>77.78</td>
122
+ </tr>
123
+ <tr>
124
+ <td>LaBSE</td>
125
+ <td>74.11</td>
126
+ <td>5</td>
127
+ <td>77.00</td>
128
+ <td>69.19</td>
129
+ <td>73.55</td>
130
+ <td>70.34</td>
131
+ <td>69.83</td>
132
+ <td>76.38</td>
133
+ <td>74.94</td>
134
+ <td>70.84</td>
135
+ <td>73.20</td>
136
+ <td>59.52</td>
137
+ <td>87.89</td>
138
+ <td>78.47</td>
139
+ </tr>
140
+ <tr>
141
+ <td>XLM-RoBERTa-Base</td>
142
+ <td>73.60</td>
143
+ <td>6</td>
144
+ <td>76.35</td>
145
+ <td>69.37</td>
146
+ <td>73.42</td>
147
+ <td>68.45</td>
148
+ <td>67.45</td>
149
+ <td>74.05</td>
150
+ <td>74.26</td>
151
+ <td>70.44</td>
152
+ <td>71.40</td>
153
+ <td>60.19</td>
154
+ <td>87.90</td>
155
+ <td>78.28</td>
156
+ </tr>
157
+ <tr>
158
+ <td>RuBERT</td>
159
+ <td>73.45</td>
160
+ <td>7</td>
161
+ <td>74.03</td>
162
+ <td>66.14</td>
163
+ <td>70.75</td>
164
+ <td>66.46</td>
165
+ <td>66.40</td>
166
+ <td>73.37</td>
167
+ <td>75.49</td>
168
+ <td>71.86</td>
169
+ <td>72.15</td>
170
+ <td>60.55</td>
171
+ <td>86.99</td>
172
+ <td>77.41</td>
173
+ </tr>
174
+ <tr>
175
+ <td>MBART-50-Large-Many-to-Many</td>
176
+ <td>73.15</td>
177
+ <td>8</td>
178
+ <td>75.38</td>
179
+ <td>67.81</td>
180
+ <td>72.26</td>
181
+ <td>67.13</td>
182
+ <td>66.97</td>
183
+ <td>73.85</td>
184
+ <td>74.78</td>
185
+ <td>70.98</td>
186
+ <td>71.98</td>
187
+ <td>59.20</td>
188
+ <td>87.05</td>
189
+ <td>77.24</td>
190
+ </tr>
191
+ <tr>
192
+ <td>SlavicBERT</td>
193
+ <td>71.96</td>
194
+ <td>9</td>
195
+ <td>71.45</td>
196
+ <td>63.03</td>
197
+ <td>68.44</td>
198
+ <td>64.32</td>
199
+ <td>63.99</td>
200
+ <td>71.31</td>
201
+ <td>72.13</td>
202
+ <td>67.57</td>
203
+ <td>72.54</td>
204
+ <td>58.70</td>
205
+ <td>86.43</td>
206
+ <td>77.16</td>
207
+ </tr>
208
+ <tr>
209
+ <td>EnRuDR-BERT</td>
210
+ <td>71.51</td>
211
+ <td>10</td>
212
+ <td>72.56</td>
213
+ <td>64.74</td>
214
+ <td>69.07</td>
215
+ <td>61.44</td>
216
+ <td>60.21</td>
217
+ <td>68.34</td>
218
+ <td>74.19</td>
219
+ <td>69.94</td>
220
+ <td>69.33</td>
221
+ <td>56.55</td>
222
+ <td>87.12</td>
223
+ <td>77.95</td>
224
+ </tr>
225
+ <tr>
226
+ <td>RuDR-BERT</td>
227
+ <td>71.14</td>
228
+ <td>11</td>
229
+ <td>72.79</td>
230
+ <td>64.23</td>
231
+ <td>68.36</td>
232
+ <td>61.86</td>
233
+ <td>60.92</td>
234
+ <td>68.48</td>
235
+ <td>74.65</td>
236
+ <td>70.63</td>
237
+ <td>68.74</td>
238
+ <td>54.45</td>
239
+ <td>87.04</td>
240
+ <td>77.91</td>
241
+ </tr>
242
+ <tr>
243
+ <td>MBART-50-Large</td>
244
+ <td>69.46</td>
245
+ <td>12</td>
246
+ <td>70.91</td>
247
+ <td>62.67</td>
248
+ <td>67.24</td>
249
+ <td>61.12</td>
250
+ <td>60.25</td>
251
+ <td>68.41</td>
252
+ <td>72.88</td>
253
+ <td>68.63</td>
254
+ <td>70.52</td>
255
+ <td>46.39</td>
256
+ <td>86.48</td>
257
+ <td>77.52</td>
258
+ </tr>
259
+ </tbody>
260
+ </table>
261
+