Update README.md
Browse files
README.md
CHANGED
@@ -60,9 +60,19 @@ print(summary)
|
|
60 |
|
61 |
## Eval results
|
62 |
|
63 |
-
|
64 |
-
|
65 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
|
67 |
Predicting all summaries:
|
68 |
```python
|
|
|
60 |
|
61 |
## Eval results
|
62 |
|
63 |
+
Gazeta v1 train -> Gazeta v1 test
|
64 |
+
|
65 |
+
| Model | R-1-f | R-2-f | R-L-f | chrF | METEOR | BLEU |
|
66 |
+
|:--------------------------|:------|:------|:------|:-------|:-------|:-----|
|
67 |
+
| mbart_ru_sum_gazeta | 32.1 | 14.3 | **27.9** | **39.7** | **25.7** | **12.4** |
|
68 |
+
| rut5_base_sum_gazeta | **32.3** | **14.5** | 27.9 | 39.6 | 25.1 | 11.5 |
|
69 |
+
|
70 |
+
Gazeta v1 train -> Gazeta v2 test
|
71 |
+
|
72 |
+
| Model | R-1-f | R-2-f | R-L-f | chrF | METEOR | BLEU |
|
73 |
+
|:--------------------------|:------|:------|:------|:-------|:-------|:-----|
|
74 |
+
| mbart_ru_sum_gazeta | **28.8** | **11.1** | **24.5** | **37.4** | **22.7** | **9.5** |
|
75 |
+
| rut5_base_sum_gazeta | 28.5 | 11.0 | 24.2 | 36.8 | 21.2 | 8.6 |
|
76 |
|
77 |
Predicting all summaries:
|
78 |
```python
|