IlyaGusev
/

rut5_base_sum_gazeta

Summarization Transformers PyTorch

Russian t5 text2text-generation Inference Endpoints text-generation-inference

Model card Files Files and versions Community

IlyaGusev commited on Nov 20, 2021

Commit

520981e

•

1 Parent(s): 6527003

Update README.md

Files changed (1) hide show

README.md +13 -3

README.md CHANGED Viewed

@@ -60,9 +60,19 @@ print(summary)
 ## Eval results
-| Model                     | R-1-f | R-2-f | R-L-f | chrF | BLEU |
-|:--------------------------|:------|:------|:------|:-----|:-----|
-| rut5_base_sum_gazeta      | 32.3  | 14.5  | 27.9  | 39.6 | 11.5 |
 Predicting all summaries:
 ```python

 ## Eval results
+Gazeta v1 train -> Gazeta v1 test
+| Model                     | R-1-f | R-2-f | R-L-f | chrF | METEOR | BLEU |
+|:--------------------------|:------|:------|:------|:-------|:-------|:-----|
+| mbart_ru_sum_gazeta       | 32.1  | 14.3  | **27.9**  | **39.7** | **25.7**   | **12.4** |
+| rut5_base_sum_gazeta      | **32.3**  | **14.5**  | 27.9 | 39.6 | 25.1   | 11.5 |
+Gazeta v1 train -> Gazeta v2 test
+| Model                     | R-1-f | R-2-f | R-L-f | chrF | METEOR | BLEU |
+|:--------------------------|:------|:------|:------|:-------|:-------|:-----|
+| mbart_ru_sum_gazeta       | **28.8**  | **11.1**  | **24.5**  | **37.4** | **22.7**   | **9.5** |
+| rut5_base_sum_gazeta      | 28.5  | 11.0  | 24.2  | 36.8 | 21.2   | 8.6 |
 Predicting all summaries:
 ```python