| tags: | |
| - summarization | |
| language: | |
| - en | |
| license: mit | |
| model-index: | |
| - name: facebook/bart-large-xsum | |
| results: | |
| - task: | |
| type: summarization | |
| name: Summarization | |
| dataset: | |
| name: cnn_dailymail | |
| type: cnn_dailymail | |
| config: 3.0.0 | |
| split: test | |
| metrics: | |
| - name: ROUGE-1 | |
| type: rouge | |
| value: 25.2697 | |
| verified: true | |
| - name: ROUGE-2 | |
| type: rouge | |
| value: 7.6638 | |
| verified: true | |
| - name: ROUGE-L | |
| type: rouge | |
| value: 17.1808 | |
| verified: true | |
| - name: ROUGE-LSUM | |
| type: rouge | |
| value: 21.7933 | |
| verified: true | |
| - name: loss | |
| type: loss | |
| value: 3.5042972564697266 | |
| verified: true | |
| - name: gen_len | |
| type: gen_len | |
| value: 27.4462 | |
| verified: true | |
| - task: | |
| type: summarization | |
| name: Summarization | |
| dataset: | |
| name: xsum | |
| type: xsum | |
| config: default | |
| split: test | |
| metrics: | |
| - name: ROUGE-1 | |
| type: rouge | |
| value: 45.4525 | |
| verified: true | |
| - name: ROUGE-2 | |
| type: rouge | |
| value: 22.3455 | |
| verified: true | |
| - name: ROUGE-L | |
| type: rouge | |
| value: 37.2302 | |
| verified: true | |
| - name: ROUGE-LSUM | |
| type: rouge | |
| value: 37.2323 | |
| verified: true | |
| - name: loss | |
| type: loss | |
| value: 2.3128726482391357 | |
| verified: true | |
| - name: gen_len | |
| type: gen_len | |
| value: 25.5435 | |
| verified: true | |
| - task: | |
| type: summarization | |
| name: Summarization | |
| dataset: | |
| name: samsum | |
| type: samsum | |
| config: samsum | |
| split: train | |
| metrics: | |
| - name: ROUGE-1 | |
| type: rouge | |
| value: 24.7852 | |
| verified: true | |
| - name: ROUGE-2 | |
| type: rouge | |
| value: 5.2533 | |
| verified: true | |
| - name: ROUGE-L | |
| type: rouge | |
| value: 18.6792 | |
| verified: true | |
| - name: ROUGE-LSUM | |
| type: rouge | |
| value: 20.629 | |
| verified: true | |
| - name: loss | |
| type: loss | |
| value: 3.746837854385376 | |
| verified: true | |
| - name: gen_len | |
| type: gen_len | |
| value: 23.1206 | |
| verified: true | |
| - task: | |
| type: summarization | |
| name: Summarization | |
| dataset: | |
| name: samsum | |
| type: samsum | |
| config: samsum | |
| split: test | |
| metrics: | |
| - name: ROUGE-1 | |
| type: rouge | |
| value: 24.9158 | |
| verified: true | |
| - name: ROUGE-2 | |
| type: rouge | |
| value: 5.5837 | |
| verified: true | |
| - name: ROUGE-L | |
| type: rouge | |
| value: 18.8935 | |
| verified: true | |
| - name: ROUGE-LSUM | |
| type: rouge | |
| value: 20.76 | |
| verified: true | |
| - name: loss | |
| type: loss | |
| value: 3.775235891342163 | |
| verified: true | |
| - name: gen_len | |
| type: gen_len | |
| value: 23.0928 | |
| verified: true | |
| ### Bart model finetuned on xsum | |
| docs: https://huggingface.co/transformers/model_doc/bart.html | |
| finetuning: examples/seq2seq/ (as of Aug 20, 2020) | |
| Metrics: ROUGE > 22 on xsum. | |
| variants: search for distilbart | |
| paper: https://arxiv.org/abs/1910.13461 |