tags: | |
- summarization | |
language: | |
- en | |
license: mit | |
model-index: | |
- name: facebook/bart-large-xsum | |
results: | |
- task: | |
type: summarization | |
name: Summarization | |
dataset: | |
name: cnn_dailymail | |
type: cnn_dailymail | |
config: 3.0.0 | |
split: test | |
metrics: | |
- name: ROUGE-1 | |
type: rouge | |
value: 25.2697 | |
verified: true | |
- name: ROUGE-2 | |
type: rouge | |
value: 7.6638 | |
verified: true | |
- name: ROUGE-L | |
type: rouge | |
value: 17.1808 | |
verified: true | |
- name: ROUGE-LSUM | |
type: rouge | |
value: 21.7933 | |
verified: true | |
- name: loss | |
type: loss | |
value: 3.5042972564697266 | |
verified: true | |
- name: gen_len | |
type: gen_len | |
value: 27.4462 | |
verified: true | |
- task: | |
type: summarization | |
name: Summarization | |
dataset: | |
name: xsum | |
type: xsum | |
config: default | |
split: test | |
metrics: | |
- name: ROUGE-1 | |
type: rouge | |
value: 45.4525 | |
verified: true | |
- name: ROUGE-2 | |
type: rouge | |
value: 22.3455 | |
verified: true | |
- name: ROUGE-L | |
type: rouge | |
value: 37.2302 | |
verified: true | |
- name: ROUGE-LSUM | |
type: rouge | |
value: 37.2323 | |
verified: true | |
- name: loss | |
type: loss | |
value: 2.3128726482391357 | |
verified: true | |
- name: gen_len | |
type: gen_len | |
value: 25.5435 | |
verified: true | |
- task: | |
type: summarization | |
name: Summarization | |
dataset: | |
name: samsum | |
type: samsum | |
config: samsum | |
split: train | |
metrics: | |
- name: ROUGE-1 | |
type: rouge | |
value: 24.7852 | |
verified: true | |
- name: ROUGE-2 | |
type: rouge | |
value: 5.2533 | |
verified: true | |
- name: ROUGE-L | |
type: rouge | |
value: 18.6792 | |
verified: true | |
- name: ROUGE-LSUM | |
type: rouge | |
value: 20.629 | |
verified: true | |
- name: loss | |
type: loss | |
value: 3.746837854385376 | |
verified: true | |
- name: gen_len | |
type: gen_len | |
value: 23.1206 | |
verified: true | |
- task: | |
type: summarization | |
name: Summarization | |
dataset: | |
name: samsum | |
type: samsum | |
config: samsum | |
split: test | |
metrics: | |
- name: ROUGE-1 | |
type: rouge | |
value: 24.9158 | |
verified: true | |
- name: ROUGE-2 | |
type: rouge | |
value: 5.5837 | |
verified: true | |
- name: ROUGE-L | |
type: rouge | |
value: 18.8935 | |
verified: true | |
- name: ROUGE-LSUM | |
type: rouge | |
value: 20.76 | |
verified: true | |
- name: loss | |
type: loss | |
value: 3.775235891342163 | |
verified: true | |
- name: gen_len | |
type: gen_len | |
value: 23.0928 | |
verified: true | |
### Bart model finetuned on xsum | |
docs: https://huggingface.co/transformers/model_doc/bart.html | |
finetuning: examples/seq2seq/ (as of Aug 20, 2020) | |
Metrics: ROUGE > 22 on xsum. | |
variants: search for distilbart | |
paper: https://arxiv.org/abs/1910.13461 |