![autoevaluator's picture](https://cdn-avatars.huggingface.co/v1/production/uploads/1654180084862-6297236d64501abb8dfde40d.png)
autoevaluator
HF staff
Add evaluation results on the 3.0.0 config and test split of cnn_dailymail
b6d65ed
metadata
language: en
license: apache-2.0
datasets:
- cnn_dailymail
tags:
- summarization
model-index:
- name: patrickvonplaten/bert2bert_cnn_daily_mail
results:
- task:
type: summarization
name: Summarization
dataset:
name: cnn_dailymail
type: cnn_dailymail
config: 3.0.0
split: test
metrics:
- name: ROUGE-1
type: rouge
value: 41.2311
verified: true
- name: ROUGE-2
type: rouge
value: 18.6648
verified: true
- name: ROUGE-L
type: rouge
value: 28.1598
verified: true
- name: ROUGE-LSUM
type: rouge
value: 38.0543
verified: true
- name: loss
type: loss
value: 2.352957010269165
verified: true
- name: gen_len
type: gen_len
value: 73.8332
verified: true
Bert2Bert Summarization with 🤗EncoderDecoder Framework This model is a warm-started BERT2BERT model fine-tuned on the CNN/Dailymail summarization dataset.
The model achieves a 18.22 ROUGE-2 score on CNN/Dailymail's test dataset.
For more details on how the model was fine-tuned, please refer to this notebook.