bart-large-xsum / README.md
lewtun's picture
lewtun HF staff
Add evaluation results on the default config of xsum
7421ec4
|
raw
history blame
1.02 kB
metadata
tags:
  - summarization
language:
  - en
license: mit
model-index:
  - name: facebook/bart-large-xsum
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: xsum
          type: xsum
          config: default
          split: test
        metrics:
          - name: ROUGE-1
            type: rouge
            value: 45.4525
            verified: true
          - name: ROUGE-2
            type: rouge
            value: 22.3455
            verified: true
          - name: ROUGE-L
            type: rouge
            value: 37.2302
            verified: true
          - name: ROUGE-LSUM
            type: rouge
            value: 37.2323
            verified: true
          - name: loss
            type: loss
            value: 2.3128726482391357
            verified: true
          - name: gen_len
            type: gen_len
            value: 25.5435
            verified: true

Bart model finetuned on xsum

docs: https://huggingface.co/transformers/model_doc/bart.html

finetuning: examples/seq2seq/ (as of Aug 20, 2020)

Metrics: ROUGE > 22 on xsum.

variants: search for distilbart

paper: https://arxiv.org/abs/1910.13461