t5-base-cnn-dm / README.md
patrickvonplaten's picture
Add evaluation results on cnn_dailymail dataset (#2)
8ee9fb4
metadata
language: en
tags:
  - summarization
license: apache-2.0
datasets:
  - cnn_dailymail
model-index:
  - name: flax-community/t5-base-cnn-dm
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: cnn_dailymail
          type: cnn_dailymail
          config: 3.0.0
          split: test
        metrics:
          - name: ROUGE-1
            type: rouge
            value: 24.2906
            verified: true
          - name: ROUGE-2
            type: rouge
            value: 11.1405
            verified: true
          - name: ROUGE-L
            type: rouge
            value: 19.8442
            verified: true
          - name: ROUGE-LSUM
            type: rouge
            value: 22.7556
            verified: true
          - name: loss
            type: loss
            value: 2.1426470279693604
            verified: true
          - name: gen_len
            type: gen_len
            value: 18.9993
            verified: true

Model

This model is fine-tuned from https://huggingface.co/flax-community/t5-base-openwebtext, fine-tuned on cnn_dailymail.