lewtun HF staff commited on
Commit
6bee5c9
1 Parent(s): 3796723

Add evaluation results on cnn_dailymail dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-3aabac9e-7554869).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -5,6 +5,42 @@ tags:
5
  license: apache-2.0
6
  datasets:
7
  - cnn_dailymail
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
  # Model
10
  This model is fine-tuned from https://huggingface.co/flax-community/t5-base-openwebtext, fine-tuned on cnn_dailymail.
 
5
  license: apache-2.0
6
  datasets:
7
  - cnn_dailymail
8
+ model-index:
9
+ - name: flax-community/t5-base-cnn-dm
10
+ results:
11
+ - task:
12
+ type: summarization
13
+ name: Summarization
14
+ dataset:
15
+ name: cnn_dailymail
16
+ type: cnn_dailymail
17
+ config: 3.0.0
18
+ split: test
19
+ metrics:
20
+ - name: ROUGE-1
21
+ type: rouge
22
+ value: 24.286
23
+ verified: true
24
+ - name: ROUGE-2
25
+ type: rouge
26
+ value: 11.1355
27
+ verified: true
28
+ - name: ROUGE-L
29
+ type: rouge
30
+ value: 19.8404
31
+ verified: true
32
+ - name: ROUGE-LSUM
33
+ type: rouge
34
+ value: 22.7534
35
+ verified: true
36
+ - name: loss
37
+ type: loss
38
+ value: 2.1426050662994385
39
+ verified: true
40
+ - name: gen_len
41
+ type: gen_len
42
+ value: 18.9993
43
+ verified: true
44
  ---
45
  # Model
46
  This model is fine-tuned from https://huggingface.co/flax-community/t5-base-openwebtext, fine-tuned on cnn_dailymail.