autoevaluator HF staff commited on
Commit
38bafba
1 Parent(s): 811b08d

Add evaluation results on the 3.0.0 config and test split of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by @DongfuTingle, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-2bc9e0-1812262541).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -2,6 +2,42 @@
2
  language: en
3
  tags:
4
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  ### Pegasus Models
 
2
  language: en
3
  tags:
4
  - summarization
5
+ model-index:
6
+ - name: google/pegasus-cnn_dailymail
7
+ results:
8
+ - task:
9
+ type: summarization
10
+ name: Summarization
11
+ dataset:
12
+ name: cnn_dailymail
13
+ type: cnn_dailymail
14
+ config: 3.0.0
15
+ split: test
16
+ metrics:
17
+ - name: ROUGE-1
18
+ type: rouge
19
+ value: 43.1622
20
+ verified: true
21
+ - name: ROUGE-2
22
+ type: rouge
23
+ value: 20.7447
24
+ verified: true
25
+ - name: ROUGE-L
26
+ type: rouge
27
+ value: 30.4765
28
+ verified: true
29
+ - name: ROUGE-LSUM
30
+ type: rouge
31
+ value: 36.8076
32
+ verified: true
33
+ - name: loss
34
+ type: loss
35
+ value: 2.030170202255249
36
+ verified: true
37
+ - name: gen_len
38
+ type: gen_len
39
+ value: 77.8432
40
+ verified: true
41
  ---
42
 
43
  ### Pegasus Models