lewtun HF staff commited on
Commit
056468e
1 Parent(s): 5b2e376

Add evaluation results on the 3.0.0 config of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@grappler

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-cnn_dailymail-1bafd1c4-12715695).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -7,6 +7,42 @@ datasets:
7
  - cnn_dailymail
8
  - xsum
9
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  ### Usage
 
7
  - cnn_dailymail
8
  - xsum
9
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
10
+ model-index:
11
+ - name: sshleifer/distilbart-xsum-12-6
12
+ results:
13
+ - task:
14
+ type: summarization
15
+ name: Summarization
16
+ dataset:
17
+ name: cnn_dailymail
18
+ type: cnn_dailymail
19
+ config: 3.0.0
20
+ split: test
21
+ metrics:
22
+ - name: ROUGE-1
23
+ type: rouge
24
+ value: 23.0331
25
+ verified: true
26
+ - name: ROUGE-2
27
+ type: rouge
28
+ value: 6.5144
29
+ verified: true
30
+ - name: ROUGE-L
31
+ type: rouge
32
+ value: 15.8576
33
+ verified: true
34
+ - name: ROUGE-LSUM
35
+ type: rouge
36
+ value: 19.9849
37
+ verified: true
38
+ - name: loss
39
+ type: loss
40
+ value: 4.359408855438232
41
+ verified: true
42
+ - name: gen_len
43
+ type: gen_len
44
+ value: 24.0687
45
+ verified: true
46
  ---
47
 
48
  ### Usage