lewtun HF staff commited on
Commit
88441f8
1 Parent(s): 45d5d50

Add evaluation results on cnn_dailymail dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-be45ecbd-7284773).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -9,6 +9,42 @@ metrics:
9
  - R1
10
  - R2
11
  - RL
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  ## facebook/bart-base model fine-tuned on CNN/DailyMail
 
9
  - R1
10
  - R2
11
  - RL
12
+ model-index:
13
+ - name: echarlaix/bart-base-cnn-r2-19.4-d35-hybrid
14
+ results:
15
+ - task:
16
+ type: summarization
17
+ name: Summarization
18
+ dataset:
19
+ name: cnn_dailymail
20
+ type: cnn_dailymail
21
+ config: 3.0.0
22
+ split: test
23
+ metrics:
24
+ - name: ROUGE-1
25
+ type: rouge
26
+ value: 24.2717
27
+ verified: true
28
+ - name: ROUGE-2
29
+ type: rouge
30
+ value: 11.8434
31
+ verified: true
32
+ - name: ROUGE-L
33
+ type: rouge
34
+ value: 20.1958
35
+ verified: true
36
+ - name: ROUGE-LSUM
37
+ type: rouge
38
+ value: 22.8206
39
+ verified: true
40
+ - name: loss
41
+ type: loss
42
+ value: 1.91438627243042
43
+ verified: true
44
+ - name: gen_len
45
+ type: gen_len
46
+ value: 20.0
47
+ verified: true
48
  ---
49
 
50
  ## facebook/bart-base model fine-tuned on CNN/DailyMail