autoevaluator HF staff commited on
Commit
52c974a
1 Parent(s): dec7796

Add evaluation results on the 3.0.0 config and test split of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@sasha

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-36c277-93197145789).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -2,6 +2,48 @@
2
  language: en
3
  tags:
4
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  ### Pegasus Models
 
2
  language: en
3
  tags:
4
  - summarization
5
+ model-index:
6
+ - name: google/pegasus-large
7
+ results:
8
+ - task:
9
+ type: summarization
10
+ name: Summarization
11
+ dataset:
12
+ name: cnn_dailymail
13
+ type: cnn_dailymail
14
+ config: 3.0.0
15
+ split: test
16
+ metrics:
17
+ - type: rouge
18
+ value: 34.2469
19
+ name: ROUGE-1
20
+ verified: true
21
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzQ2OTA1ODU2NGZkZTQyZmU4MWU5MThjZTFlOTE4MjUzYWUxMWY5ZDZiODA2OWI2OTM4NTY1ZGNlOTEwNTYzYiIsInZlcnNpb24iOjF9.kwREGOSSAdsiikzuageoUhQHpSV3tnmjiI3Li9cTes2HL_y5DH6o1ggL0_ylAWhDSboZFFNn4OsPclOKpOn5CA
22
+ - type: rouge
23
+ value: 13.6938
24
+ name: ROUGE-2
25
+ verified: true
26
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWMwMDU1ODA1ODY5ZWYyODQzYzkzMzJlNmU2MGMyMTdmNmYxMDJlOWE3OTEwNGRhNjE0MGM4MDkzMWE5YTMzNSIsInZlcnNpb24iOjF9.XOBSdFW-6Wlu7E8i5l19wEqqS490U8tdne1ZQts_1tMfTIIjKn3OQ-rk3qva9PfgMIUwnkwjTdjwSXi-BQJGDQ
27
+ - type: rouge
28
+ value: 22.1834
29
+ name: ROUGE-L
30
+ verified: true
31
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTE1MTU5YWNjMzFiNTA1YmUyMGUxZmFkZjYyNzVhOWY2ZmMwYjgzODZkNTFmZjdhYzI2ZDY4NTc2MzEwNTU1MiIsInZlcnNpb24iOjF9.LM0rzP07-XSmpcqmXJcXxVBCUM6Nf3-vwHI_aumJBARKhN9D2Vq5A2xK6vCC36nFnDPrOjH0M7I5nOZ8GPtkDA
32
+ - type: rouge
33
+ value: 30.3632
34
+ name: ROUGE-LSUM
35
+ verified: true
36
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzgzZTM4NTkzOWM5NjYyNzU0YTEwMTUyYTQ5ZWNmOTVmODk4YzhhMGFhYTY1MTY1ODY0NzlmYjdmNmYxYTdlNyIsInZlcnNpb24iOjF9.K7sRTcJga1bV0zHpWaIsJVr9UgcMUfBDXh9qg8JePnSfOORp5iu6zqpVR9SzP46MFV41NdVYqzrMTpgB0Gx4CQ
37
+ - type: loss
38
+ value: 2.4100289344787598
39
+ name: loss
40
+ verified: true
41
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjQyN2UxZTdhNzU5ZjRiN2U4OGI3ZmJkN2FiMzNhZTQ2NDYzMzY5MTI4YTU2ZGYwYzQwMTRkMTUwYjc4MWEwZSIsInZlcnNpb24iOjF9.VgQyew_hertKt0qvJaki8x3r2uoaejqPpAK14iLf8RrV6njDOXZD-wpC0eRp5BO6IZRKTm8OIacdE6EWBq3tBg
42
+ - type: gen_len
43
+ value: 105.9809
44
+ name: gen_len
45
+ verified: true
46
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzM3OGM3YjY0M2IzMGM5ZDgwY2ZjMmJiYWI3ZDlkYTIxMWVmNDY0YThmYWIzM2UxNmQ3ODMwNDQyMmJlZjAwNiIsInZlcnNpb24iOjF9.l0z9-W0lc53u-QaONnMFaW-aoeiQ5FBgh4lM3qKnmEEoCs7Vwp4uaMNChNJZO61UqC7OucDMLRWJckqvXqqgCQ
47
  ---
48
 
49
  ### Pegasus Models