autoevaluator HF staff commited on
Commit
4341092
1 Parent(s): e181a2c

Add evaluation results on the 3.0.0 config and test split of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@https

://huggingface.co/Sini, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-e26065-64936145535).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +43 -1
README.md CHANGED
@@ -1,3 +1,45 @@
1
  ---
2
  pipeline_tag: summarization
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  pipeline_tag: summarization
3
+ model-index:
4
+ - name: 0x70DA/pegasus-cnn_dailymail
5
+ results:
6
+ - task:
7
+ type: summarization
8
+ name: Summarization
9
+ dataset:
10
+ name: cnn_dailymail
11
+ type: cnn_dailymail
12
+ config: 3.0.0
13
+ split: test
14
+ metrics:
15
+ - type: rouge
16
+ value: 42.0769
17
+ name: ROUGE-1
18
+ verified: true
19
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGY5ZjRmNzIzMzU3MTcyNjI5NjAzMmUxNTk5M2VjNDQwZGFiZjM3YjE0NjZkZDI2NGY4ODQwMGMxYmUxY2YzYiIsInZlcnNpb24iOjF9.awgdiW5v92eENvhSk1KM5KA6BJjCzVd-wJ6w79jHPI-cQ3HGMELW2b2HiNEXje2socFp89xweKRMnbJonaYrAA
20
+ - type: rouge
21
+ value: 20.1341
22
+ name: ROUGE-2
23
+ verified: true
24
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDdmN2I1MGIzOTQwMmY3ODY2MWM4NGJiYzhkYzM0ZDg3MTIwNzk0ODUzNGNkY2VkOGJiMDVmZmM4YWM3MmRhZiIsInZlcnNpb24iOjF9.curKPAy-rrKZLoUlsh_QKiM22qxoyrB5DX4qqDzXiMOSzpQ17UTrJ0gZ0PKA7KZJo4ZVCF8TyXR0bzVkvdyICQ
25
+ - type: rouge
26
+ value: 29.881
27
+ name: ROUGE-L
28
+ verified: true
29
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDk3YmRhNDBlYzRiMzFhNjM0OGE5MWM0Mjc3MWY5YzY3ZTA3MzgyYjYyNjJkMjViNTBlMDMwNTYzMWIxNzQzYSIsInZlcnNpb24iOjF9.AEzbPODHUylX81jKz-7Ukw6MapuTnRMTvKQV7SYZBVaUq6ZgFbJedv04FXIfzGDWxj-bZs1yQ3-mHh3tZU_bAw
30
+ - type: rouge
31
+ value: 37.8775
32
+ name: ROUGE-LSUM
33
+ verified: true
34
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmVmMjRkNTJjZjU4NGEyMDk1YWYyMWUyMGE0YjJmNDViOWUxMGQ2YWM2ZjdiYTg2OThjZTFkNmYwNTI4MmNjNiIsInZlcnNpb24iOjF9.WM5ubbkBn6cGWXzWTANZ_c4-kI6l25u0PegDkEo35Upytohg9ofTM7H9AZBtpRhYF4JtOhbE3k7nwkAILyTCDw
35
+ - type: loss
36
+ value: 1.762200951576233
37
+ name: loss
38
+ verified: true
39
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDQzNWYxY2VjNWIzNGE2MjllZGY2YjUyMTUxYTU3YTRhOWNiMmE5MDFjNzU3OWM0MGQwYTM3YmRhNjRmODRmNiIsInZlcnNpb24iOjF9.D8v4ULtmChj1SDEl6Ka2EU_HyU255_26JGOHUQl22kIlG4xu9a2md95PP6qR-m9sbtEVIpzMjthWxs5R4ALDBw
40
+ - type: gen_len
41
+ value: 63.5059
42
+ name: gen_len
43
+ verified: true
44
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjc1NDYwOWRlMDFjNjU0OTIxMWViNjg3N2U5MWJhODVmZDY0MzYyYjBkYmEwYWUwNjBlNzFmNjExMjc2MDhkYiIsInZlcnNpb24iOjF9.-llqLZ7UNqG1vUAK3-mY_rgVwNWXtJTM9iRjlCQBi73AFahWRpePCK3n4AHcEDzbF-HpVlJQBl6eOYBytTBEBQ
45
+ ---