autoevaluator HF staff commited on
Commit
c422ea1
1 Parent(s): e181a2c

Add evaluation results on the 3.0.0 config and test split of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@gauiru1998

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-66cf5e-63956145513).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +43 -1
README.md CHANGED
@@ -1,3 +1,45 @@
1
  ---
2
  pipeline_tag: summarization
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  pipeline_tag: summarization
3
+ model-index:
4
+ - name: 0x70DA/pegasus-cnn_dailymail
5
+ results:
6
+ - task:
7
+ type: summarization
8
+ name: Summarization
9
+ dataset:
10
+ name: cnn_dailymail
11
+ type: cnn_dailymail
12
+ config: 3.0.0
13
+ split: test
14
+ metrics:
15
+ - type: rouge
16
+ value: 42.0703
17
+ name: ROUGE-1
18
+ verified: true
19
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDBkYTUzNTQwN2JhZTdmYjllOTk5YmRmMGQwMzA1ZjFlMGMwM2JjNDk4ODZiMDBjMmYxMDdhNzlhODQxMjA4YiIsInZlcnNpb24iOjF9.Xj34BCuUsYwpCXuKk5ooPZ_2Mo_4o_1QHrkfJFjv4Qd0Tl-jCyhTQRzSDtANs4oV6Snfn6UjqSuu6IOwlKjtBQ
20
+ - type: rouge
21
+ value: 20.1368
22
+ name: ROUGE-2
23
+ verified: true
24
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOGFjNjllZjQ0NGJhNGI0MmUzNTZiOTU4NWVlMDY5ZDBjNTc0ZDhjMGM1Yzk4Y2MzNDYwZmIxNWNkMzFiYWU5OSIsInZlcnNpb24iOjF9.Mbj4BwVIUHY9tPs_Xj3E8HOpFNbPSCT_9S3j0nN6NsSqDzFEvyMVyOHsRk6F6g4vzmA5YWHX0YFoYxRHI-RUCA
25
+ - type: rouge
26
+ value: 29.8819
27
+ name: ROUGE-L
28
+ verified: true
29
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTgzZDk2MGRhZGNmM2Q0Mjg5MDU2NGUzYThiMGJkZWU2MjcwOTIxNzI3YzA0NGI2NDljMjRlZmJlNDdiZjM0OCIsInZlcnNpb24iOjF9.jYic6OGh81fWHplV2rHF2qKx_MoFGMaG08rNUyjQhUuqzPF-ZVU2IEz5-zrNd2I_IfWYqDzXYtMCFe7zC6z1BA
30
+ - type: rouge
31
+ value: 37.8738
32
+ name: ROUGE-LSUM
33
+ verified: true
34
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDU2MThlZGY3MDUzZDU4MDEyODEyMDg2OWViNzdiNTQwYWQ2NzRmNzRjOWNlNDg1MmVjY2JmM2JjMzViZThiOCIsInZlcnNpb24iOjF9.OP4ifKCAa015Pzvue6X_OOHyJH9OeMzM71rlEal-bOkv0kKqORxmGt43RMl09PPEwPnV0TnI47QDezUuwf_tDA
35
+ - type: loss
36
+ value: 1.762200951576233
37
+ name: loss
38
+ verified: true
39
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDQzNWYxY2VjNWIzNGE2MjllZGY2YjUyMTUxYTU3YTRhOWNiMmE5MDFjNzU3OWM0MGQwYTM3YmRhNjRmODRmNiIsInZlcnNpb24iOjF9.D8v4ULtmChj1SDEl6Ka2EU_HyU255_26JGOHUQl22kIlG4xu9a2md95PP6qR-m9sbtEVIpzMjthWxs5R4ALDBw
40
+ - type: gen_len
41
+ value: 63.5059
42
+ name: gen_len
43
+ verified: true
44
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjc1NDYwOWRlMDFjNjU0OTIxMWViNjg3N2U5MWJhODVmZDY0MzYyYjBkYmEwYWUwNjBlNzFmNjExMjc2MDhkYiIsInZlcnNpb24iOjF9.-llqLZ7UNqG1vUAK3-mY_rgVwNWXtJTM9iRjlCQBi73AFahWRpePCK3n4AHcEDzbF-HpVlJQBl6eOYBytTBEBQ
45
+ ---