autoevaluator HF staff commited on
Commit
370c0c9
1 Parent(s): deb0f97

Add evaluation results on the zeroshot--twitter-financial-news-topic config and train split of zeroshot/twitter-financial-news-topic

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the zeroshot--twitter-financial-news-topic config and train split of the [zeroshot/twitter-financial-news-topic](https://huggingface.co/datasets/zeroshot/twitter-financial-news-topic) dataset by

@peterdevathala

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-zeroshot__twitter-financial-news-topic-zeroshot__twitte-e590a9-28983144931).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=zeroshot/twitter-financial-news-topic).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=zeroshot/twitter-financial-news-topic).

Files changed (1) hide show
  1. README.md +53 -14
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
2
  language:
3
  - en
 
4
  tags:
5
  - summarization
6
- license: mit
7
- thumbnail: https://huggingface.co/front/thumbnails/facebook.png
8
  datasets:
9
  - cnn_dailymail
 
10
  model-index:
11
  - name: facebook/bart-large-cnn
12
  results:
@@ -19,30 +19,69 @@ model-index:
19
  config: 3.0.0
20
  split: train
21
  metrics:
22
- - name: ROUGE-1
23
- type: rouge
24
  value: 42.9486
 
25
  verified: true
26
- - name: ROUGE-2
27
- type: rouge
28
  value: 20.8149
 
29
  verified: true
30
- - name: ROUGE-L
31
- type: rouge
32
  value: 30.6186
 
33
  verified: true
34
- - name: ROUGE-LSUM
35
- type: rouge
36
  value: 40.0376
 
37
  verified: true
38
- - name: loss
39
- type: loss
40
  value: 2.529000997543335
 
41
  verified: true
42
- - name: gen_len
43
- type: gen_len
44
  value: 78.5866
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
  verified: true
 
46
  ---
47
  # BART (large-sized model), fine-tuned on CNN Daily Mail
48
 
 
1
  ---
2
  language:
3
  - en
4
+ license: mit
5
  tags:
6
  - summarization
 
 
7
  datasets:
8
  - cnn_dailymail
9
+ thumbnail: https://huggingface.co/front/thumbnails/facebook.png
10
  model-index:
11
  - name: facebook/bart-large-cnn
12
  results:
 
19
  config: 3.0.0
20
  split: train
21
  metrics:
22
+ - type: rouge
 
23
  value: 42.9486
24
+ name: ROUGE-1
25
  verified: true
26
+ - type: rouge
 
27
  value: 20.8149
28
+ name: ROUGE-2
29
  verified: true
30
+ - type: rouge
 
31
  value: 30.6186
32
+ name: ROUGE-L
33
  verified: true
34
+ - type: rouge
 
35
  value: 40.0376
36
+ name: ROUGE-LSUM
37
  verified: true
38
+ - type: loss
 
39
  value: 2.529000997543335
40
+ name: loss
41
  verified: true
42
+ - type: gen_len
 
43
  value: 78.5866
44
+ name: gen_len
45
+ verified: true
46
+ - task:
47
+ type: summarization
48
+ name: Summarization
49
+ dataset:
50
+ name: zeroshot/twitter-financial-news-topic
51
+ type: zeroshot/twitter-financial-news-topic
52
+ config: zeroshot--twitter-financial-news-topic
53
+ split: train
54
+ metrics:
55
+ - type: rouge
56
+ value: 0.1417
57
+ name: ROUGE-1
58
+ verified: true
59
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjBlMjM1ZDcyMTNhYzQ3ZGQ3ZTQ3NWU5ZjdlOGE5ZTQ0Y2M2MzQxNmQyYzExNTI2NmYyZDhlOTBkNGE1ZjZkOCIsInZlcnNpb24iOjF9.9oRRqFP_0m4RNBeAkMtjtpo5Qbg9Go6WpHkywD-ZeP9V67tc915Wi7Z_sKaR3R5-uXixoNc6lY3k2RR_dgtaBw
60
+ - type: rouge
61
+ value: 0.0
62
+ name: ROUGE-2
63
+ verified: true
64
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWYzNWViZGU5Nzk3MjVlY2NiMjhhYjVlM2NjZmNiYjc2MjM1MGQ4ODU3MTU0MWEyODA5MmQxOGRhYjgxMDEzOCIsInZlcnNpb24iOjF9.poDIKaa62hgX9-zqX_nrxg4C9E5TO9Mv8gZUB-yCBXksHQwulJs-qUWeOPBC_ljbx3gXnl4tsQvPb-AEK89UBg
65
+ - type: rouge
66
+ value: 0.1419
67
+ name: ROUGE-L
68
+ verified: true
69
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWMxY2FhNTA4NjhlZDc5ZGE2NDIxNzc2MDViOTdlYjMwOGJkYmYyMWYwNThmNGY2Y2JhNzg1MWU4ZWMzMzk4NiIsInZlcnNpb24iOjF9.bEExV9qd77EG_VsK_dei_VvFPpVQO7RbUcM6tpBT2p-F6GFHHM-qkTg9dlFGioMsvkYG2fPkqVGC9axJHZPWBA
70
+ - type: rouge
71
+ value: 0.1419
72
+ name: ROUGE-LSUM
73
+ verified: true
74
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGM5NThhNTZmMzI0ZGI3MjliOTVjMjRjMWQwN2M3ODc1ZDMzYjE4MjM0MjJmOGU4MmU1M2VmNDFhN2FmMmFhYSIsInZlcnNpb24iOjF9.g92nWsqfFVjjDYWk579gk7ZpMWpFaof8AIhCiq7JMU6pTvki7og5T00de9iYGmmeGpvaj1L5kYnXXYvV9XAQAA
75
+ - type: loss
76
+ value: 7.505679607391357
77
+ name: loss
78
+ verified: true
79
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGJmMzM2ZDg0ZmM1Nzg2Mjg0ZWNiNmEyMjVhMWVjZWZiODQ0ZjRhY2MxMDZhZWM4YzRkMWFiMmMxYmNmZWZkNiIsInZlcnNpb24iOjF9.Dg6RYEe6lyprc9M-i1M05UJ9VKdvWmeBDgA70Z73XIIrRpxFnVe1EPUEUfIom6-lo7NwLsWCkXsFxpzkIArzBA
80
+ - type: gen_len
81
+ value: 70.49
82
+ name: gen_len
83
  verified: true
84
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTYwYWY2NTkwNGM4MTdlYjFhMTY0NDIzNjUyYmJjZDhlNDY5YzYwZDdiNGE4NDA0ZTcyMjViMWI2YjYyZjE2OCIsInZlcnNpb24iOjF9.uscCJgF6ZGrWa8lqjaVHR3X6xEa50ipzFMkjyK1s7U3jZnF5IfzpoApLAgVSuNMeSCl2lySCE73iDCYPE2b-Bg
85
  ---
86
  # BART (large-sized model), fine-tuned on CNN Daily Mail
87