lewtun HF staff commited on
Commit
3ee105e
1 Parent(s): 9d87686

Add evaluation results on the default config of xsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config of the [xsum](https://huggingface.co/datasets/xsum) dataset by

@grapplerulrich

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-xsum-5cb1ece5-12895721).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -45,6 +45,39 @@ model-index:
45
  type: gen_len
46
  value: 209.2537
47
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
  ---
49
 
50
  # BigBirdPegasus model (large)
 
45
  type: gen_len
46
  value: 209.2537
47
  verified: true
48
+ - task:
49
+ type: summarization
50
+ name: Summarization
51
+ dataset:
52
+ name: xsum
53
+ type: xsum
54
+ config: default
55
+ split: test
56
+ metrics:
57
+ - name: ROUGE-1
58
+ type: rouge
59
+ value: 4.9787
60
+ verified: true
61
+ - name: ROUGE-2
62
+ type: rouge
63
+ value: 0.3527
64
+ verified: true
65
+ - name: ROUGE-L
66
+ type: rouge
67
+ value: 4.3679
68
+ verified: true
69
+ - name: ROUGE-LSUM
70
+ type: rouge
71
+ value: 4.1723
72
+ verified: true
73
+ - name: loss
74
+ type: loss
75
+ value: .nan
76
+ verified: true
77
+ - name: gen_len
78
+ type: gen_len
79
+ value: 230.4886
80
+ verified: true
81
  ---
82
 
83
  # BigBirdPegasus model (large)