lewtun HF staff commited on
Commit
33290d8
1 Parent(s): de82de5

Add evaluation results on the samsum config of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-samsum-f90fd7b5-10915466).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -210,6 +210,39 @@ model-index:
210
  type: gen_len
211
  value: 154.9036
212
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
213
  ---
214
 
215
  # Longformer Encoder-Decoder (LED) fine-tuned on Booksum
 
210
  type: gen_len
211
  value: 154.9036
212
  verified: true
213
+ - task:
214
+ type: summarization
215
+ name: Summarization
216
+ dataset:
217
+ name: samsum
218
+ type: samsum
219
+ config: samsum
220
+ split: test
221
+ metrics:
222
+ - name: ROUGE-1
223
+ type: rouge
224
+ value: 33.4514
225
+ verified: true
226
+ - name: ROUGE-2
227
+ type: rouge
228
+ value: 10.3718
229
+ verified: true
230
+ - name: ROUGE-L
231
+ type: rouge
232
+ value: 24.5432
233
+ verified: true
234
+ - name: ROUGE-LSUM
235
+ type: rouge
236
+ value: 29.7913
237
+ verified: true
238
+ - name: loss
239
+ type: loss
240
+ value: 4.176078796386719
241
+ verified: true
242
+ - name: gen_len
243
+ type: gen_len
244
+ value: 65.4005
245
+ verified: true
246
  ---
247
 
248
  # Longformer Encoder-Decoder (LED) fine-tuned on Booksum