autoevaluator HF staff commited on
Commit
15c2210
1 Parent(s): e5a7b83

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config and test split of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-kmfoda__booksum-kmfoda__booksum-e42237-1523455078).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -285,6 +285,39 @@ model-index:
285
  type: gen_len
286
  value: 179.2184
287
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
288
  ---
289
 
290
  # pszemraj/pegasus-x-large-book-summary
 
285
  type: gen_len
286
  value: 179.2184
287
  verified: true
288
+ - task:
289
+ type: summarization
290
+ name: Summarization
291
+ dataset:
292
+ name: kmfoda/booksum
293
+ type: kmfoda/booksum
294
+ config: kmfoda--booksum
295
+ split: test
296
+ metrics:
297
+ - name: ROUGE-1
298
+ type: rouge
299
+ value: 35.2154
300
+ verified: true
301
+ - name: ROUGE-2
302
+ type: rouge
303
+ value: 6.8702
304
+ verified: true
305
+ - name: ROUGE-L
306
+ type: rouge
307
+ value: 17.6693
308
+ verified: true
309
+ - name: ROUGE-LSUM
310
+ type: rouge
311
+ value: 32.8365
312
+ verified: true
313
+ - name: loss
314
+ type: loss
315
+ value: 2.9878039360046387
316
+ verified: true
317
+ - name: gen_len
318
+ type: gen_len
319
+ value: 200.6785
320
+ verified: true
321
  ---
322
 
323
  # pszemraj/pegasus-x-large-book-summary