Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

#4
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -285,6 +285,39 @@ model-index:
285
  type: gen_len
286
  value: 179.2184
287
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
288
  ---
289
 
290
  # pszemraj/pegasus-x-large-book-summary
 
285
  type: gen_len
286
  value: 179.2184
287
  verified: true
288
+ - task:
289
+ type: summarization
290
+ name: Summarization
291
+ dataset:
292
+ name: kmfoda/booksum
293
+ type: kmfoda/booksum
294
+ config: kmfoda--booksum
295
+ split: test
296
+ metrics:
297
+ - name: ROUGE-1
298
+ type: rouge
299
+ value: 35.2154
300
+ verified: true
301
+ - name: ROUGE-2
302
+ type: rouge
303
+ value: 6.8702
304
+ verified: true
305
+ - name: ROUGE-L
306
+ type: rouge
307
+ value: 17.6693
308
+ verified: true
309
+ - name: ROUGE-LSUM
310
+ type: rouge
311
+ value: 32.8365
312
+ verified: true
313
+ - name: loss
314
+ type: loss
315
+ value: 2.9878039360046387
316
+ verified: true
317
+ - name: gen_len
318
+ type: gen_len
319
+ value: 200.6785
320
+ verified: true
321
  ---
322
 
323
  # pszemraj/pegasus-x-large-book-summary