Add evaluation results on the plain_text config and test split of launch/gov_report

#11
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -416,6 +416,39 @@ model-index:
416
  type: gen_len
417
  value: 220.3747
418
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
419
  ---
420
 
421
  # long-t5-tglobal-base-16384 + BookSum
 
416
  type: gen_len
417
  value: 220.3747
418
  verified: true
419
+ - task:
420
+ type: summarization
421
+ name: Summarization
422
+ dataset:
423
+ name: launch/gov_report
424
+ type: launch/gov_report
425
+ config: plain_text
426
+ split: test
427
+ metrics:
428
+ - name: ROUGE-1
429
+ type: rouge
430
+ value: 37.4438
431
+ verified: true
432
+ - name: ROUGE-2
433
+ type: rouge
434
+ value: 8.2907
435
+ verified: true
436
+ - name: ROUGE-L
437
+ type: rouge
438
+ value: 17.6893
439
+ verified: true
440
+ - name: ROUGE-LSUM
441
+ type: rouge
442
+ value: 33.7141
443
+ verified: true
444
+ - name: loss
445
+ type: loss
446
+ value: 2.5776000022888184
447
+ verified: true
448
+ - name: gen_len
449
+ type: gen_len
450
+ value: 214.9692
451
+ verified: true
452
  ---
453
 
454
  # long-t5-tglobal-base-16384 + BookSum