pszemraj autoevaluator HF staff commited on
Commit
9e0c825
1 Parent(s): e1f2529

Add evaluation results on the 3.0.0 config of cnn_dailymail (#4)

Browse files

- Add evaluation results on the 3.0.0 config of cnn_dailymail (e570e5a198015a6dc0bea95fd4f3352eb91efd3a)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -283,6 +283,39 @@ model-index:
283
  type: gen_len
284
  value: 27.4815
285
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
286
  ---
287
 
288
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
283
  type: gen_len
284
  value: 27.4815
285
  verified: true
286
+ - task:
287
+ type: summarization
288
+ name: Summarization
289
+ dataset:
290
+ name: cnn_dailymail
291
+ type: cnn_dailymail
292
+ config: 3.0.0
293
+ split: test
294
+ metrics:
295
+ - name: ROUGE-1
296
+ type: rouge
297
+ value: 27.5692
298
+ verified: true
299
+ - name: ROUGE-2
300
+ type: rouge
301
+ value: 6.1264
302
+ verified: true
303
+ - name: ROUGE-L
304
+ type: rouge
305
+ value: 17.1127
306
+ verified: true
307
+ - name: ROUGE-LSUM
308
+ type: rouge
309
+ value: 23.0066
310
+ verified: true
311
+ - name: loss
312
+ type: loss
313
+ value: 2.218526601791382
314
+ verified: true
315
+ - name: gen_len
316
+ type: gen_len
317
+ value: 39.1952
318
+ verified: true
319
  ---
320
 
321
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2