Add evaluation results on the document config and test split of ccdv/arxiv-summarization

#5
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -284,6 +284,39 @@ model-index:
284
  type: gen_len
285
  value: 239.4179
286
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
287
  ---
288
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
289
 
 
284
  type: gen_len
285
  value: 239.4179
286
  verified: true
287
+ - task:
288
+ type: summarization
289
+ name: Summarization
290
+ dataset:
291
+ name: ccdv/arxiv-summarization
292
+ type: ccdv/arxiv-summarization
293
+ config: document
294
+ split: test
295
+ metrics:
296
+ - name: ROUGE-1
297
+ type: rouge
298
+ value: 36.2876
299
+ verified: true
300
+ - name: ROUGE-2
301
+ type: rouge
302
+ value: 8.0921
303
+ verified: true
304
+ - name: ROUGE-L
305
+ type: rouge
306
+ value: 19.0887
307
+ verified: true
308
+ - name: ROUGE-LSUM
309
+ type: rouge
310
+ value: 32.3614
311
+ verified: true
312
+ - name: loss
313
+ type: loss
314
+ value: 2.850468635559082
315
+ verified: true
316
+ - name: gen_len
317
+ type: gen_len
318
+ value: 163.5443
319
+ verified: true
320
  ---
321
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
322