Add evaluation results on the default config and test split of billsum

#4
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -251,6 +251,39 @@ model-index:
251
  type: gen_len
252
  value: 201.5951
253
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
254
  ---
255
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
256
 
 
251
  type: gen_len
252
  value: 201.5951
253
  verified: true
254
+ - task:
255
+ type: summarization
256
+ name: Summarization
257
+ dataset:
258
+ name: billsum
259
+ type: billsum
260
+ config: default
261
+ split: test
262
+ metrics:
263
+ - name: ROUGE-1
264
+ type: rouge
265
+ value: 39.1441
266
+ verified: true
267
+ - name: ROUGE-2
268
+ type: rouge
269
+ value: 12.5747
270
+ verified: true
271
+ - name: ROUGE-L
272
+ type: rouge
273
+ value: 22.6354
274
+ verified: true
275
+ - name: ROUGE-LSUM
276
+ type: rouge
277
+ value: 32.7358
278
+ verified: true
279
+ - name: loss
280
+ type: loss
281
+ value: 1.9654552936553955
282
+ verified: true
283
+ - name: gen_len
284
+ type: gen_len
285
+ value: 152.1753
286
+ verified: true
287
  ---
288
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
289