Add evaluation results on the default config and test split of billsum

#3
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -252,6 +252,39 @@ model-index:
252
  type: gen_len
253
  value: 212.8243
254
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
255
  ---
256
 
257
  # pszemraj/pegasus-x-large-book-summary
 
252
  type: gen_len
253
  value: 212.8243
254
  verified: true
255
+ - task:
256
+ type: summarization
257
+ name: Summarization
258
+ dataset:
259
+ name: billsum
260
+ type: billsum
261
+ config: default
262
+ split: test
263
+ metrics:
264
+ - name: ROUGE-1
265
+ type: rouge
266
+ value: 42.1065
267
+ verified: true
268
+ - name: ROUGE-2
269
+ type: rouge
270
+ value: 15.4079
271
+ verified: true
272
+ - name: ROUGE-L
273
+ type: rouge
274
+ value: 24.8814
275
+ verified: true
276
+ - name: ROUGE-LSUM
277
+ type: rouge
278
+ value: 36.0375
279
+ verified: true
280
+ - name: loss
281
+ type: loss
282
+ value: 1.9130958318710327
283
+ verified: true
284
+ - name: gen_len
285
+ type: gen_len
286
+ value: 179.2184
287
+ verified: true
288
  ---
289
 
290
  # pszemraj/pegasus-x-large-book-summary