autoevaluator HF staff commited on
Commit
54efacd
1 Parent(s): 5fe7804

Add evaluation results on the default config and test split of billsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config and test split of the [billsum](https://huggingface.co/datasets/billsum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-billsum-default-dd03f7-1519455003).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=billsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=billsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -252,6 +252,39 @@ model-index:
252
  type: gen_len
253
  value: 212.8243
254
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
255
  ---
256
 
257
  # pszemraj/pegasus-x-large-book-summary
 
252
  type: gen_len
253
  value: 212.8243
254
  verified: true
255
+ - task:
256
+ type: summarization
257
+ name: Summarization
258
+ dataset:
259
+ name: billsum
260
+ type: billsum
261
+ config: default
262
+ split: test
263
+ metrics:
264
+ - name: ROUGE-1
265
+ type: rouge
266
+ value: 42.1065
267
+ verified: true
268
+ - name: ROUGE-2
269
+ type: rouge
270
+ value: 15.4079
271
+ verified: true
272
+ - name: ROUGE-L
273
+ type: rouge
274
+ value: 24.8814
275
+ verified: true
276
+ - name: ROUGE-LSUM
277
+ type: rouge
278
+ value: 36.0375
279
+ verified: true
280
+ - name: loss
281
+ type: loss
282
+ value: 1.9130958318710327
283
+ verified: true
284
+ - name: gen_len
285
+ type: gen_len
286
+ value: 179.2184
287
+ verified: true
288
  ---
289
 
290
  # pszemraj/pegasus-x-large-book-summary