lewtun HF staff commited on
Commit
d1011b1
1 Parent(s): be91696

Add evaluation results on the kmfoda--booksum config of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-kmfoda__booksum-e703e34d-10975474).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -242,6 +242,39 @@ model-index:
242
  type: gen_len
243
  value: 81.4964
244
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
245
  ---
246
 
247
  # long-t5-tglobal-base-16384 + BookSum
 
242
  type: gen_len
243
  value: 81.4964
244
  verified: true
245
+ - task:
246
+ type: summarization
247
+ name: Summarization
248
+ dataset:
249
+ name: kmfoda/booksum
250
+ type: kmfoda/booksum
251
+ config: kmfoda--booksum
252
+ split: test
253
+ metrics:
254
+ - name: ROUGE-1
255
+ type: rouge
256
+ value: 36.2047
257
+ verified: true
258
+ - name: ROUGE-2
259
+ type: rouge
260
+ value: 6.0472
261
+ verified: true
262
+ - name: ROUGE-L
263
+ type: rouge
264
+ value: 16.616
265
+ verified: true
266
+ - name: ROUGE-LSUM
267
+ type: rouge
268
+ value: 33.172
269
+ verified: true
270
+ - name: loss
271
+ type: loss
272
+ value: .nan
273
+ verified: true
274
+ - name: gen_len
275
+ type: gen_len
276
+ value: 248.7994
277
+ verified: true
278
  ---
279
 
280
  # long-t5-tglobal-base-16384 + BookSum