lewtun HF staff commited on
Commit
a4f2c72
1 Parent(s): f065021

Add evaluation results on the default config of billsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config of the [billsum](https://huggingface.co/datasets/billsum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-billsum-18299d18-11955600).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=billsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=billsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -274,6 +274,39 @@ model-index:
274
  type: gen_len
275
  value: 231.0762
276
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
277
  ---
278
 
279
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization
 
274
  type: gen_len
275
  value: 231.0762
276
  verified: true
277
+ - task:
278
+ type: summarization
279
+ name: Summarization
280
+ dataset:
281
+ name: billsum
282
+ type: billsum
283
+ config: default
284
+ split: test
285
+ metrics:
286
+ - name: ROUGE-1
287
+ type: rouge
288
+ value: 36.8502
289
+ verified: true
290
+ - name: ROUGE-2
291
+ type: rouge
292
+ value: 15.9147
293
+ verified: true
294
+ - name: ROUGE-L
295
+ type: rouge
296
+ value: 23.4762
297
+ verified: true
298
+ - name: ROUGE-LSUM
299
+ type: rouge
300
+ value: 30.9597
301
+ verified: true
302
+ - name: loss
303
+ type: loss
304
+ value: 3.878790855407715
305
+ verified: true
306
+ - name: gen_len
307
+ type: gen_len
308
+ value: 131.3622
309
+ verified: true
310
  ---
311
 
312
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization