lewtun HF staff commited on
Commit
3232eab
1 Parent(s): adae8ac

Add evaluation results on the samsum config of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-samsum-f4288f9c-10925467).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -205,6 +205,39 @@ model-index:
205
  type: gen_len
206
  value: 191.9783
207
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
208
  ---
209
 
210
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization
 
205
  type: gen_len
206
  value: 191.9783
207
  verified: true
208
+ - task:
209
+ type: summarization
210
+ name: Summarization
211
+ dataset:
212
+ name: samsum
213
+ type: samsum
214
+ config: samsum
215
+ split: test
216
+ metrics:
217
+ - name: ROUGE-1
218
+ type: rouge
219
+ value: 32.0048
220
+ verified: true
221
+ - name: ROUGE-2
222
+ type: rouge
223
+ value: 10.0862
224
+ verified: true
225
+ - name: ROUGE-L
226
+ type: rouge
227
+ value: 23.6564
228
+ verified: true
229
+ - name: ROUGE-LSUM
230
+ type: rouge
231
+ value: 28.8011
232
+ verified: true
233
+ - name: loss
234
+ type: loss
235
+ value: 2.903024673461914
236
+ verified: true
237
+ - name: gen_len
238
+ type: gen_len
239
+ value: 60.7411
240
+ verified: true
241
  ---
242
 
243
  # Longformer Encoder-Decoder (LED) for Narrative-Esque Long Text Summarization