Add evaluation results on the samsum config of samsum

#3
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -210,6 +210,39 @@ model-index:
210
  type: gen_len
211
  value: 154.9036
212
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
213
  ---
214
 
215
  # Longformer Encoder-Decoder (LED) fine-tuned on Booksum
 
210
  type: gen_len
211
  value: 154.9036
212
  verified: true
213
+ - task:
214
+ type: summarization
215
+ name: Summarization
216
+ dataset:
217
+ name: samsum
218
+ type: samsum
219
+ config: samsum
220
+ split: test
221
+ metrics:
222
+ - name: ROUGE-1
223
+ type: rouge
224
+ value: 33.4514
225
+ verified: true
226
+ - name: ROUGE-2
227
+ type: rouge
228
+ value: 10.3718
229
+ verified: true
230
+ - name: ROUGE-L
231
+ type: rouge
232
+ value: 24.5432
233
+ verified: true
234
+ - name: ROUGE-LSUM
235
+ type: rouge
236
+ value: 29.7913
237
+ verified: true
238
+ - name: loss
239
+ type: loss
240
+ value: 4.176078796386719
241
+ verified: true
242
+ - name: gen_len
243
+ type: gen_len
244
+ value: 65.4005
245
+ verified: true
246
  ---
247
 
248
  # Longformer Encoder-Decoder (LED) fine-tuned on Booksum