lewtun HF staff commited on
Commit
5c4eaa3
1 Parent(s): 46c9910

Add evaluation results on the document config and test split of ccdv/arxiv-summarization

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the document config and test split of the [ccdv/arxiv-summarization](https://huggingface.co/datasets/ccdv/arxiv-summarization) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-ccdv__arxiv-summarization-document-47d12e-1465753970).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=ccdv/arxiv-summarization).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=ccdv/arxiv-summarization).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -284,6 +284,39 @@ model-index:
284
  type: gen_len
285
  value: 239.4179
286
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
287
  ---
288
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
289
 
 
284
  type: gen_len
285
  value: 239.4179
286
  verified: true
287
+ - task:
288
+ type: summarization
289
+ name: Summarization
290
+ dataset:
291
+ name: ccdv/arxiv-summarization
292
+ type: ccdv/arxiv-summarization
293
+ config: document
294
+ split: test
295
+ metrics:
296
+ - name: ROUGE-1
297
+ type: rouge
298
+ value: 36.2876
299
+ verified: true
300
+ - name: ROUGE-2
301
+ type: rouge
302
+ value: 8.0921
303
+ verified: true
304
+ - name: ROUGE-L
305
+ type: rouge
306
+ value: 19.0887
307
+ verified: true
308
+ - name: ROUGE-LSUM
309
+ type: rouge
310
+ value: 32.3614
311
+ verified: true
312
+ - name: loss
313
+ type: loss
314
+ value: 2.850468635559082
315
+ verified: true
316
+ - name: gen_len
317
+ type: gen_len
318
+ value: 163.5443
319
+ verified: true
320
  ---
321
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
322