lewtun HF staff commited on
Commit
b59683a
1 Parent(s): 46c9910

Add evaluation results on the y config and test split of big_patent

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the y config and test split of the [big_patent](https://huggingface.co/datasets/big_patent) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-big_patent-y-3c6f0a-1465253965).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=big_patent).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=big_patent).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -284,6 +284,39 @@ model-index:
284
  type: gen_len
285
  value: 239.4179
286
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
287
  ---
288
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
289
 
 
284
  type: gen_len
285
  value: 239.4179
286
  verified: true
287
+ - task:
288
+ type: summarization
289
+ name: Summarization
290
+ dataset:
291
+ name: big_patent
292
+ type: big_patent
293
+ config: y
294
+ split: test
295
+ metrics:
296
+ - name: ROUGE-1
297
+ type: rouge
298
+ value: 35.615
299
+ verified: true
300
+ - name: ROUGE-2
301
+ type: rouge
302
+ value: 8.2625
303
+ verified: true
304
+ - name: ROUGE-L
305
+ type: rouge
306
+ value: 19.9883
307
+ verified: true
308
+ - name: ROUGE-LSUM
309
+ type: rouge
310
+ value: 30.1801
311
+ verified: true
312
+ - name: loss
313
+ type: loss
314
+ value: 2.8106656074523926
315
+ verified: true
316
+ - name: gen_len
317
+ type: gen_len
318
+ value: 170.3483
319
+ verified: true
320
  ---
321
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
322