lewtun HF staff commited on
Commit
a1b915d
1 Parent(s): 333b18a

Add evaluation results on the samsum config and test split of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config and test split of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-samsum-samsum-89ef9c-1465453967).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -182,6 +182,42 @@ parameters:
182
  length_penalty: 0.3
183
  encoder_no_repeat_ngram_size: 3
184
  num_beams: 4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
185
  ---
186
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
187
 
 
182
  length_penalty: 0.3
183
  encoder_no_repeat_ngram_size: 3
184
  num_beams: 4
185
+ model-index:
186
+ - name: pszemraj/long-t5-tglobal-base-16384-booksum-V12
187
+ results:
188
+ - task:
189
+ type: summarization
190
+ name: Summarization
191
+ dataset:
192
+ name: samsum
193
+ type: samsum
194
+ config: samsum
195
+ split: test
196
+ metrics:
197
+ - name: ROUGE-1
198
+ type: rouge
199
+ value: 30.0032
200
+ verified: true
201
+ - name: ROUGE-2
202
+ type: rouge
203
+ value: 7.2671
204
+ verified: true
205
+ - name: ROUGE-L
206
+ type: rouge
207
+ value: 21.8779
208
+ verified: true
209
+ - name: ROUGE-LSUM
210
+ type: rouge
211
+ value: 26.4371
212
+ verified: true
213
+ - name: loss
214
+ type: loss
215
+ value: 2.6383285522460938
216
+ verified: true
217
+ - name: gen_len
218
+ type: gen_len
219
+ value: 54.2357
220
+ verified: true
221
  ---
222
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
223