lewtun HF staff commited on
Commit
643e7e3
1 Parent(s): 2f6950d

Add evaluation results on the samsum config and test split of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config and test split of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-samsum-samsum-b534aa-1519254997).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -183,6 +183,42 @@ parameters:
183
  repetition_penalty: 3.5
184
  encoder_no_repeat_ngram_size: 3
185
  num_beams: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
186
  ---
187
 
188
  # pszemraj/pegasus-x-large-book-summary
 
183
  repetition_penalty: 3.5
184
  encoder_no_repeat_ngram_size: 3
185
  num_beams: 1
186
+ model-index:
187
+ - name: pszemraj/pegasus-x-large-book-summary
188
+ results:
189
+ - task:
190
+ type: summarization
191
+ name: Summarization
192
+ dataset:
193
+ name: samsum
194
+ type: samsum
195
+ config: samsum
196
+ split: test
197
+ metrics:
198
+ - name: ROUGE-1
199
+ type: rouge
200
+ value: 33.1401
201
+ verified: true
202
+ - name: ROUGE-2
203
+ type: rouge
204
+ value: 9.3095
205
+ verified: true
206
+ - name: ROUGE-L
207
+ type: rouge
208
+ value: 24.8552
209
+ verified: true
210
+ - name: ROUGE-LSUM
211
+ type: rouge
212
+ value: 29.0391
213
+ verified: true
214
+ - name: loss
215
+ type: loss
216
+ value: 2.288182497024536
217
+ verified: true
218
+ - name: gen_len
219
+ type: gen_len
220
+ value: 45.2173
221
+ verified: true
222
  ---
223
 
224
  # pszemraj/pegasus-x-large-book-summary