lewtun HF staff commited on
Commit
e9c278b
1 Parent(s): c313858

Add evaluation results on the plain_text config and test split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-1abd3a-16146234).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -195,6 +195,39 @@ model-index:
195
  type: gen_len
196
  value: 254.3676
197
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
198
  ---
199
 
200
 
 
195
  type: gen_len
196
  value: 254.3676
197
  verified: true
198
+ - task:
199
+ type: summarization
200
+ name: Summarization
201
+ dataset:
202
+ name: launch/gov_report
203
+ type: launch/gov_report
204
+ config: plain_text
205
+ split: test
206
+ metrics:
207
+ - name: ROUGE-1
208
+ type: rouge
209
+ value: 40.015
210
+ verified: true
211
+ - name: ROUGE-2
212
+ type: rouge
213
+ value: 10.7406
214
+ verified: true
215
+ - name: ROUGE-L
216
+ type: rouge
217
+ value: 20.1344
218
+ verified: true
219
+ - name: ROUGE-LSUM
220
+ type: rouge
221
+ value: 36.7743
222
+ verified: true
223
+ - name: loss
224
+ type: loss
225
+ value: 3.8273396492004395
226
+ verified: true
227
+ - name: gen_len
228
+ type: gen_len
229
+ value: 228.1285
230
+ verified: true
231
  ---
232
 
233