lewtun HF staff commited on
Commit
0e8e3c5
1 Parent(s): 3f3246b

Add evaluation results on the autoevaluate--xsum-sample config of autoevaluate/xsum-sample

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the autoevaluate--xsum-sample config of the [autoevaluate/xsum-sample](https://huggingface.co/datasets/autoevaluate/xsum-sample) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-2dc683ab-6695-42ab-9eff-11dad91952e1-2415).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=autoevaluate/xsum-sample).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=autoevaluate/xsum-sample).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -20,6 +20,39 @@ model-index:
20
  - name: Rouge1
21
  type: rouge
22
  value: 23.9405
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ---
24
 
25
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
20
  - name: Rouge1
21
  type: rouge
22
  value: 23.9405
23
+ - task:
24
+ type: summarization
25
+ name: Summarization
26
+ dataset:
27
+ name: autoevaluate/xsum-sample
28
+ type: autoevaluate/xsum-sample
29
+ config: autoevaluate--xsum-sample
30
+ split: test
31
+ metrics:
32
+ - name: ROUGE-1
33
+ type: rouge
34
+ value: 18.3205
35
+ verified: true
36
+ - name: ROUGE-2
37
+ type: rouge
38
+ value: 3.0568
39
+ verified: true
40
+ - name: ROUGE-L
41
+ type: rouge
42
+ value: 14.8435
43
+ verified: true
44
+ - name: ROUGE-LSUM
45
+ type: rouge
46
+ value: 14.8142
47
+ verified: true
48
+ - name: loss
49
+ type: loss
50
+ value: 3.0104541778564453
51
+ verified: true
52
+ - name: gen_len
53
+ type: gen_len
54
+ value: 18.05
55
+ verified: true
56
  ---
57
 
58
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You