Add evaluation results on the plain_text config and test split of launch/gov_report

#5
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -115,6 +115,39 @@ model-index:
115
  type: gen_len
116
  value: 96.2584
117
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
118
  ---
119
 
120
 
 
115
  type: gen_len
116
  value: 96.2584
117
  verified: true
118
+ - task:
119
+ type: summarization
120
+ name: Summarization
121
+ dataset:
122
+ name: launch/gov_report
123
+ type: launch/gov_report
124
+ config: plain_text
125
+ split: test
126
+ metrics:
127
+ - name: ROUGE-1
128
+ type: rouge
129
+ value: 37.3609
130
+ verified: true
131
+ - name: ROUGE-2
132
+ type: rouge
133
+ value: 8.6943
134
+ verified: true
135
+ - name: ROUGE-L
136
+ type: rouge
137
+ value: 17.9106
138
+ verified: true
139
+ - name: ROUGE-LSUM
140
+ type: rouge
141
+ value: 33.8022
142
+ verified: true
143
+ - name: loss
144
+ type: loss
145
+ value: 3.4974069595336914
146
+ verified: true
147
+ - name: gen_len
148
+ type: gen_len
149
+ value: 243.3453
150
+ verified: true
151
  ---
152
 
153