File size: 23,582 Bytes
736eb1d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
---
license: apache-2.0
base_model: facebook/wav2vec2-large-xlsr-53
tags:
- generated_from_trainer
metrics:
- wer
model-index:
- name: wav2vec2-large-xlsr-geo-demo
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-large-xlsr-geo-demo

This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1636
- Wer: 0.4438

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.002
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 200
- num_epochs: 5

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Wer    |
|:-------------:|:-----:|:-----:|:---------------:|:------:|
| 7.887         | 0.03  | 100   | 3.6607          | 1.0    |
| 4.0646        | 0.05  | 200   | 3.1735          | 1.0    |
| 3.7509        | 0.08  | 300   | 3.2336          | 1.0    |
| 3.8832        | 0.11  | 400   | 3.1474          | 1.0    |
| 3.9646        | 0.14  | 500   | 3.3345          | 1.0    |
| 3.1657        | 0.16  | 600   | 3.0552          | 1.0    |
| 3.0641        | 0.19  | 700   | 3.0919          | 1.0    |
| 1.9443        | 0.22  | 800   | 1.5124          | 1.0    |
| 0.6772        | 0.25  | 900   | 0.6392          | 0.8845 |
| 0.5144        | 0.27  | 1000  | 0.4253          | 0.7256 |
| 0.4361        | 0.3   | 1100  | 0.3405          | 0.6596 |
| 0.4239        | 0.33  | 1200  | 0.2857          | 0.5969 |
| 0.3226        | 0.36  | 1300  | 0.2790          | 0.5880 |
| 0.3508        | 0.38  | 1400  | 0.2492          | 0.5586 |
| 0.3091        | 0.41  | 1500  | 0.2572          | 0.5655 |
| 0.3094        | 0.44  | 1600  | 0.2238          | 0.5122 |
| 0.305         | 0.47  | 1700  | 0.2339          | 0.5011 |
| 0.258         | 0.49  | 1800  | 0.2067          | 0.5008 |
| 0.2673        | 0.52  | 1900  | 0.2201          | 0.5077 |
| 0.2256        | 0.55  | 2000  | 0.1871          | 0.4633 |
| 0.2697        | 0.58  | 2100  | 0.1933          | 0.4696 |
| 0.233         | 0.6   | 2200  | 0.1835          | 0.4520 |
| 0.2078        | 0.63  | 2300  | 0.1761          | 0.4482 |
| 0.2721        | 0.66  | 2400  | 0.1742          | 0.4406 |
| 0.2807        | 0.69  | 2500  | 0.1717          | 0.4376 |
| 0.2397        | 0.71  | 2600  | 0.1788          | 0.4444 |
| 0.2672        | 0.74  | 2700  | 0.1534          | 0.4126 |
| 0.1954        | 0.77  | 2800  | 0.1593          | 0.4085 |
| 0.2753        | 0.79  | 2900  | 0.1575          | 0.4128 |
| 0.1975        | 0.82  | 3000  | 0.1435          | 0.3926 |
| 0.2282        | 0.85  | 3100  | 0.1702          | 0.4271 |
| 0.2372        | 0.88  | 3200  | 0.1417          | 0.3965 |
| 0.229         | 0.9   | 3300  | 0.1385          | 0.3860 |
| 0.2332        | 0.93  | 3400  | 0.1325          | 0.3805 |
| 0.2074        | 0.96  | 3500  | 0.1309          | 0.375  |
| 0.1937        | 0.99  | 3600  | 0.1306          | 0.3784 |
| 0.2211        | 1.01  | 3700  | 0.1402          | 0.3836 |
| 0.1928        | 1.04  | 3800  | 0.1339          | 0.3714 |
| 0.176         | 1.07  | 3900  | 0.1319          | 0.3743 |
| 0.1818        | 1.1   | 4000  | 0.1326          | 0.3760 |
| 0.2191        | 1.12  | 4100  | 0.1312          | 0.3768 |
| 0.1848        | 1.15  | 4200  | 0.1228          | 0.3599 |
| 0.1671        | 1.18  | 4300  | 0.1289          | 0.3731 |
| 0.1759        | 1.21  | 4400  | 0.1245          | 0.3632 |
| 0.1783        | 1.23  | 4500  | 0.1267          | 0.3545 |
| 0.1576        | 1.26  | 4600  | 0.1280          | 0.3581 |
| 0.1726        | 1.29  | 4700  | 0.1215          | 0.3541 |
| 0.1702        | 1.32  | 4800  | 0.1342          | 0.3690 |
| 0.2667        | 1.34  | 4900  | 0.1256          | 0.3635 |
| 0.232         | 1.37  | 5000  | 0.1228          | 0.3580 |
| 0.2012        | 1.4   | 5100  | 0.1183          | 0.3476 |
| 0.1862        | 1.42  | 5200  | 0.1210          | 0.3535 |
| 0.1947        | 1.45  | 5300  | 0.1241          | 0.3514 |
| 0.1806        | 1.48  | 5400  | 0.1151          | 0.3399 |
| 0.1779        | 1.51  | 5500  | 0.1127          | 0.3426 |
| 0.176         | 1.53  | 5600  | 0.1105          | 0.3446 |
| 0.1387        | 1.56  | 5700  | 0.1019          | 0.3301 |
| 0.1621        | 1.59  | 5800  | 0.1038          | 0.3309 |
| 0.1527        | 1.62  | 5900  | 0.1104          | 0.3398 |
| 0.1748        | 1.64  | 6000  | 0.1071          | 0.3348 |
| 0.165         | 1.67  | 6100  | 0.1092          | 0.3380 |
| 0.1384        | 1.7   | 6200  | 0.1063          | 0.3349 |
| 0.1859        | 1.73  | 6300  | 0.1058          | 0.3250 |
| 0.1919        | 1.75  | 6400  | 0.1080          | 0.3413 |
| 0.1425        | 1.78  | 6500  | 0.1050          | 0.3284 |
| 0.1571        | 1.81  | 6600  | 0.1002          | 0.3244 |
| 0.1591        | 1.84  | 6700  | 0.0999          | 0.3238 |
| 0.1615        | 1.86  | 6800  | 0.0961          | 0.3157 |
| 0.148         | 1.89  | 6900  | 0.0993          | 0.3197 |
| 0.1893        | 1.92  | 7000  | 0.0963          | 0.3219 |
| 0.1586        | 1.95  | 7100  | 0.0970          | 0.3227 |
| 0.1932        | 1.97  | 7200  | 0.0955          | 0.3200 |
| 0.172         | 2.0   | 7300  | 0.0930          | 0.3159 |
| 0.1617        | 2.03  | 7400  | 0.0972          | 0.3170 |
| 0.1644        | 2.06  | 7500  | 0.0923          | 0.3117 |
| 0.1098        | 2.08  | 7600  | 0.1001          | 0.3186 |
| 0.1456        | 2.11  | 7700  | 0.1028          | 0.3262 |
| 0.1518        | 2.14  | 7800  | 0.1018          | 0.3177 |
| 0.1485        | 2.16  | 7900  | 0.0986          | 0.3153 |
| 0.1411        | 2.19  | 8000  | 0.0938          | 0.3117 |
| 0.1439        | 2.22  | 8100  | 0.0937          | 0.3124 |
| 0.1469        | 2.25  | 8200  | 0.0919          | 0.3096 |
| 0.1476        | 2.27  | 8300  | 0.0939          | 0.3099 |
| 0.1678        | 2.3   | 8400  | 0.0926          | 0.3095 |
| 0.1705        | 2.33  | 8500  | 0.0973          | 0.3167 |
| 0.1323        | 2.36  | 8600  | 0.0910          | 0.3055 |
| 0.1258        | 2.38  | 8700  | 0.0872          | 0.3017 |
| 0.1536        | 2.41  | 8800  | 0.0963          | 0.3103 |
| 0.1628        | 2.44  | 8900  | 0.0871          | 0.3045 |
| 0.1504        | 2.47  | 9000  | 0.0898          | 0.3038 |
| 0.1301        | 2.49  | 9100  | 0.0856          | 0.2966 |
| 0.1488        | 2.52  | 9200  | 0.0846          | 0.2978 |
| 0.1621        | 2.55  | 9300  | 0.0855          | 0.3024 |
| 0.1453        | 2.58  | 9400  | 0.0830          | 0.2940 |
| 0.13          | 2.6   | 9500  | 0.0824          | 0.2920 |
| 0.1225        | 2.63  | 9600  | 0.0830          | 0.2920 |
| 0.1337        | 2.66  | 9700  | 0.0838          | 0.2914 |
| 0.1192        | 2.69  | 9800  | 0.0846          | 0.2992 |
| 0.1478        | 2.71  | 9900  | 0.0794          | 0.2921 |
| 0.1188        | 2.74  | 10000 | 0.0771          | 0.2875 |
| 0.2217        | 2.77  | 10100 | 0.0840          | 0.3002 |
| 0.1169        | 2.79  | 10200 | 0.0769          | 0.2876 |
| 0.1334        | 2.82  | 10300 | 0.0782          | 0.2875 |
| 0.1623        | 2.85  | 10400 | 0.0833          | 0.2948 |
| 0.2           | 2.88  | 10500 | 0.0772          | 0.2856 |
| 0.1288        | 2.9   | 10600 | 0.0773          | 0.2854 |
| 0.1201        | 2.93  | 10700 | 0.0782          | 0.2885 |
| 0.1467        | 2.96  | 10800 | 0.0778          | 0.2864 |
| 0.1452        | 2.99  | 10900 | 0.0747          | 0.2825 |
| 0.1182        | 3.01  | 11000 | 0.0759          | 0.2812 |
| 0.1078        | 3.04  | 11100 | 0.0744          | 0.2771 |
| 0.1426        | 3.07  | 11200 | 0.0797          | 0.2883 |
| 0.1322        | 3.1   | 11300 | 0.0765          | 0.2797 |
| 0.1655        | 3.12  | 11400 | 0.0743          | 0.2885 |
| 0.1243        | 3.15  | 11500 | 0.0744          | 0.2792 |
| 0.1724        | 3.18  | 11600 | 0.0749          | 0.2778 |
| 0.1136        | 3.21  | 11700 | 0.0730          | 0.2764 |
| 0.1428        | 3.23  | 11800 | 0.0776          | 0.2836 |
| 0.1189        | 3.26  | 11900 | 0.0788          | 0.2893 |
| 0.1065        | 3.29  | 12000 | 0.0732          | 0.2746 |
| 0.14          | 3.32  | 12100 | 0.0720          | 0.2756 |
| 2.7696        | 3.34  | 12200 | 2.8195          | 1.0    |
| 0.7388        | 3.37  | 12300 | 0.4293          | 0.7221 |
| 0.1829        | 3.4   | 12400 | 0.0925          | 0.2933 |
| 0.1534        | 3.42  | 12500 | 0.0794          | 0.2763 |
| 0.134         | 3.45  | 12600 | 0.0768          | 0.2719 |
| 0.1095        | 3.48  | 12700 | 0.0716          | 0.2641 |
| 0.1185        | 3.51  | 12800 | 0.0702          | 0.2603 |
| 0.6919        | 1.77  | 12900 | 0.5212          | 0.7533 |
| 0.6742        | 1.78  | 13000 | 0.7236          | 0.8849 |
| 0.7929        | 1.79  | 13100 | 0.6992          | 0.8898 |
| 0.6284        | 1.81  | 13200 | 0.6220          | 0.8438 |
| 0.5259        | 1.82  | 13300 | 0.6681          | 0.8442 |
| 0.6102        | 1.84  | 13400 | 0.6867          | 0.8975 |
| 0.6609        | 1.85  | 13500 | 0.7216          | 0.8682 |
| 0.5471        | 1.86  | 13600 | 0.7449          | 0.9033 |
| 0.5535        | 1.88  | 13700 | 0.5763          | 0.8305 |
| 0.5933        | 1.89  | 13800 | 0.6063          | 0.8677 |
| 0.6006        | 1.9   | 13900 | 0.5470          | 0.8033 |
| 0.6245        | 1.92  | 14000 | 0.6193          | 0.8423 |
| 0.469         | 1.93  | 14100 | 0.5840          | 0.8292 |
| 0.539         | 1.95  | 14200 | 0.5749          | 0.8211 |
| 0.6109        | 1.96  | 14300 | 0.6034          | 0.8475 |
| 0.4675        | 1.97  | 14400 | 0.5792          | 0.7991 |
| 0.4737        | 1.99  | 14500 | 0.5673          | 0.8333 |
| 0.6289        | 2.0   | 14600 | 0.5211          | 0.8101 |
| 0.5712        | 2.01  | 14700 | 0.5000          | 0.7945 |
| 0.9085        | 2.03  | 14800 | 0.5572          | 0.7913 |
| 0.5669        | 2.04  | 14900 | 0.5175          | 0.7903 |
| 0.4907        | 2.06  | 15000 | 0.5407          | 0.7994 |
| 0.6087        | 2.07  | 15100 | 0.5598          | 0.8134 |
| 0.6574        | 2.08  | 15200 | 0.5471          | 0.8014 |
| 0.5082        | 2.1   | 15300 | 0.5032          | 0.7930 |
| 0.5103        | 2.11  | 15400 | 0.5067          | 0.7894 |
| 0.4954        | 2.12  | 15500 | 0.5027          | 0.7716 |
| 0.5438        | 2.14  | 15600 | 0.5090          | 0.7783 |
| 0.4469        | 2.15  | 15700 | 0.4353          | 0.7355 |
| 0.4258        | 2.16  | 15800 | 0.4388          | 0.7353 |
| 0.6645        | 2.18  | 15900 | 0.5062          | 0.7839 |
| 0.4875        | 2.19  | 16000 | 0.4939          | 0.7813 |
| 0.5195        | 2.21  | 16100 | 0.4684          | 0.7653 |
| 0.5162        | 2.22  | 16200 | 0.4422          | 0.7387 |
| 0.4851        | 2.23  | 16300 | 0.4714          | 0.7619 |
| 0.536         | 2.25  | 16400 | 0.4778          | 0.7590 |
| 0.403         | 2.26  | 16500 | 0.4672          | 0.7729 |
| 0.4217        | 2.27  | 16600 | 0.4305          | 0.7329 |
| 0.4865        | 2.29  | 16700 | 0.4577          | 0.7367 |
| 0.4889        | 2.3   | 16800 | 0.4398          | 0.7282 |
| 0.4094        | 2.32  | 16900 | 0.4433          | 0.7245 |
| 0.4654        | 2.33  | 17000 | 0.4121          | 0.7143 |
| 0.394         | 2.34  | 17100 | 0.4642          | 0.7268 |
| 0.4595        | 2.36  | 17200 | 0.4076          | 0.7034 |
| 0.4463        | 2.37  | 17300 | 0.4477          | 0.7619 |
| 0.5096        | 2.38  | 17400 | 0.4394          | 0.7324 |
| 0.3934        | 2.4   | 17500 | 0.3927          | 0.7054 |
| 0.3766        | 2.41  | 17600 | 0.4442          | 0.7405 |
| 0.4216        | 2.42  | 17700 | 0.4131          | 0.6991 |
| 0.3822        | 2.44  | 17800 | 0.3996          | 0.7095 |
| 0.5685        | 2.45  | 17900 | 0.3785          | 0.6970 |
| 0.5032        | 2.47  | 18000 | 0.4015          | 0.7013 |
| 0.3936        | 2.48  | 18100 | 0.3789          | 0.6921 |
| 0.4129        | 2.49  | 18200 | 0.4374          | 0.7275 |
| 0.4559        | 2.51  | 18300 | 0.4613          | 0.7437 |
| 0.4168        | 2.52  | 18400 | 0.4183          | 0.7092 |
| 0.3521        | 2.53  | 18500 | 0.4058          | 0.7056 |
| 0.4208        | 2.55  | 18600 | 0.4373          | 0.7354 |
| 0.3918        | 2.56  | 18700 | 0.4257          | 0.7230 |
| 0.3886        | 2.58  | 18800 | 0.4144          | 0.7192 |
| 0.5022        | 2.59  | 18900 | 0.3865          | 0.6997 |
| 0.4236        | 2.6   | 19000 | 0.4095          | 0.7155 |
| 0.3934        | 2.62  | 19100 | 0.4137          | 0.7209 |
| 0.4274        | 2.63  | 19200 | 0.3846          | 0.6822 |
| 0.3991        | 2.64  | 19300 | 0.3732          | 0.6723 |
| 0.4125        | 2.66  | 19400 | 0.4050          | 0.6991 |
| 0.3494        | 2.67  | 19500 | 0.3714          | 0.6874 |
| 0.4416        | 2.69  | 19600 | 0.3762          | 0.6842 |
| 0.397         | 2.7   | 19700 | 0.3722          | 0.6821 |
| 0.4796        | 2.71  | 19800 | 0.3822          | 0.6959 |
| 0.3637        | 2.73  | 19900 | 0.3865          | 0.6979 |
| 0.4456        | 2.74  | 20000 | 0.3903          | 0.7038 |
| 0.3338        | 2.75  | 20100 | 0.3514          | 0.6549 |
| 0.3541        | 2.77  | 20200 | 0.3697          | 0.6782 |
| 0.4417        | 2.78  | 20300 | 0.3654          | 0.6810 |
| 0.3682        | 2.79  | 20400 | 0.3627          | 0.6613 |
| 0.3196        | 2.81  | 20500 | 0.3464          | 0.6650 |
| 0.3729        | 2.82  | 20600 | 0.3278          | 0.6508 |
| 0.3838        | 2.84  | 20700 | 0.3434          | 0.6576 |
| 0.3506        | 2.85  | 20800 | 0.3495          | 0.6607 |
| 0.3215        | 2.86  | 20900 | 0.3348          | 0.6416 |
| 0.3806        | 2.88  | 21000 | 0.3501          | 0.6777 |
| 0.311         | 2.89  | 21100 | 0.3374          | 0.6557 |
| 0.33          | 2.9   | 21200 | 0.3297          | 0.6425 |
| 0.3916        | 2.92  | 21300 | 0.3228          | 0.6373 |
| 0.3767        | 2.93  | 21400 | 0.3391          | 0.6497 |
| 0.3951        | 2.95  | 21500 | 0.4120          | 0.7108 |
| 0.3302        | 2.96  | 21600 | 0.3271          | 0.6309 |
| 0.3759        | 2.97  | 21700 | 0.3210          | 0.6293 |
| 0.3984        | 2.99  | 21800 | 0.3598          | 0.6565 |
| 0.3391        | 3.0   | 21900 | 0.3367          | 0.6470 |
| 0.3271        | 3.01  | 22000 | 0.3249          | 0.6352 |
| 0.3205        | 3.03  | 22100 | 0.3494          | 0.6461 |
| 0.3037        | 3.04  | 22200 | 0.3113          | 0.6191 |
| 0.3389        | 3.06  | 22300 | 0.3394          | 0.6502 |
| 0.3817        | 3.07  | 22400 | 0.3276          | 0.6282 |
| 0.3801        | 3.08  | 22500 | 0.3177          | 0.6243 |
| 0.4181        | 3.1   | 22600 | 0.2995          | 0.6091 |
| 0.2837        | 3.11  | 22700 | 0.3072          | 0.6150 |
| 0.3423        | 3.12  | 22800 | 0.3116          | 0.6108 |
| 0.32          | 3.14  | 22900 | 0.3129          | 0.6183 |
| 0.3138        | 3.15  | 23000 | 0.3026          | 0.6174 |
| 0.3693        | 3.16  | 23100 | 0.3104          | 0.6233 |
| 0.3765        | 3.18  | 23200 | 0.3196          | 0.6313 |
| 0.4339        | 3.19  | 23300 | 0.3126          | 0.6232 |
| 0.3197        | 3.21  | 23400 | 0.2984          | 0.5983 |
| 0.3411        | 3.22  | 23500 | 0.3056          | 0.6093 |
| 0.3468        | 3.23  | 23600 | 0.3094          | 0.6146 |
| 0.3297        | 3.25  | 23700 | 0.3033          | 0.6030 |
| 0.3018        | 3.26  | 23800 | 0.2849          | 0.5893 |
| 0.3119        | 3.27  | 23900 | 0.2944          | 0.6047 |
| 0.2679        | 3.29  | 24000 | 0.2866          | 0.5913 |
| 0.4425        | 3.3   | 24100 | 0.2977          | 0.6086 |
| 0.2961        | 3.32  | 24200 | 0.2930          | 0.6002 |
| 0.2888        | 3.33  | 24300 | 0.2752          | 0.5774 |
| 0.3084        | 3.34  | 24400 | 0.2890          | 0.5945 |
| 0.3406        | 3.36  | 24500 | 0.2922          | 0.6100 |
| 0.2947        | 3.37  | 24600 | 0.2909          | 0.6025 |
| 0.284         | 3.38  | 24700 | 0.2940          | 0.5920 |
| 0.2991        | 3.4   | 24800 | 0.2803          | 0.5776 |
| 0.3419        | 3.41  | 24900 | 0.2738          | 0.5698 |
| 0.3274        | 3.43  | 25000 | 0.2818          | 0.5925 |
| 0.2594        | 3.44  | 25100 | 0.2670          | 0.5710 |
| 0.3437        | 3.45  | 25200 | 0.2783          | 0.5734 |
| 0.2723        | 3.47  | 25300 | 0.2775          | 0.5868 |
| 0.2916        | 3.48  | 25400 | 0.2821          | 0.5867 |
| 0.2438        | 3.49  | 25500 | 0.2659          | 0.5658 |
| 0.3299        | 3.51  | 25600 | 0.2782          | 0.5855 |
| 0.3268        | 3.52  | 25700 | 0.2861          | 0.5814 |
| 0.2712        | 3.53  | 25800 | 0.2803          | 0.5814 |
| 0.3433        | 3.55  | 25900 | 0.2783          | 0.5810 |
| 0.3374        | 3.56  | 26000 | 0.2748          | 0.5731 |
| 0.3253        | 3.58  | 26100 | 0.2814          | 0.5848 |
| 0.2877        | 3.59  | 26200 | 0.2731          | 0.5705 |
| 0.3398        | 3.6   | 26300 | 0.2784          | 0.5903 |
| 0.3244        | 3.62  | 26400 | 0.2925          | 0.5857 |
| 0.3231        | 3.63  | 26500 | 0.2620          | 0.5661 |
| 0.2607        | 3.64  | 26600 | 0.2568          | 0.5646 |
| 0.306         | 3.66  | 26700 | 0.2654          | 0.5638 |
| 0.3182        | 3.67  | 26800 | 0.2722          | 0.5666 |
| 0.295         | 3.69  | 26900 | 0.2487          | 0.5453 |
| 0.2382        | 3.7   | 27000 | 0.2566          | 0.5526 |
| 0.2456        | 3.71  | 27100 | 0.2533          | 0.5636 |
| 0.2887        | 3.73  | 27200 | 0.2620          | 0.5743 |
| 0.2991        | 3.74  | 27300 | 0.2583          | 0.5570 |
| 0.2838        | 3.75  | 27400 | 0.2538          | 0.5534 |
| 0.2766        | 3.77  | 27500 | 0.2522          | 0.5561 |
| 0.2814        | 3.78  | 27600 | 0.2532          | 0.5573 |
| 0.2471        | 3.8   | 27700 | 0.2452          | 0.5452 |
| 0.2888        | 3.81  | 27800 | 0.2445          | 0.5365 |
| 0.2647        | 3.82  | 27900 | 0.2332          | 0.5324 |
| 0.2567        | 3.84  | 28000 | 0.2439          | 0.5468 |
| 0.2848        | 3.85  | 28100 | 0.2439          | 0.5375 |
| 0.2445        | 3.86  | 28200 | 0.2523          | 0.5485 |
| 0.2836        | 3.88  | 28300 | 0.2476          | 0.5408 |
| 0.2441        | 3.89  | 28400 | 0.2514          | 0.5511 |
| 0.272         | 3.9   | 28500 | 0.2340          | 0.5313 |
| 0.2746        | 3.92  | 28600 | 0.2454          | 0.5394 |
| 0.2637        | 3.93  | 28700 | 0.2484          | 0.5437 |
| 0.2889        | 3.95  | 28800 | 0.2344          | 0.5312 |
| 0.2733        | 3.96  | 28900 | 0.2261          | 0.5314 |
| 0.3967        | 3.97  | 29000 | 0.2547          | 0.5667 |
| 0.3052        | 3.99  | 29100 | 0.2227          | 0.5270 |
| 0.2849        | 4.0   | 29200 | 0.2272          | 0.5272 |
| 0.2446        | 4.01  | 29300 | 0.2286          | 0.5139 |
| 0.2553        | 4.03  | 29400 | 0.2294          | 0.5189 |
| 0.2948        | 4.04  | 29500 | 0.2477          | 0.5321 |
| 0.2541        | 4.06  | 29600 | 0.2302          | 0.5203 |
| 0.2361        | 4.07  | 29700 | 0.2228          | 0.5249 |
| 0.3058        | 4.08  | 29800 | 0.2272          | 0.5198 |
| 0.2584        | 4.1   | 29900 | 0.2225          | 0.5136 |
| 0.2686        | 4.11  | 30000 | 0.2353          | 0.5285 |
| 0.2262        | 4.12  | 30100 | 0.2103          | 0.4910 |
| 0.211         | 4.14  | 30200 | 0.2141          | 0.4973 |
| 0.2396        | 4.15  | 30300 | 0.2224          | 0.5072 |
| 0.2576        | 4.16  | 30400 | 0.2241          | 0.5105 |
| 0.2326        | 4.18  | 30500 | 0.2192          | 0.5035 |
| 0.2458        | 4.19  | 30600 | 0.2152          | 0.5008 |
| 0.1914        | 4.21  | 30700 | 0.2119          | 0.5024 |
| 0.2418        | 4.22  | 30800 | 0.2129          | 0.5074 |
| 0.2311        | 4.23  | 30900 | 0.2213          | 0.5088 |
| 0.2543        | 4.25  | 31000 | 0.2099          | 0.4990 |
| 0.256         | 4.26  | 31100 | 0.2081          | 0.4983 |
| 0.2918        | 4.27  | 31200 | 0.2116          | 0.5017 |
| 0.2416        | 4.29  | 31300 | 0.2024          | 0.4901 |
| 0.1784        | 4.3   | 31400 | 0.2089          | 0.4927 |
| 0.2046        | 4.32  | 31500 | 0.2140          | 0.5046 |
| 0.2546        | 4.33  | 31600 | 0.2059          | 0.4901 |
| 0.2133        | 4.34  | 31700 | 0.2053          | 0.4911 |
| 0.2166        | 4.36  | 31800 | 0.1973          | 0.4767 |
| 0.2095        | 4.37  | 31900 | 0.2164          | 0.4955 |
| 0.2604        | 4.38  | 32000 | 0.2030          | 0.4874 |
| 0.267         | 4.4   | 32100 | 0.2025          | 0.4924 |
| 0.2053        | 4.41  | 32200 | 0.2022          | 0.4847 |
| 0.2527        | 4.43  | 32300 | 0.1976          | 0.4788 |
| 0.2553        | 4.44  | 32400 | 0.2012          | 0.4803 |
| 0.2374        | 4.45  | 32500 | 0.1913          | 0.4713 |
| 0.2054        | 4.47  | 32600 | 0.1945          | 0.4758 |
| 0.195         | 4.48  | 32700 | 0.1983          | 0.4794 |
| 0.2873        | 4.49  | 32800 | 0.1965          | 0.4865 |
| 0.2529        | 4.51  | 32900 | 0.1913          | 0.4715 |
| 0.2309        | 4.52  | 33000 | 0.2002          | 0.4792 |
| 0.1991        | 4.53  | 33100 | 0.1856          | 0.4680 |
| 0.2009        | 4.55  | 33200 | 0.1903          | 0.4753 |
| 0.2214        | 4.56  | 33300 | 0.1914          | 0.4709 |
| 0.2517        | 4.58  | 33400 | 0.1869          | 0.4656 |
| 0.1969        | 4.59  | 33500 | 0.1859          | 0.4671 |
| 0.202         | 4.6   | 33600 | 0.1861          | 0.4659 |
| 0.206         | 4.62  | 33700 | 0.1824          | 0.4577 |
| 0.3113        | 4.63  | 33800 | 0.1914          | 0.4879 |
| 0.2779        | 4.64  | 33900 | 0.1941          | 0.4746 |
| 0.2115        | 4.66  | 34000 | 0.1849          | 0.4611 |
| 0.1859        | 4.67  | 34100 | 0.1872          | 0.4677 |
| 0.2078        | 4.69  | 34200 | 0.1804          | 0.4624 |
| 0.1957        | 4.7   | 34300 | 0.1880          | 0.4653 |
| 0.2222        | 4.71  | 34400 | 0.1772          | 0.4536 |
| 0.2334        | 4.73  | 34500 | 0.1845          | 0.4649 |
| 0.1754        | 4.74  | 34600 | 0.1729          | 0.4504 |
| 0.2025        | 4.75  | 34700 | 0.1769          | 0.4512 |
| 0.213         | 4.77  | 34800 | 0.1807          | 0.4551 |
| 0.2255        | 4.78  | 34900 | 0.1742          | 0.4479 |
| 0.1698        | 4.8   | 35000 | 0.1803          | 0.4584 |
| 0.2254        | 4.81  | 35100 | 0.1774          | 0.4510 |
| 0.1913        | 4.82  | 35200 | 0.1742          | 0.4504 |
| 0.2123        | 4.84  | 35300 | 0.1773          | 0.4591 |
| 0.2402        | 4.85  | 35400 | 0.1768          | 0.4527 |
| 0.1617        | 4.86  | 35500 | 0.1717          | 0.4484 |
| 0.2387        | 4.88  | 35600 | 0.1713          | 0.4540 |
| 0.1844        | 4.89  | 35700 | 0.1647          | 0.4386 |
| 0.2113        | 4.9   | 35800 | 0.1760          | 0.4580 |
| 0.1892        | 4.92  | 35900 | 0.1643          | 0.4392 |
| 0.2179        | 4.93  | 36000 | 0.1651          | 0.4407 |
| 0.2053        | 4.95  | 36100 | 0.1663          | 0.4479 |
| 0.1748        | 4.96  | 36200 | 0.1710          | 0.4454 |
| 0.2233        | 4.97  | 36300 | 0.1753          | 0.4541 |
| 0.1941        | 4.99  | 36400 | 0.1636          | 0.4438 |


### Framework versions

- Transformers 4.34.1
- Pytorch 2.1.0+cu121
- Datasets 2.14.6
- Tokenizers 0.14.1