File size: 26,777 Bytes
20e4858
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
---
tags:
- generated_from_trainer
model-index:
- name: bert-base-greek-uncased-v3-finetuned-polylex
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-base-greek-uncased-v3-finetuned-polylex

This model is a fine-tuned version of [nlpaueb/bert-base-greek-uncased-v1](https://huggingface.co/nlpaueb/bert-base-greek-uncased-v1) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.2388

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-06
- train_batch_size: 512
- eval_batch_size: 512
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 500

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 2.7244        | 1.0   | 13   | 2.6291          |
| 2.694         | 2.0   | 26   | 2.6311          |
| 2.7107        | 3.0   | 39   | 2.4722          |
| 2.6558        | 4.0   | 52   | 2.5651          |
| 2.6605        | 5.0   | 65   | 2.5038          |
| 2.6573        | 6.0   | 78   | 2.4791          |
| 2.6467        | 7.0   | 91   | 2.4887          |
| 2.5708        | 8.0   | 104  | 2.4863          |
| 2.5622        | 9.0   | 117  | 2.3389          |
| 2.5644        | 10.0  | 130  | 2.4384          |
| 2.5504        | 11.0  | 143  | 2.4352          |
| 2.5182        | 12.0  | 156  | 2.4158          |
| 2.5046        | 13.0  | 169  | 2.4234          |
| 2.4485        | 14.0  | 182  | 2.4289          |
| 2.473         | 15.0  | 195  | 2.3559          |
| 2.4475        | 16.0  | 208  | 2.3746          |
| 2.4487        | 17.0  | 221  | 2.3665          |
| 2.428         | 18.0  | 234  | 2.2715          |
| 2.4131        | 19.0  | 247  | 2.3679          |
| 2.3936        | 20.0  | 260  | 2.2356          |
| 2.3946        | 21.0  | 273  | 2.3008          |
| 2.3449        | 22.0  | 286  | 2.3134          |
| 2.3708        | 23.0  | 299  | 2.3177          |
| 2.3152        | 24.0  | 312  | 2.2009          |
| 2.3192        | 25.0  | 325  | 2.2506          |
| 2.3304        | 26.0  | 338  | 2.2458          |
| 2.2691        | 27.0  | 351  | 2.2125          |
| 2.2592        | 28.0  | 364  | 2.1254          |
| 2.2714        | 29.0  | 377  | 2.1649          |
| 2.3054        | 30.0  | 390  | 2.1633          |
| 2.2601        | 31.0  | 403  | 2.1433          |
| 2.2445        | 32.0  | 416  | 2.1790          |
| 2.2251        | 33.0  | 429  | 2.1874          |
| 2.2402        | 34.0  | 442  | 2.0976          |
| 2.2485        | 35.0  | 455  | 2.2506          |
| 2.2158        | 36.0  | 468  | 2.1411          |
| 2.1912        | 37.0  | 481  | 2.1640          |
| 2.1883        | 38.0  | 494  | 2.1221          |
| 2.1869        | 39.0  | 507  | 2.1404          |
| 2.1613        | 40.0  | 520  | 2.1048          |
| 2.1562        | 41.0  | 533  | 2.1490          |
| 2.1135        | 42.0  | 546  | 2.1360          |
| 2.1588        | 43.0  | 559  | 2.1085          |
| 2.1245        | 44.0  | 572  | 2.0455          |
| 2.1256        | 45.0  | 585  | 2.0955          |
| 2.1175        | 46.0  | 598  | 2.0554          |
| 2.0986        | 47.0  | 611  | 2.1592          |
| 2.0672        | 48.0  | 624  | 2.0547          |
| 2.0834        | 49.0  | 637  | 2.1018          |
| 2.0637        | 50.0  | 650  | 1.9672          |
| 2.0934        | 51.0  | 663  | 2.0244          |
| 2.0624        | 52.0  | 676  | 2.0206          |
| 2.0654        | 53.0  | 689  | 2.0019          |
| 2.0375        | 54.0  | 702  | 1.9709          |
| 2.0247        | 55.0  | 715  | 2.0573          |
| 2.0051        | 56.0  | 728  | 2.0118          |
| 2.0272        | 57.0  | 741  | 1.9811          |
| 1.9794        | 58.0  | 754  | 2.0686          |
| 2.0075        | 59.0  | 767  | 1.9908          |
| 1.9903        | 60.0  | 780  | 1.9719          |
| 1.9861        | 61.0  | 793  | 1.8938          |
| 1.9723        | 62.0  | 806  | 1.9435          |
| 1.9757        | 63.0  | 819  | 1.9853          |
| 1.9652        | 64.0  | 832  | 1.9546          |
| 1.9082        | 65.0  | 845  | 1.9496          |
| 1.9565        | 66.0  | 858  | 2.0053          |
| 1.9461        | 67.0  | 871  | 1.9123          |
| 1.9348        | 68.0  | 884  | 1.9159          |
| 1.9582        | 69.0  | 897  | 1.9521          |
| 1.9226        | 70.0  | 910  | 1.8827          |
| 1.8822        | 71.0  | 923  | 1.8913          |
| 1.9009        | 72.0  | 936  | 1.9483          |
| 1.8754        | 73.0  | 949  | 1.8115          |
| 1.8989        | 74.0  | 962  | 1.8791          |
| 1.9258        | 75.0  | 975  | 1.8749          |
| 1.8691        | 76.0  | 988  | 1.7972          |
| 1.8842        | 77.0  | 1001 | 1.8793          |
| 1.8788        | 78.0  | 1014 | 1.8586          |
| 1.8319        | 79.0  | 1027 | 1.8892          |
| 1.8608        | 80.0  | 1040 | 1.9646          |
| 1.8318        | 81.0  | 1053 | 1.9309          |
| 1.8437        | 82.0  | 1066 | 1.8566          |
| 1.8203        | 83.0  | 1079 | 1.8284          |
| 1.824         | 84.0  | 1092 | 1.7816          |
| 1.8182        | 85.0  | 1105 | 1.9069          |
| 1.8179        | 86.0  | 1118 | 1.9081          |
| 1.7929        | 87.0  | 1131 | 1.8425          |
| 1.8193        | 88.0  | 1144 | 1.8563          |
| 1.7839        | 89.0  | 1157 | 1.8833          |
| 1.7921        | 90.0  | 1170 | 1.9352          |
| 1.815         | 91.0  | 1183 | 1.7930          |
| 1.7462        | 92.0  | 1196 | 1.8891          |
| 1.7404        | 93.0  | 1209 | 1.7958          |
| 1.7678        | 94.0  | 1222 | 1.8088          |
| 1.7639        | 95.0  | 1235 | 1.8375          |
| 1.7631        | 96.0  | 1248 | 1.7708          |
| 1.766         | 97.0  | 1261 | 1.7981          |
| 1.7695        | 98.0  | 1274 | 1.7941          |
| 1.7176        | 99.0  | 1287 | 1.8595          |
| 1.7293        | 100.0 | 1300 | 1.7562          |
| 1.7483        | 101.0 | 1313 | 1.7352          |
| 1.7082        | 102.0 | 1326 | 1.8223          |
| 1.7325        | 103.0 | 1339 | 1.6402          |
| 1.7099        | 104.0 | 1352 | 1.7554          |
| 1.721         | 105.0 | 1365 | 1.7200          |
| 1.7241        | 106.0 | 1378 | 1.6550          |
| 1.6731        | 107.0 | 1391 | 1.7392          |
| 1.6811        | 108.0 | 1404 | 1.8979          |
| 1.7082        | 109.0 | 1417 | 1.7811          |
| 1.6629        | 110.0 | 1430 | 1.6550          |
| 1.6965        | 111.0 | 1443 | 1.7140          |
| 1.7202        | 112.0 | 1456 | 1.6252          |
| 1.6947        | 113.0 | 1469 | 1.6977          |
| 1.6858        | 114.0 | 1482 | 1.7298          |
| 1.6741        | 115.0 | 1495 | 1.7912          |
| 1.6703        | 116.0 | 1508 | 1.7231          |
| 1.6155        | 117.0 | 1521 | 1.7453          |
| 1.6872        | 118.0 | 1534 | 1.7383          |
| 1.6271        | 119.0 | 1547 | 1.7250          |
| 1.6729        | 120.0 | 1560 | 1.6696          |
| 1.6422        | 121.0 | 1573 | 1.6866          |
| 1.6668        | 122.0 | 1586 | 1.7051          |
| 1.5937        | 123.0 | 1599 | 1.7192          |
| 1.651         | 124.0 | 1612 | 1.7196          |
| 1.6286        | 125.0 | 1625 | 1.7460          |
| 1.6103        | 126.0 | 1638 | 1.6972          |
| 1.6341        | 127.0 | 1651 | 1.6315          |
| 1.6032        | 128.0 | 1664 | 1.7183          |
| 1.6089        | 129.0 | 1677 | 1.6223          |
| 1.6019        | 130.0 | 1690 | 1.6137          |
| 1.5891        | 131.0 | 1703 | 1.7023          |
| 1.597         | 132.0 | 1716 | 1.6243          |
| 1.5559        | 133.0 | 1729 | 1.6536          |
| 1.5882        | 134.0 | 1742 | 1.6405          |
| 1.5728        | 135.0 | 1755 | 1.6444          |
| 1.6019        | 136.0 | 1768 | 1.6513          |
| 1.571         | 137.0 | 1781 | 1.6124          |
| 1.5488        | 138.0 | 1794 | 1.6870          |
| 1.5376        | 139.0 | 1807 | 1.6583          |
| 1.5641        | 140.0 | 1820 | 1.6581          |
| 1.5722        | 141.0 | 1833 | 1.6245          |
| 1.5446        | 142.0 | 1846 | 1.5859          |
| 1.5441        | 143.0 | 1859 | 1.6329          |
| 1.56          | 144.0 | 1872 | 1.6646          |
| 1.5571        | 145.0 | 1885 | 1.6170          |
| 1.5331        | 146.0 | 1898 | 1.6471          |
| 1.5476        | 147.0 | 1911 | 1.6206          |
| 1.5573        | 148.0 | 1924 | 1.6275          |
| 1.5182        | 149.0 | 1937 | 1.6181          |
| 1.4818        | 150.0 | 1950 | 1.6150          |
| 1.5521        | 151.0 | 1963 | 1.5718          |
| 1.5039        | 152.0 | 1976 | 1.6621          |
| 1.5349        | 153.0 | 1989 | 1.5775          |
| 1.4856        | 154.0 | 2002 | 1.5395          |
| 1.5132        | 155.0 | 2015 | 1.6016          |
| 1.4865        | 156.0 | 2028 | 1.6300          |
| 1.4883        | 157.0 | 2041 | 1.6204          |
| 1.4763        | 158.0 | 2054 | 1.6024          |
| 1.497         | 159.0 | 2067 | 1.5947          |
| 1.4897        | 160.0 | 2080 | 1.5532          |
| 1.4797        | 161.0 | 2093 | 1.5129          |
| 1.4714        | 162.0 | 2106 | 1.5091          |
| 1.5007        | 163.0 | 2119 | 1.4499          |
| 1.5007        | 164.0 | 2132 | 1.5607          |
| 1.4778        | 165.0 | 2145 | 1.5594          |
| 1.4871        | 166.0 | 2158 | 1.5438          |
| 1.4718        | 167.0 | 2171 | 1.6030          |
| 1.487         | 168.0 | 2184 | 1.5506          |
| 1.464         | 169.0 | 2197 | 1.5435          |
| 1.4691        | 170.0 | 2210 | 1.5132          |
| 1.4438        | 171.0 | 2223 | 1.5154          |
| 1.461         | 172.0 | 2236 | 1.5698          |
| 1.4319        | 173.0 | 2249 | 1.6740          |
| 1.4798        | 174.0 | 2262 | 1.5586          |
| 1.4681        | 175.0 | 2275 | 1.5489          |
| 1.4587        | 176.0 | 2288 | 1.5589          |
| 1.4543        | 177.0 | 2301 | 1.5321          |
| 1.4611        | 178.0 | 2314 | 1.5495          |
| 1.4155        | 179.0 | 2327 | 1.5491          |
| 1.4228        | 180.0 | 2340 | 1.4871          |
| 1.4345        | 181.0 | 2353 | 1.5680          |
| 1.4325        | 182.0 | 2366 | 1.5306          |
| 1.404         | 183.0 | 2379 | 1.5051          |
| 1.4216        | 184.0 | 2392 | 1.5427          |
| 1.4229        | 185.0 | 2405 | 1.4961          |
| 1.4293        | 186.0 | 2418 | 1.4781          |
| 1.4318        | 187.0 | 2431 | 1.4869          |
| 1.4135        | 188.0 | 2444 | 1.5986          |
| 1.3873        | 189.0 | 2457 | 1.5333          |
| 1.394         | 190.0 | 2470 | 1.4695          |
| 1.4098        | 191.0 | 2483 | 1.5061          |
| 1.4605        | 192.0 | 2496 | 1.5591          |
| 1.3858        | 193.0 | 2509 | 1.4991          |
| 1.4076        | 194.0 | 2522 | 1.4924          |
| 1.3853        | 195.0 | 2535 | 1.4368          |
| 1.3562        | 196.0 | 2548 | 1.4973          |
| 1.3752        | 197.0 | 2561 | 1.4802          |
| 1.396         | 198.0 | 2574 | 1.5606          |
| 1.3836        | 199.0 | 2587 | 1.4912          |
| 1.3682        | 200.0 | 2600 | 1.5184          |
| 1.3821        | 201.0 | 2613 | 1.4448          |
| 1.3792        | 202.0 | 2626 | 1.4727          |
| 1.3755        | 203.0 | 2639 | 1.4996          |
| 1.3664        | 204.0 | 2652 | 1.4469          |
| 1.3574        | 205.0 | 2665 | 1.4670          |
| 1.3948        | 206.0 | 2678 | 1.5356          |
| 1.3378        | 207.0 | 2691 | 1.4756          |
| 1.3546        | 208.0 | 2704 | 1.4507          |
| 1.3547        | 209.0 | 2717 | 1.4986          |
| 1.3551        | 210.0 | 2730 | 1.4478          |
| 1.3262        | 211.0 | 2743 | 1.4450          |
| 1.3577        | 212.0 | 2756 | 1.4713          |
| 1.3698        | 213.0 | 2769 | 1.4404          |
| 1.3604        | 214.0 | 2782 | 1.3906          |
| 1.3733        | 215.0 | 2795 | 1.4844          |
| 1.3574        | 216.0 | 2808 | 1.4104          |
| 1.3227        | 217.0 | 2821 | 1.4512          |
| 1.3409        | 218.0 | 2834 | 1.4661          |
| 1.3411        | 219.0 | 2847 | 1.4515          |
| 1.3258        | 220.0 | 2860 | 1.5193          |
| 1.3194        | 221.0 | 2873 | 1.3303          |
| 1.332         | 222.0 | 2886 | 1.5037          |
| 1.3477        | 223.0 | 2899 | 1.4095          |
| 1.3182        | 224.0 | 2912 | 1.5021          |
| 1.3456        | 225.0 | 2925 | 1.4410          |
| 1.3082        | 226.0 | 2938 | 1.5183          |
| 1.3253        | 227.0 | 2951 | 1.3419          |
| 1.3171        | 228.0 | 2964 | 1.4621          |
| 1.2994        | 229.0 | 2977 | 1.4418          |
| 1.3039        | 230.0 | 2990 | 1.4845          |
| 1.3418        | 231.0 | 3003 | 1.5488          |
| 1.2917        | 232.0 | 3016 | 1.4748          |
| 1.3174        | 233.0 | 3029 | 1.4301          |
| 1.2929        | 234.0 | 3042 | 1.3867          |
| 1.3301        | 235.0 | 3055 | 1.5229          |
| 1.3154        | 236.0 | 3068 | 1.5099          |
| 1.316         | 237.0 | 3081 | 1.3725          |
| 1.3278        | 238.0 | 3094 | 1.4296          |
| 1.311         | 239.0 | 3107 | 1.3594          |
| 1.3149        | 240.0 | 3120 | 1.4675          |
| 1.3151        | 241.0 | 3133 | 1.3854          |
| 1.2792        | 242.0 | 3146 | 1.3681          |
| 1.2755        | 243.0 | 3159 | 1.3866          |
| 1.2748        | 244.0 | 3172 | 1.3623          |
| 1.2969        | 245.0 | 3185 | 1.3822          |
| 1.2839        | 246.0 | 3198 | 1.4040          |
| 1.2728        | 247.0 | 3211 | 1.4649          |
| 1.2853        | 248.0 | 3224 | 1.3486          |
| 1.3091        | 249.0 | 3237 | 1.3852          |
| 1.2677        | 250.0 | 3250 | 1.4326          |
| 1.2627        | 251.0 | 3263 | 1.3952          |
| 1.2794        | 252.0 | 3276 | 1.3576          |
| 1.2893        | 253.0 | 3289 | 1.3751          |
| 1.2483        | 254.0 | 3302 | 1.3861          |
| 1.2799        | 255.0 | 3315 | 1.3946          |
| 1.2774        | 256.0 | 3328 | 1.5043          |
| 1.2501        | 257.0 | 3341 | 1.3320          |
| 1.2491        | 258.0 | 3354 | 1.2201          |
| 1.2587        | 259.0 | 3367 | 1.3994          |
| 1.2771        | 260.0 | 3380 | 1.4088          |
| 1.2635        | 261.0 | 3393 | 1.3706          |
| 1.2805        | 262.0 | 3406 | 1.3330          |
| 1.2196        | 263.0 | 3419 | 1.3849          |
| 1.2485        | 264.0 | 3432 | 1.3607          |
| 1.2259        | 265.0 | 3445 | 1.3942          |
| 1.2653        | 266.0 | 3458 | 1.4019          |
| 1.2355        | 267.0 | 3471 | 1.2494          |
| 1.2687        | 268.0 | 3484 | 1.4765          |
| 1.2547        | 269.0 | 3497 | 1.3954          |
| 1.2613        | 270.0 | 3510 | 1.4220          |
| 1.2216        | 271.0 | 3523 | 1.4526          |
| 1.2494        | 272.0 | 3536 | 1.3749          |
| 1.2324        | 273.0 | 3549 | 1.4229          |
| 1.2415        | 274.0 | 3562 | 1.3641          |
| 1.244         | 275.0 | 3575 | 1.2835          |
| 1.2287        | 276.0 | 3588 | 1.3544          |
| 1.2151        | 277.0 | 3601 | 1.3578          |
| 1.2219        | 278.0 | 3614 | 1.3710          |
| 1.2077        | 279.0 | 3627 | 1.3806          |
| 1.2186        | 280.0 | 3640 | 1.3459          |
| 1.2053        | 281.0 | 3653 | 1.3691          |
| 1.2268        | 282.0 | 3666 | 1.2611          |
| 1.2174        | 283.0 | 3679 | 1.3259          |
| 1.2263        | 284.0 | 3692 | 1.3702          |
| 1.214         | 285.0 | 3705 | 1.2818          |
| 1.226         | 286.0 | 3718 | 1.2994          |
| 1.2331        | 287.0 | 3731 | 1.3583          |
| 1.2301        | 288.0 | 3744 | 1.3379          |
| 1.212         | 289.0 | 3757 | 1.3326          |
| 1.1784        | 290.0 | 3770 | 1.3129          |
| 1.2246        | 291.0 | 3783 | 1.3665          |
| 1.2156        | 292.0 | 3796 | 1.3132          |
| 1.2281        | 293.0 | 3809 | 1.3519          |
| 1.1816        | 294.0 | 3822 | 1.2700          |
| 1.2088        | 295.0 | 3835 | 1.3741          |
| 1.2216        | 296.0 | 3848 | 1.3393          |
| 1.2214        | 297.0 | 3861 | 1.3340          |
| 1.1606        | 298.0 | 3874 | 1.4059          |
| 1.1932        | 299.0 | 3887 | 1.4301          |
| 1.1879        | 300.0 | 3900 | 1.4612          |
| 1.2086        | 301.0 | 3913 | 1.2934          |
| 1.2026        | 302.0 | 3926 | 1.3369          |
| 1.171         | 303.0 | 3939 | 1.4190          |
| 1.1941        | 304.0 | 3952 | 1.3881          |
| 1.1981        | 305.0 | 3965 | 1.3244          |
| 1.1938        | 306.0 | 3978 | 1.3505          |
| 1.2111        | 307.0 | 3991 | 1.3938          |
| 1.2041        | 308.0 | 4004 | 1.2997          |
| 1.2012        | 309.0 | 4017 | 1.3563          |
| 1.1794        | 310.0 | 4030 | 1.3185          |
| 1.2042        | 311.0 | 4043 | 1.3803          |
| 1.171         | 312.0 | 4056 | 1.2954          |
| 1.1567        | 313.0 | 4069 | 1.3422          |
| 1.1743        | 314.0 | 4082 | 1.2974          |
| 1.205         | 315.0 | 4095 | 1.3749          |
| 1.1745        | 316.0 | 4108 | 1.4046          |
| 1.1917        | 317.0 | 4121 | 1.3082          |
| 1.1749        | 318.0 | 4134 | 1.3277          |
| 1.1897        | 319.0 | 4147 | 1.2651          |
| 1.1862        | 320.0 | 4160 | 1.3003          |
| 1.158         | 321.0 | 4173 | 1.3515          |
| 1.1488        | 322.0 | 4186 | 1.3738          |
| 1.1961        | 323.0 | 4199 | 1.2749          |
| 1.1884        | 324.0 | 4212 | 1.2602          |
| 1.1475        | 325.0 | 4225 | 1.2695          |
| 1.1769        | 326.0 | 4238 | 1.2700          |
| 1.1798        | 327.0 | 4251 | 1.3313          |
| 1.1643        | 328.0 | 4264 | 1.3272          |
| 1.1788        | 329.0 | 4277 | 1.2919          |
| 1.1696        | 330.0 | 4290 | 1.3841          |
| 1.1562        | 331.0 | 4303 | 1.2884          |
| 1.1734        | 332.0 | 4316 | 1.2844          |
| 1.1519        | 333.0 | 4329 | 1.3076          |
| 1.1685        | 334.0 | 4342 | 1.3387          |
| 1.1687        | 335.0 | 4355 | 1.2754          |
| 1.1349        | 336.0 | 4368 | 1.2932          |
| 1.1367        | 337.0 | 4381 | 1.2461          |
| 1.1429        | 338.0 | 4394 | 1.3838          |
| 1.1656        | 339.0 | 4407 | 1.3135          |
| 1.149         | 340.0 | 4420 | 1.2941          |
| 1.1412        | 341.0 | 4433 | 1.3608          |
| 1.1375        | 342.0 | 4446 | 1.2460          |
| 1.1527        | 343.0 | 4459 | 1.2603          |
| 1.17          | 344.0 | 4472 | 1.2844          |
| 1.1512        | 345.0 | 4485 | 1.2820          |
| 1.1404        | 346.0 | 4498 | 1.1912          |
| 1.167         | 347.0 | 4511 | 1.3074          |
| 1.1748        | 348.0 | 4524 | 1.3113          |
| 1.149         | 349.0 | 4537 | 1.2842          |
| 1.1907        | 350.0 | 4550 | 1.2868          |
| 1.1344        | 351.0 | 4563 | 1.3040          |
| 1.1368        | 352.0 | 4576 | 1.3053          |
| 1.1519        | 353.0 | 4589 | 1.2947          |
| 1.1439        | 354.0 | 4602 | 1.2751          |
| 1.1459        | 355.0 | 4615 | 1.2740          |
| 1.1673        | 356.0 | 4628 | 1.1941          |
| 1.1415        | 357.0 | 4641 | 1.2766          |
| 1.1384        | 358.0 | 4654 | 1.2161          |
| 1.1411        | 359.0 | 4667 | 1.3156          |
| 1.1362        | 360.0 | 4680 | 1.3086          |
| 1.1317        | 361.0 | 4693 | 1.3608          |
| 1.1168        | 362.0 | 4706 | 1.2478          |
| 1.1347        | 363.0 | 4719 | 1.2681          |
| 1.1553        | 364.0 | 4732 | 1.2650          |
| 1.1487        | 365.0 | 4745 | 1.3514          |
| 1.1135        | 366.0 | 4758 | 1.3292          |
| 1.1388        | 367.0 | 4771 | 1.3192          |
| 1.1818        | 368.0 | 4784 | 1.2937          |
| 1.1256        | 369.0 | 4797 | 1.3446          |
| 1.1284        | 370.0 | 4810 | 1.2609          |
| 1.1352        | 371.0 | 4823 | 1.2070          |
| 1.1151        | 372.0 | 4836 | 1.2035          |
| 1.1148        | 373.0 | 4849 | 1.3513          |
| 1.124         | 374.0 | 4862 | 1.2842          |
| 1.1213        | 375.0 | 4875 | 1.2513          |
| 1.1305        | 376.0 | 4888 | 1.2974          |
| 1.1271        | 377.0 | 4901 | 1.2245          |
| 1.1085        | 378.0 | 4914 | 1.2812          |
| 1.1383        | 379.0 | 4927 | 1.2253          |
| 1.1319        | 380.0 | 4940 | 1.3116          |
| 1.1268        | 381.0 | 4953 | 1.3139          |
| 1.1302        | 382.0 | 4966 | 1.2785          |
| 1.1197        | 383.0 | 4979 | 1.1841          |
| 1.1167        | 384.0 | 4992 | 1.2763          |
| 1.1279        | 385.0 | 5005 | 1.2248          |
| 1.1426        | 386.0 | 5018 | 1.1960          |
| 1.0997        | 387.0 | 5031 | 1.2735          |
| 1.1212        | 388.0 | 5044 | 1.3007          |
| 1.108         | 389.0 | 5057 | 1.2739          |
| 1.1189        | 390.0 | 5070 | 1.2446          |
| 1.1156        | 391.0 | 5083 | 1.2815          |
| 1.1342        | 392.0 | 5096 | 1.2405          |
| 1.1082        | 393.0 | 5109 | 1.2778          |
| 1.1091        | 394.0 | 5122 | 1.2683          |
| 1.1516        | 395.0 | 5135 | 1.1883          |
| 1.1136        | 396.0 | 5148 | 1.3215          |
| 1.1115        | 397.0 | 5161 | 1.2671          |
| 1.1356        | 398.0 | 5174 | 1.1809          |
| 1.1281        | 399.0 | 5187 | 1.2935          |
| 1.1241        | 400.0 | 5200 | 1.2595          |
| 1.0893        | 401.0 | 5213 | 1.2746          |
| 1.1045        | 402.0 | 5226 | 1.2215          |
| 1.1184        | 403.0 | 5239 | 1.1524          |
| 1.1088        | 404.0 | 5252 | 1.3651          |
| 1.1331        | 405.0 | 5265 | 1.1774          |
| 1.1151        | 406.0 | 5278 | 1.3032          |
| 1.1061        | 407.0 | 5291 | 1.3317          |
| 1.1103        | 408.0 | 5304 | 1.3300          |
| 1.1343        | 409.0 | 5317 | 1.2831          |
| 1.1056        | 410.0 | 5330 | 1.2202          |
| 1.1037        | 411.0 | 5343 | 1.3218          |
| 1.1131        | 412.0 | 5356 | 1.2714          |
| 1.1237        | 413.0 | 5369 | 1.2526          |
| 1.1241        | 414.0 | 5382 | 1.2328          |
| 1.1332        | 415.0 | 5395 | 1.2634          |
| 1.128         | 416.0 | 5408 | 1.3259          |
| 1.0864        | 417.0 | 5421 | 1.3554          |
| 1.1214        | 418.0 | 5434 | 1.2347          |
| 1.1177        | 419.0 | 5447 | 1.3417          |
| 1.0893        | 420.0 | 5460 | 1.2682          |
| 1.0809        | 421.0 | 5473 | 1.2308          |
| 1.1074        | 422.0 | 5486 | 1.3069          |
| 1.1101        | 423.0 | 5499 | 1.2414          |
| 1.1052        | 424.0 | 5512 | 1.2131          |
| 1.1036        | 425.0 | 5525 | 1.2598          |
| 1.1041        | 426.0 | 5538 | 1.2435          |
| 1.0916        | 427.0 | 5551 | 1.3050          |
| 1.1182        | 428.0 | 5564 | 1.2315          |
| 1.1401        | 429.0 | 5577 | 1.2985          |
| 1.0783        | 430.0 | 5590 | 1.2561          |
| 1.1023        | 431.0 | 5603 | 1.2018          |
| 1.0812        | 432.0 | 5616 | 1.2776          |
| 1.0972        | 433.0 | 5629 | 1.3098          |
| 1.0974        | 434.0 | 5642 | 1.2912          |
| 1.1034        | 435.0 | 5655 | 1.2527          |
| 1.1113        | 436.0 | 5668 | 1.3305          |
| 1.1026        | 437.0 | 5681 | 1.2507          |
| 1.1173        | 438.0 | 5694 | 1.1933          |
| 1.1059        | 439.0 | 5707 | 1.2326          |
| 1.1059        | 440.0 | 5720 | 1.3398          |
| 1.0857        | 441.0 | 5733 | 1.2865          |
| 1.1101        | 442.0 | 5746 | 1.2175          |
| 1.0909        | 443.0 | 5759 | 1.2195          |
| 1.0842        | 444.0 | 5772 | 1.1917          |
| 1.1266        | 445.0 | 5785 | 1.3260          |
| 1.1003        | 446.0 | 5798 | 1.1981          |
| 1.1132        | 447.0 | 5811 | 1.3115          |
| 1.1144        | 448.0 | 5824 | 1.2113          |
| 1.0909        | 449.0 | 5837 | 1.2275          |
| 1.0901        | 450.0 | 5850 | 1.3206          |
| 1.0966        | 451.0 | 5863 | 1.2821          |
| 1.1113        | 452.0 | 5876 | 1.2246          |
| 1.1166        | 453.0 | 5889 | 1.2174          |
| 1.1008        | 454.0 | 5902 | 1.2261          |
| 1.0867        | 455.0 | 5915 | 1.2382          |
| 1.0946        | 456.0 | 5928 | 1.2275          |
| 1.0806        | 457.0 | 5941 | 1.2702          |
| 1.092         | 458.0 | 5954 | 1.2788          |
| 1.0781        | 459.0 | 5967 | 1.1919          |
| 1.0708        | 460.0 | 5980 | 1.2266          |
| 1.0716        | 461.0 | 5993 | 1.2876          |
| 1.087         | 462.0 | 6006 | 1.2632          |
| 1.0925        | 463.0 | 6019 | 1.1550          |
| 1.0998        | 464.0 | 6032 | 1.2398          |
| 1.0816        | 465.0 | 6045 | 1.2901          |
| 1.0661        | 466.0 | 6058 | 1.2204          |
| 1.0896        | 467.0 | 6071 | 1.2587          |
| 1.1085        | 468.0 | 6084 | 1.2251          |
| 1.0629        | 469.0 | 6097 | 1.2259          |
| 1.0755        | 470.0 | 6110 | 1.1535          |
| 1.1145        | 471.0 | 6123 | 1.2034          |
| 1.0803        | 472.0 | 6136 | 1.2616          |
| 1.0787        | 473.0 | 6149 | 1.2261          |
| 1.1043        | 474.0 | 6162 | 1.2071          |
| 1.091         | 475.0 | 6175 | 1.2788          |
| 1.0938        | 476.0 | 6188 | 1.3360          |
| 1.0846        | 477.0 | 6201 | 1.1932          |
| 1.1042        | 478.0 | 6214 | 1.2023          |
| 1.0737        | 479.0 | 6227 | 1.2668          |
| 1.0857        | 480.0 | 6240 | 1.2893          |
| 1.0677        | 481.0 | 6253 | 1.1550          |
| 1.0779        | 482.0 | 6266 | 1.2404          |
| 1.0847        | 483.0 | 6279 | 1.2260          |
| 1.064         | 484.0 | 6292 | 1.2843          |
| 1.1016        | 485.0 | 6305 | 1.2789          |
| 1.088         | 486.0 | 6318 | 1.2207          |
| 1.0721        | 487.0 | 6331 | 1.2481          |
| 1.0622        | 488.0 | 6344 | 1.2128          |
| 1.0849        | 489.0 | 6357 | 1.2319          |
| 1.0665        | 490.0 | 6370 | 1.2880          |
| 1.0823        | 491.0 | 6383 | 1.2155          |
| 1.0956        | 492.0 | 6396 | 1.2121          |
| 1.0685        | 493.0 | 6409 | 1.1844          |
| 1.0871        | 494.0 | 6422 | 1.3001          |
| 1.0755        | 495.0 | 6435 | 1.2396          |
| 1.064         | 496.0 | 6448 | 1.1924          |
| 1.0898        | 497.0 | 6461 | 1.2475          |
| 1.0737        | 498.0 | 6474 | 1.2293          |
| 1.0828        | 499.0 | 6487 | 1.2668          |
| 1.0921        | 500.0 | 6500 | 1.2141          |


### Framework versions

- Transformers 4.30.2
- Pytorch 2.0.1+cu118
- Datasets 2.13.1
- Tokenizers 0.13.3