File size: 28,589 Bytes
1755dc4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
---
license: mit
tags:
- generated_from_trainer
model-index:
- name: BERiT_2000_custom_architecture_100_epochs
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# BERiT_2000_custom_architecture_100_epochs

This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 4.3615

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0005
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch | Step   | Validation Loss |
|:-------------:|:-----:|:------:|:---------------:|
| 16.6444       | 0.19  | 500    | 8.8209          |
| 8.1904        | 0.39  | 1000   | 7.5197          |
| 7.3572        | 0.58  | 1500   | 7.1037          |
| 7.0042        | 0.77  | 2000   | 6.8817          |
| 6.8626        | 0.97  | 2500   | 6.7353          |
| 6.7582        | 1.16  | 3000   | 6.5802          |
| 6.6345        | 1.36  | 3500   | 6.4232          |
| 6.5817        | 1.55  | 4000   | 6.3375          |
| 6.517         | 1.74  | 4500   | 6.3439          |
| 6.4531        | 1.94  | 5000   | 6.2870          |
| 6.469         | 2.13  | 5500   | 6.3208          |
| 6.4503        | 2.32  | 6000   | 6.2136          |
| 6.3679        | 2.52  | 6500   | 6.2260          |
| 6.4032        | 2.71  | 7000   | 6.2015          |
| 6.357         | 2.9   | 7500   | 6.2363          |
| 6.3349        | 3.1   | 8000   | 6.2101          |
| 6.342         | 3.29  | 8500   | 6.2031          |
| 6.3047        | 3.49  | 9000   | 6.1945          |
| 6.3204        | 3.68  | 9500   | 6.1681          |
| 6.2935        | 3.87  | 10000  | 6.1999          |
| 6.3319        | 4.07  | 10500  | 6.1613          |
| 6.2528        | 4.26  | 11000  | 6.1354          |
| 6.2683        | 4.45  | 11500  | 6.2427          |
| 6.2572        | 4.65  | 12000  | 6.1477          |
| 6.2509        | 4.84  | 12500  | 6.1770          |
| 6.2402        | 5.03  | 13000  | 6.1779          |
| 6.2412        | 5.23  | 13500  | 6.1516          |
| 6.2291        | 5.42  | 14000  | 6.1498          |
| 6.2203        | 5.62  | 14500  | 6.1804          |
| 6.2341        | 5.81  | 15000  | 6.1501          |
| 6.2242        | 6.0   | 15500  | 6.1239          |
| 6.2163        | 6.2   | 16000  | 6.1567          |
| 6.2079        | 6.39  | 16500  | 6.1188          |
| 6.2176        | 6.58  | 17000  | 6.1620          |
| 6.1926        | 6.78  | 17500  | 6.1635          |
| 6.1743        | 6.97  | 18000  | 6.0749          |
| 6.1978        | 7.16  | 18500  | 6.1316          |
| 6.1868        | 7.36  | 19000  | 6.0297          |
| 6.19          | 7.55  | 19500  | 6.1126          |
| 6.2005        | 7.75  | 20000  | 6.0985          |
| 6.2056        | 7.94  | 20500  | 6.1100          |
| 6.1628        | 8.13  | 21000  | 6.1321          |
| 6.169         | 8.33  | 21500  | 6.0842          |
| 6.1636        | 8.52  | 22000  | 6.1205          |
| 6.1278        | 8.71  | 22500  | 6.1270          |
| 6.1656        | 8.91  | 23000  | 6.1049          |
| 6.1526        | 9.1   | 23500  | 6.1462          |
| 6.1624        | 9.3   | 24000  | 6.0534          |
| 6.1353        | 9.49  | 24500  | 6.0862          |
| 6.1264        | 9.68  | 25000  | 6.0844          |
| 6.1648        | 9.88  | 25500  | 6.1206          |
| 6.1574        | 10.07 | 26000  | 6.0942          |
| 6.0971        | 10.26 | 26500  | 6.1151          |
| 6.119         | 10.46 | 27000  | 6.1148          |
| 6.1217        | 10.65 | 27500  | 6.1076          |
| 6.1054        | 10.84 | 28000  | 6.1457          |
| 6.1402        | 11.04 | 28500  | 6.0442          |
| 6.1124        | 11.23 | 29000  | 6.1404          |
| 6.1457        | 11.43 | 29500  | 6.0622          |
| 6.1248        | 11.62 | 30000  | 6.1377          |
| 6.1204        | 11.81 | 30500  | 6.1056          |
| 6.1097        | 12.01 | 31000  | 6.0780          |
| 6.0713        | 12.2  | 31500  | 6.0061          |
| 6.1119        | 12.39 | 32000  | 6.1671          |
| 6.0744        | 12.59 | 32500  | 6.1235          |
| 6.082         | 12.78 | 33000  | 6.0905          |
| 6.0962        | 12.97 | 33500  | 6.0936          |
| 6.1265        | 13.17 | 34000  | 6.0786          |
| 6.0941        | 13.36 | 34500  | 6.0944          |
| 6.0694        | 13.56 | 35000  | 6.0988          |
| 6.0784        | 13.75 | 35500  | 6.1221          |
| 6.0749        | 13.94 | 36000  | 6.0961          |
| 6.103         | 14.14 | 36500  | 6.0141          |
| 6.0944        | 14.33 | 37000  | 6.0812          |
| 6.0869        | 14.52 | 37500  | 6.0423          |
| 6.0986        | 14.72 | 38000  | 6.1194          |
| 6.0759        | 14.91 | 38500  | 6.0504          |
| 6.0592        | 15.1  | 39000  | 6.1483          |
| 6.0624        | 15.3  | 39500  | 6.0978          |
| 6.077         | 15.49 | 40000  | 6.0585          |
| 6.0581        | 15.69 | 40500  | 6.0355          |
| 6.0612        | 15.88 | 41000  | 6.0742          |
| 6.0536        | 16.07 | 41500  | 6.1443          |
| 6.057         | 16.27 | 42000  | 6.0574          |
| 6.0419        | 16.46 | 42500  | 6.0372          |
| 6.0076        | 16.65 | 43000  | 6.0624          |
| 6.0773        | 16.85 | 43500  | 6.0624          |
| 6.0317        | 17.04 | 44000  | 6.0738          |
| 6.0248        | 17.23 | 44500  | 6.0959          |
| 6.0459        | 17.43 | 45000  | 6.0636          |
| 6.0332        | 17.62 | 45500  | 6.0536          |
| 6.0319        | 17.82 | 46000  | 6.0659          |
| 6.0363        | 18.01 | 46500  | 6.0154          |
| 6.0001        | 18.2  | 47000  | 6.0082          |
| 5.9719        | 18.4  | 47500  | 6.0778          |
| 6.0332        | 18.59 | 48000  | 6.0491          |
| 6.0061        | 18.78 | 48500  | 5.9457          |
| 5.9675        | 18.98 | 49000  | 5.9768          |
| 5.9749        | 19.17 | 49500  | 6.0173          |
| 5.9944        | 19.36 | 50000  | 5.9981          |
| 6.0248        | 19.56 | 50500  | 5.9255          |
| 5.9774        | 19.75 | 51000  | 6.0158          |
| 5.9768        | 19.95 | 51500  | 5.9443          |
| 5.9499        | 20.14 | 52000  | 5.9708          |
| 5.979         | 20.33 | 52500  | 5.9296          |
| 5.9881        | 20.53 | 53000  | 5.9506          |
| 5.9775        | 20.72 | 53500  | 5.9266          |
| 5.9361        | 20.91 | 54000  | 5.9270          |
| 5.9427        | 21.11 | 54500  | 5.9461          |
| 5.9396        | 21.3  | 55000  | 5.9156          |
| 5.9596        | 21.49 | 55500  | 5.9185          |
| 5.9079        | 21.69 | 56000  | 5.9630          |
| 5.9579        | 21.88 | 56500  | 5.8991          |
| 5.9564        | 22.08 | 57000  | 5.9097          |
| 5.9225        | 22.27 | 57500  | 5.9452          |
| 5.9202        | 22.46 | 58000  | 5.8680          |
| 5.9103        | 22.66 | 58500  | 5.8985          |
| 5.9106        | 22.85 | 59000  | 5.8656          |
| 5.913         | 23.04 | 59500  | 5.8292          |
| 5.9249        | 23.24 | 60000  | 5.8420          |
| 5.8948        | 23.43 | 60500  | 5.8782          |
| 5.9273        | 23.63 | 61000  | 5.8952          |
| 5.8788        | 23.82 | 61500  | 5.8438          |
| 5.898         | 24.01 | 62000  | 5.8705          |
| 5.8809        | 24.21 | 62500  | 5.7648          |
| 5.8953        | 24.4  | 63000  | 5.8283          |
| 5.9177        | 24.59 | 63500  | 5.7760          |
| 5.8809        | 24.79 | 64000  | 5.8144          |
| 5.8994        | 24.98 | 64500  | 5.8348          |
| 5.8817        | 25.17 | 65000  | 5.8334          |
| 5.8701        | 25.37 | 65500  | 5.7240          |
| 5.8518        | 25.56 | 66000  | 5.8187          |
| 5.8406        | 25.76 | 66500  | 5.8133          |
| 5.859         | 25.95 | 67000  | 5.7331          |
| 5.8627        | 26.14 | 67500  | 5.7711          |
| 5.8727        | 26.34 | 68000  | 5.7598          |
| 5.8295        | 26.53 | 68500  | 5.8364          |
| 5.8216        | 26.72 | 69000  | 5.7586          |
| 5.8458        | 26.92 | 69500  | 5.7413          |
| 5.8597        | 27.11 | 70000  | 5.7444          |
| 5.842         | 27.3  | 70500  | 5.7288          |
| 5.8254        | 27.5  | 71000  | 5.7811          |
| 5.8285        | 27.69 | 71500  | 5.7120          |
| 5.8106        | 27.89 | 72000  | 5.6733          |
| 5.8073        | 28.08 | 72500  | 5.7163          |
| 5.7932        | 28.27 | 73000  | 5.7258          |
| 5.7919        | 28.47 | 73500  | 5.6985          |
| 5.7881        | 28.66 | 74000  | 5.7321          |
| 5.7942        | 28.85 | 74500  | 5.6545          |
| 5.8011        | 29.05 | 75000  | 5.6799          |
| 5.8071        | 29.24 | 75500  | 5.7270          |
| 5.784         | 29.43 | 76000  | 5.6806          |
| 5.7774        | 29.63 | 76500  | 5.6918          |
| 5.7345        | 29.82 | 77000  | 5.7138          |
| 5.7863        | 30.02 | 77500  | 5.7072          |
| 5.7774        | 30.21 | 78000  | 5.6649          |
| 5.7954        | 30.4  | 78500  | 5.6150          |
| 5.7624        | 30.6  | 79000  | 5.6398          |
| 5.7296        | 30.79 | 79500  | 5.6216          |
| 5.7053        | 30.98 | 80000  | 5.5447          |
| 5.7688        | 31.18 | 80500  | 5.6245          |
| 5.7254        | 31.37 | 81000  | 5.6100          |
| 5.755         | 31.56 | 81500  | 5.6257          |
| 5.7854        | 31.76 | 82000  | 5.6330          |
| 5.7351        | 31.95 | 82500  | 5.5588          |
| 5.7233        | 32.15 | 83000  | 5.5590          |
| 5.7225        | 32.34 | 83500  | 5.5480          |
| 5.7451        | 32.53 | 84000  | 5.6075          |
| 5.6989        | 32.73 | 84500  | 5.5447          |
| 5.7245        | 32.92 | 85000  | 5.5353          |
| 5.7132        | 33.11 | 85500  | 5.5563          |
| 5.7187        | 33.31 | 86000  | 5.5177          |
| 5.7203        | 33.5  | 86500  | 5.5630          |
| 5.6948        | 33.69 | 87000  | 5.5357          |
| 5.7118        | 33.89 | 87500  | 5.5367          |
| 5.6763        | 34.08 | 88000  | 5.4824          |
| 5.6923        | 34.28 | 88500  | 5.4489          |
| 5.6803        | 34.47 | 89000  | 5.5113          |
| 5.6977        | 34.66 | 89500  | 5.4829          |
| 5.6834        | 34.86 | 90000  | 5.4640          |
| 5.6596        | 35.05 | 90500  | 5.4816          |
| 5.6513        | 35.24 | 91000  | 5.4522          |
| 5.6687        | 35.44 | 91500  | 5.3984          |
| 5.6866        | 35.63 | 92000  | 5.4538          |
| 5.6479        | 35.82 | 92500  | 5.3811          |
| 5.6308        | 36.02 | 93000  | 5.3664          |
| 5.6299        | 36.21 | 93500  | 5.3788          |
| 5.6263        | 36.41 | 94000  | 5.3367          |
| 5.6305        | 36.6  | 94500  | 5.4058          |
| 5.6065        | 36.79 | 95000  | 5.3011          |
| 5.6236        | 36.99 | 95500  | 5.3301          |
| 5.6191        | 37.18 | 96000  | 5.3643          |
| 5.5991        | 37.37 | 96500  | 5.3917          |
| 5.6044        | 37.57 | 97000  | 5.3284          |
| 5.6001        | 37.76 | 97500  | 5.3199          |
| 5.5758        | 37.96 | 98000  | 5.2644          |
| 5.567         | 38.15 | 98500  | 5.3054          |
| 5.5404        | 38.34 | 99000  | 5.3473          |
| 5.5677        | 38.54 | 99500  | 5.2537          |
| 5.5676        | 38.73 | 100000 | 5.3135          |
| 5.5608        | 38.92 | 100500 | 5.2030          |
| 5.5523        | 39.12 | 101000 | 5.2808          |
| 5.545         | 39.31 | 101500 | 5.2114          |
| 5.5117        | 39.5  | 102000 | 5.2167          |
| 5.5403        | 39.7  | 102500 | 5.1930          |
| 5.5166        | 39.89 | 103000 | 5.1737          |
| 5.5267        | 40.09 | 103500 | 5.2112          |
| 5.5116        | 40.28 | 104000 | 5.2007          |
| 5.4874        | 40.47 | 104500 | 5.1654          |
| 5.5144        | 40.67 | 105000 | 5.1378          |
| 5.4683        | 40.86 | 105500 | 5.2039          |
| 5.4978        | 41.05 | 106000 | 5.1436          |
| 5.4781        | 41.25 | 106500 | 5.1642          |
| 5.5052        | 41.44 | 107000 | 5.1245          |
| 5.4844        | 41.63 | 107500 | 5.1809          |
| 5.4853        | 41.83 | 108000 | 5.0201          |
| 5.4814        | 42.02 | 108500 | 5.1054          |
| 5.4529        | 42.22 | 109000 | 5.1489          |
| 5.4804        | 42.41 | 109500 | 5.0555          |
| 5.4534        | 42.6  | 110000 | 5.0705          |
| 5.4401        | 42.8  | 110500 | 5.0464          |
| 5.45          | 42.99 | 111000 | 5.0069          |
| 5.4547        | 43.18 | 111500 | 5.0655          |
| 5.4212        | 43.38 | 112000 | 5.0563          |
| 5.3913        | 43.57 | 112500 | 5.0514          |
| 5.4268        | 43.76 | 113000 | 4.9936          |
| 5.3926        | 43.96 | 113500 | 5.0101          |
| 5.3882        | 44.15 | 114000 | 5.0294          |
| 5.4014        | 44.35 | 114500 | 5.0560          |
| 5.417         | 44.54 | 115000 | 4.9827          |
| 5.4012        | 44.73 | 115500 | 4.9811          |
| 5.3697        | 44.93 | 116000 | 4.9288          |
| 5.3991        | 45.12 | 116500 | 4.9576          |
| 5.3711        | 45.31 | 117000 | 4.9339          |
| 5.4081        | 45.51 | 117500 | 4.9250          |
| 5.3531        | 45.7  | 118000 | 4.8725          |
| 5.3826        | 45.89 | 118500 | 4.9501          |
| 5.3798        | 46.09 | 119000 | 4.9958          |
| 5.3415        | 46.28 | 119500 | 4.9327          |
| 5.3786        | 46.48 | 120000 | 4.8616          |
| 5.3862        | 46.67 | 120500 | 4.8863          |
| 5.3606        | 46.86 | 121000 | 4.9151          |
| 5.3605        | 47.06 | 121500 | 4.9053          |
| 5.3455        | 47.25 | 122000 | 4.9110          |
| 5.3264        | 47.44 | 122500 | 4.8673          |
| 5.3409        | 47.64 | 123000 | 4.8346          |
| 5.3567        | 47.83 | 123500 | 4.8996          |
| 5.3103        | 48.02 | 124000 | 4.8342          |
| 5.3244        | 48.22 | 124500 | 4.8464          |
| 5.3324        | 48.41 | 125000 | 4.8729          |
| 5.3273        | 48.61 | 125500 | 4.8125          |
| 5.31          | 48.8  | 126000 | 4.8519          |
| 5.2872        | 48.99 | 126500 | 4.8693          |
| 5.3066        | 49.19 | 127000 | 4.8600          |
| 5.302         | 49.38 | 127500 | 4.8171          |
| 5.2875        | 49.57 | 128000 | 4.7911          |
| 5.2806        | 49.77 | 128500 | 4.8004          |
| 5.3108        | 49.96 | 129000 | 4.7977          |
| 5.2741        | 50.15 | 129500 | 4.8427          |
| 5.2603        | 50.35 | 130000 | 4.7938          |
| 5.282         | 50.54 | 130500 | 4.7997          |
| 5.2835        | 50.74 | 131000 | 4.8173          |
| 5.2628        | 50.93 | 131500 | 4.7610          |
| 5.3034        | 51.12 | 132000 | 4.7908          |
| 5.2635        | 51.32 | 132500 | 4.7676          |
| 5.3269        | 51.51 | 133000 | 4.8245          |
| 5.242         | 51.7  | 133500 | 4.7265          |
| 5.2516        | 51.9  | 134000 | 4.7588          |
| 5.2641        | 52.09 | 134500 | 4.7695          |
| 5.2493        | 52.29 | 135000 | 4.7327          |
| 5.2334        | 52.48 | 135500 | 4.7206          |
| 5.2483        | 52.67 | 136000 | 4.7289          |
| 5.2133        | 52.87 | 136500 | 4.8136          |
| 5.2495        | 53.06 | 137000 | 4.6620          |
| 5.2489        | 53.25 | 137500 | 4.7118          |
| 5.2415        | 53.45 | 138000 | 4.7011          |
| 5.231         | 53.64 | 138500 | 4.7295          |
| 5.2211        | 53.83 | 139000 | 4.7199          |
| 5.2327        | 54.03 | 139500 | 4.7146          |
| 5.2053        | 54.22 | 140000 | 4.6871          |
| 5.2117        | 54.42 | 140500 | 4.7097          |
| 5.1929        | 54.61 | 141000 | 4.6923          |
| 5.2199        | 54.8  | 141500 | 4.7291          |
| 5.211         | 55.0  | 142000 | 4.7088          |
| 5.2482        | 55.19 | 142500 | 4.6551          |
| 5.2043        | 55.38 | 143000 | 4.7244          |
| 5.1799        | 55.58 | 143500 | 4.7225          |
| 5.2053        | 55.77 | 144000 | 4.6948          |
| 5.1745        | 55.96 | 144500 | 4.7157          |
| 5.1673        | 56.16 | 145000 | 4.6555          |
| 5.2122        | 56.35 | 145500 | 4.6842          |
| 5.1701        | 56.55 | 146000 | 4.6581          |
| 5.2107        | 56.74 | 146500 | 4.6245          |
| 5.2454        | 56.93 | 147000 | 4.6399          |
| 5.2134        | 57.13 | 147500 | 4.6585          |
| 5.1753        | 57.32 | 148000 | 4.6233          |
| 5.1355        | 57.51 | 148500 | 4.6543          |
| 5.2032        | 57.71 | 149000 | 4.6640          |
| 5.1714        | 57.9  | 149500 | 4.6635          |
| 5.1769        | 58.09 | 150000 | 4.6256          |
| 5.1632        | 58.29 | 150500 | 4.6456          |
| 5.1556        | 58.48 | 151000 | 4.6647          |
| 5.1671        | 58.68 | 151500 | 4.6548          |
| 5.1482        | 58.87 | 152000 | 4.6107          |
| 5.104         | 59.06 | 152500 | 4.6320          |
| 5.1545        | 59.26 | 153000 | 4.6035          |
| 5.1338        | 59.45 | 153500 | 4.6512          |
| 5.1518        | 59.64 | 154000 | 4.6424          |
| 5.1937        | 59.84 | 154500 | 4.6123          |
| 5.1576        | 60.03 | 155000 | 4.6077          |
| 5.1643        | 60.22 | 155500 | 4.5990          |
| 5.1371        | 60.42 | 156000 | 4.6025          |
| 5.1535        | 60.61 | 156500 | 4.5939          |
| 5.128         | 60.81 | 157000 | 4.5716          |
| 5.1711        | 61.0  | 157500 | 4.5895          |
| 5.1265        | 61.19 | 158000 | 4.6367          |
| 5.1131        | 61.39 | 158500 | 4.6565          |
| 5.1239        | 61.58 | 159000 | 4.6194          |
| 5.1089        | 61.77 | 159500 | 4.6214          |
| 5.1052        | 61.97 | 160000 | 4.5982          |
| 5.1336        | 62.16 | 160500 | 4.5861          |
| 5.1081        | 62.35 | 161000 | 4.5343          |
| 5.1706        | 62.55 | 161500 | 4.5480          |
| 5.0848        | 62.74 | 162000 | 4.5500          |
| 5.0848        | 62.94 | 162500 | 4.5965          |
| 5.0849        | 63.13 | 163000 | 4.5737          |
| 5.1267        | 63.32 | 163500 | 4.5680          |
| 5.124         | 63.52 | 164000 | 4.5341          |
| 5.1212        | 63.71 | 164500 | 4.5154          |
| 5.1214        | 63.9  | 165000 | 4.5329          |
| 5.117         | 64.1  | 165500 | 4.4988          |
| 5.0578        | 64.29 | 166000 | 4.5582          |
| 5.0705        | 64.48 | 166500 | 4.5346          |
| 5.0814        | 64.68 | 167000 | 4.5978          |
| 5.0959        | 64.87 | 167500 | 4.5628          |
| 5.0601        | 65.07 | 168000 | 4.5449          |
| 5.1112        | 65.26 | 168500 | 4.5499          |
| 5.0946        | 65.45 | 169000 | 4.5344          |
| 5.0965        | 65.65 | 169500 | 4.5324          |
| 5.0958        | 65.84 | 170000 | 4.4937          |
| 5.081         | 66.03 | 170500 | 4.5009          |
| 5.0506        | 66.23 | 171000 | 4.5145          |
| 5.0729        | 66.42 | 171500 | 4.4779          |
| 5.0628        | 66.62 | 172000 | 4.5531          |
| 5.0674        | 66.81 | 172500 | 4.5023          |
| 5.0634        | 67.0  | 173000 | 4.5124          |
| 5.0847        | 67.2  | 173500 | 4.5203          |
| 5.0729        | 67.39 | 174000 | 4.4887          |
| 5.0683        | 67.58 | 174500 | 4.5113          |
| 5.0596        | 67.78 | 175000 | 4.4898          |
| 5.0528        | 67.97 | 175500 | 4.5359          |
| 5.0595        | 68.16 | 176000 | 4.5139          |
| 5.0864        | 68.36 | 176500 | 4.5260          |
| 5.0241        | 68.55 | 177000 | 4.5325          |
| 5.1038        | 68.75 | 177500 | 4.4692          |
| 5.073         | 68.94 | 178000 | 4.5429          |
| 5.0667        | 69.13 | 178500 | 4.4781          |
| 5.041         | 69.33 | 179000 | 4.5035          |
| 5.033         | 69.52 | 179500 | 4.5177          |
| 5.0369        | 69.71 | 180000 | 4.4948          |
| 5.0265        | 69.91 | 180500 | 4.5544          |
| 5.0687        | 70.1  | 181000 | 4.5048          |
| 5.0464        | 70.29 | 181500 | 4.4532          |
| 5.0502        | 70.49 | 182000 | 4.5503          |
| 4.9993        | 70.68 | 182500 | 4.5011          |
| 5.041         | 70.88 | 183000 | 4.4769          |
| 5.0603        | 71.07 | 183500 | 4.4642          |
| 5.0448        | 71.26 | 184000 | 4.4527          |
| 5.0702        | 71.46 | 184500 | 4.4807          |
| 5.0418        | 71.65 | 185000 | 4.4724          |
| 4.9976        | 71.84 | 185500 | 4.4915          |
| 5.0502        | 72.04 | 186000 | 4.4591          |
| 5.0438        | 72.23 | 186500 | 4.4292          |
| 4.9812        | 72.42 | 187000 | 4.4252          |
| 5.0377        | 72.62 | 187500 | 4.4512          |
| 5.0117        | 72.81 | 188000 | 4.4617          |
| 4.976         | 73.01 | 188500 | 4.5048          |
| 5.05          | 73.2  | 189000 | 4.4400          |
| 5.0306        | 73.39 | 189500 | 4.4209          |
| 5.0648        | 73.59 | 190000 | 4.4707          |
| 5.0097        | 73.78 | 190500 | 4.4453          |
| 5.0611        | 73.97 | 191000 | 4.4601          |
| 5.0091        | 74.17 | 191500 | 4.4231          |
| 5.0529        | 74.36 | 192000 | 4.4110          |
| 5.0221        | 74.55 | 192500 | 4.5013          |
| 5.0156        | 74.75 | 193000 | 4.4717          |
| 5.0442        | 74.94 | 193500 | 4.4585          |
| 5.0229        | 75.14 | 194000 | 4.4601          |
| 4.9883        | 75.33 | 194500 | 4.4740          |
| 4.9963        | 75.52 | 195000 | 4.4663          |
| 4.9886        | 75.72 | 195500 | 4.4237          |
| 4.9753        | 75.91 | 196000 | 4.4762          |
| 4.981         | 76.1  | 196500 | 4.4573          |
| 4.9901        | 76.3  | 197000 | 4.4376          |
| 5.005         | 76.49 | 197500 | 4.4859          |
| 5.0254        | 76.68 | 198000 | 4.4181          |
| 5.0067        | 76.88 | 198500 | 4.4582          |
| 5.0097        | 77.07 | 199000 | 4.4494          |
| 4.9815        | 77.27 | 199500 | 4.4382          |
| 5.0029        | 77.46 | 200000 | 4.4780          |
| 4.9659        | 77.65 | 200500 | 4.4009          |
| 4.9889        | 77.85 | 201000 | 4.3664          |
| 4.9916        | 78.04 | 201500 | 4.4319          |
| 4.9715        | 78.23 | 202000 | 4.4390          |
| 4.9815        | 78.43 | 202500 | 4.4593          |
| 4.972         | 78.62 | 203000 | 4.4620          |
| 5.0164        | 78.81 | 203500 | 4.4247          |
| 4.9608        | 79.01 | 204000 | 4.4031          |
| 4.9606        | 79.2  | 204500 | 4.4301          |
| 4.9922        | 79.4  | 205000 | 4.4147          |
| 4.9825        | 79.59 | 205500 | 4.4489          |
| 4.9719        | 79.78 | 206000 | 4.4155          |
| 4.9663        | 79.98 | 206500 | 4.4514          |
| 4.9663        | 80.17 | 207000 | 4.4439          |
| 4.9351        | 80.36 | 207500 | 4.4235          |
| 5.0248        | 80.56 | 208000 | 4.4122          |
| 4.9836        | 80.75 | 208500 | 4.4261          |
| 4.9881        | 80.95 | 209000 | 4.4228          |
| 5.0021        | 81.14 | 209500 | 4.4588          |
| 4.9508        | 81.33 | 210000 | 4.3826          |
| 4.9729        | 81.53 | 210500 | 4.4254          |
| 4.9746        | 81.72 | 211000 | 4.3951          |
| 4.9771        | 81.91 | 211500 | 4.4301          |
| 4.9988        | 82.11 | 212000 | 4.3889          |
| 5.006         | 82.3  | 212500 | 4.4137          |
| 4.9662        | 82.49 | 213000 | 4.4597          |
| 4.9476        | 82.69 | 213500 | 4.4484          |
| 4.9801        | 82.88 | 214000 | 4.4676          |
| 4.9605        | 83.08 | 214500 | 4.3832          |
| 4.9617        | 83.27 | 215000 | 4.3933          |
| 4.9565        | 83.46 | 215500 | 4.4156          |
| 4.9193        | 83.66 | 216000 | 4.4221          |
| 4.942         | 83.85 | 216500 | 4.4150          |
| 4.9504        | 84.04 | 217000 | 4.4034          |
| 4.9469        | 84.24 | 217500 | 4.4364          |
| 4.9519        | 84.43 | 218000 | 4.4306          |
| 4.9555        | 84.62 | 218500 | 4.3787          |
| 4.9558        | 84.82 | 219000 | 4.4363          |
| 4.94          | 85.01 | 219500 | 4.4151          |
| 4.9441        | 85.21 | 220000 | 4.3747          |
| 4.9654        | 85.4  | 220500 | 4.3779          |
| 4.9352        | 85.59 | 221000 | 4.4293          |
| 4.9743        | 85.79 | 221500 | 4.3823          |
| 4.9536        | 85.98 | 222000 | 4.4049          |
| 4.9426        | 86.17 | 222500 | 4.3719          |
| 4.9363        | 86.37 | 223000 | 4.3414          |
| 4.9093        | 86.56 | 223500 | 4.3717          |
| 4.935         | 86.75 | 224000 | 4.3860          |
| 4.9204        | 86.95 | 224500 | 4.3939          |
| 4.926         | 87.14 | 225000 | 4.4328          |
| 4.9291        | 87.34 | 225500 | 4.4435          |
| 4.9162        | 87.53 | 226000 | 4.4062          |
| 4.9298        | 87.72 | 226500 | 4.3990          |
| 4.9743        | 87.92 | 227000 | 4.4284          |
| 4.9135        | 88.11 | 227500 | 4.3740          |
| 4.9138        | 88.3  | 228000 | 4.3697          |
| 4.9686        | 88.5  | 228500 | 4.3498          |
| 4.9263        | 88.69 | 229000 | 4.3457          |
| 4.9453        | 88.88 | 229500 | 4.3315          |
| 4.9329        | 89.08 | 230000 | 4.3874          |
| 4.9277        | 89.27 | 230500 | 4.3627          |
| 4.8942        | 89.47 | 231000 | 4.3674          |
| 4.9496        | 89.66 | 231500 | 4.4107          |
| 4.924         | 89.85 | 232000 | 4.3855          |
| 4.9825        | 90.05 | 232500 | 4.3674          |
| 4.9365        | 90.24 | 233000 | 4.3662          |
| 4.9123        | 90.43 | 233500 | 4.3669          |
| 4.9555        | 90.63 | 234000 | 4.3668          |
| 4.9394        | 90.82 | 234500 | 4.3677          |
| 4.9672        | 91.01 | 235000 | 4.3339          |
| 4.9493        | 91.21 | 235500 | 4.3554          |
| 4.9114        | 91.4  | 236000 | 4.3507          |
| 4.9374        | 91.6  | 236500 | 4.3447          |
| 4.9288        | 91.79 | 237000 | 4.3988          |
| 4.9156        | 91.98 | 237500 | 4.3785          |
| 4.9226        | 92.18 | 238000 | 4.3322          |
| 4.9223        | 92.37 | 238500 | 4.3461          |
| 4.9051        | 92.56 | 239000 | 4.3603          |
| 4.9341        | 92.76 | 239500 | 4.4139          |
| 4.9285        | 92.95 | 240000 | 4.3757          |
| 4.9506        | 93.14 | 240500 | 4.3456          |
| 4.92          | 93.34 | 241000 | 4.3492          |
| 4.9027        | 93.53 | 241500 | 4.3982          |
| 4.9366        | 93.73 | 242000 | 4.3651          |
| 4.9072        | 93.92 | 242500 | 4.3186          |
| 4.9441        | 94.11 | 243000 | 4.3560          |
| 4.874         | 94.31 | 243500 | 4.3749          |
| 4.9246        | 94.5  | 244000 | 4.3345          |
| 4.8971        | 94.69 | 244500 | 4.3497          |
| 4.9234        | 94.89 | 245000 | 4.4110          |
| 4.9396        | 95.08 | 245500 | 4.3645          |
| 4.8943        | 95.27 | 246000 | 4.3204          |
| 4.9194        | 95.47 | 246500 | 4.4034          |
| 4.914         | 95.66 | 247000 | 4.3936          |
| 4.9376        | 95.86 | 247500 | 4.3477          |
| 4.9042        | 96.05 | 248000 | 4.4062          |
| 4.8946        | 96.24 | 248500 | 4.4115          |
| 4.8959        | 96.44 | 249000 | 4.3983          |
| 4.9408        | 96.63 | 249500 | 4.3633          |
| 4.9039        | 96.82 | 250000 | 4.3486          |
| 4.9368        | 97.02 | 250500 | 4.3819          |
| 4.8793        | 97.21 | 251000 | 4.3586          |
| 4.9069        | 97.41 | 251500 | 4.3666          |
| 4.9339        | 97.6  | 252000 | 4.3911          |
| 4.9086        | 97.79 | 252500 | 4.3505          |
| 4.9132        | 97.99 | 253000 | 4.3878          |
| 4.9279        | 98.18 | 253500 | 4.3422          |
| 4.8955        | 98.37 | 254000 | 4.3913          |
| 4.8874        | 98.57 | 254500 | 4.3560          |
| 4.9026        | 98.76 | 255000 | 4.3189          |
| 4.9008        | 98.95 | 255500 | 4.4185          |
| 4.9023        | 99.15 | 256000 | 4.3197          |
| 4.8792        | 99.34 | 256500 | 4.3112          |
| 4.9193        | 99.54 | 257000 | 4.3886          |
| 4.9136        | 99.73 | 257500 | 4.3596          |
| 4.8953        | 99.92 | 258000 | 4.3615          |


### Framework versions

- Transformers 4.24.0
- Pytorch 1.12.1+cu113
- Datasets 2.6.1
- Tokenizers 0.13.2