File size: 35,503 Bytes
2bc6870
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b924e4b
 
 
 
 
2bc6870
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53ad6d9
d6eba47
8a82e17
bff874d
6b6ec78
ea35c7a
695c18a
81555c7
1debcdd
2f03e73
47eda48
22aea34
72ee4d4
8cd99b6
414d598
b416c35
deacb04
608d4dd
fa377d2
37ebf72
6304609
41c2c48
e947221
7e96d8d
6202a72
26fc5e4
da6c6da
e213a21
b437ee2
4184a67
8a14282
7087cca
e8601da
2c71f1c
3a57baa
40cdc38
dbc244a
24449a8
8a6e38f
44af771
f47d714
7a2570a
f21c61a
4e29aef
cddc347
92e6692
39890a5
ef178e0
2f1725c
0a9a238
9a4231c
f6fb138
46118f3
0970377
3e4f7d9
81b73d1
140ca33
ec86b04
c0ae2ee
b773d47
f381da1
c5e3681
ed81298
a184e90
0493f13
8c19c14
fea11bf
15312f9
d1150f8
8b95b24
57f2436
856407b
a3ccac9
b081988
2c14a9c
a8bacfb
a45d2d0
56b8db3
501f2c2
d6eec5d
8a7be0d
79016fb
b462d5b
7e2acb0
07a2804
92f313d
31f5125
c4519c5
cecd273
0498caf
3ed0ca4
911ed44
180fc71
b182b10
4892895
480ba55
873aa27
54b94b0
e4f29cc
3fd0a95
fa7e060
eda5439
a149e87
89ccb2f
da70330
bb2ed78
48dd0c0
17ac284
47e8862
7060013
c4c165f
0218504
db09af3
f463a2d
c5b9d28
b611d45
a097edd
8423f8a
632d6bb
a206ac9
07f5204
27ba289
fef2214
2ac8d53
8365d1e
5754648
d1c64d2
7a551f5
cfbc33e
bf13a11
349119c
3645f22
acc3e67
a477a6e
ebd3445
5962e38
58f6f85
d73623d
3fd7a64
829c5a8
789fa85
7efe436
975137e
32a1197
38b423c
1838e98
191b371
d8ceec1
8dc8c41
af2e5fe
6899740
334c689
cc608da
5ace5c0
a6419a0
ff4c56e
a214d20
fe57908
bcfadde
a0597ba
d4ada39
74a9bed
c4fb21f
3ca2291
70d36ab
7dc78f5
94ae0fd
c15b342
2065c52
a295c51
0288302
96f3510
96c7c70
73c26f2
cc19944
5861f4a
c89a276
bd16236
2a11383
a02420a
11e13a3
e3b30ac
e93cd07
50c86bb
2faded6
b2f57fd
390d368
7bf16ff
d66f452
c137cdc
27cd3d1
10f04f0
c40b861
f480acf
a6e3f7d
381c399
2b6ccc1
60f74a2
6f372d8
fa7dd86
8c494d1
85179f1
ddfa081
35a708b
35f86e5
a0d4609
4dd25f0
2d41754
6eecd14
3640d64
18dd715
11bc0dc
8e1dfe1
494cc84
b44614d
b37e207
5cc1c96
a09f36e
2ebc520
343aa1f
a98db59
14c0748
efe0918
bd69aeb
5723a5d
8979f53
e5337f1
e8e81fc
24c845e
4659656
54f455e
8354ff1
7a6ed70
2c6065f
5d4b56e
17ab57e
b7a72bf
a4f8081
75a6d73
19dcc8d
f90d0ae
a7167d2
009ee0c
0298be1
6a6a33a
669f4ba
c4a0a41
75620d4
1a89347
77f395a
fb4e267
97bde7a
4c0054a
ee94e2f
1c2852c
57f970a
7441366
66743c9
dc19d01
8e2bc5a
539cc39
c5c63e7
4302597
eb833bd
ac9bba3
08b894d
c4e66bd
1cbefdd
8977bdb
79c4c65
6087163
ee36f2c
626ac8f
1f890be
e98ed2f
a184599
7332048
be19d12
994091b
960f68b
db864f0
44fdd7d
eb87f20
1c74141
cc05484
e00b7b3
993370a
b037906
899e39a
8f932c6
e753d9c
e9b5bdb
4f3d37a
deeba03
7f0b4fd
7111837
be77c2a
08b2874
ffbd818
b0a86ec
68b09af
81cf5c7
dc9121f
5da80eb
5f5cf17
19398e2
5dd0b51
2b24129
13b4204
f7ca9b6
99e29d3
fb144e7
f77f0e1
b8d2e7d
05d3e3f
ed15c7c
13b0102
89e84ad
1fc8225
f288a61
a2c19e9
96595c7
c530a03
8cb5957
034a094
8c4099c
8d03573
26ca335
c4b1b46
76e9084
e41d7fa
be18e9c
5486ca1
2a47519
1545c89
1761e6c
99967a8
ff3f480
99a63c1
f9edd26
45d108d
af47315
60772d8
4b3fdb5
0580de8
7416913
e18494f
d498cca
52c233d
bf464b2
e83441e
3e295d0
06f5541
2457194
9915a0f
75e2c75
4dc4b7a
ec7a3f4
bae355f
8ce7f10
352f3b5
cca893f
1512f59
a4981a4
24757ee
a83c64d
bcaccd9
3a44e2d
841eec0
dfaede5
012ca7b
286efe3
dd9456b
e6063e9
4b90837
8b5150d
6e0db10
124e9cf
3b16b08
6655657
5110d1a
c9816d5
eb4e9e4
40edf66
a64bf1e
4ca0bfe
5f4fe79
9089efb
6a5e079
178a331
e52e2fa
9e7c03c
9c1d05e
237f3a1
abe4ff5
8c4e2d3
8a56929
a6a6c50
bf9af96
ddbf3d8
7512c52
81d845e
378b949
127c9ce
d954040
b6cbc43
41fe547
2ede84a
7e02855
bd0cdf2
0c0a35a
f60297c
9f0f3ec
d330b99
ee55077
46ec587
3185af1
44b1a51
a24b50b
8e4fb3c
80258e5
b924e4b
2bc6870
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
---
license: mit
tags:
- generated_from_keras_callback
model-index:
- name: tf-tpu/roberta-base-epochs-500-no-wd
  results: []
---

<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->

# tf-tpu/roberta-base-epochs-500-no-wd

This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 0.7231
- Train Accuracy: 0.1216
- Validation Loss: 0.7935
- Validation Accuracy: 0.1210
- Epoch: 421

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'class_name': 'WarmUp', 'config': {'initial_learning_rate': 0.0001, 'decay_schedule_fn': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 0.0001, 'decay_steps': 278825, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, '__passive_serialization__': True}, 'warmup_steps': 14675, 'power': 1.0, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.001}
- training_precision: mixed_bfloat16

### Training results

| Train Loss | Train Accuracy | Validation Loss | Validation Accuracy | Epoch |
|:----------:|:--------------:|:---------------:|:-------------------:|:-----:|
| 8.3284     | 0.0211         | 7.1523          | 0.0266              | 0     |
| 6.3670     | 0.0318         | 5.7812          | 0.0342              | 1     |
| 5.6051     | 0.0380         | 5.4414          | 0.0420              | 2     |
| 5.3602     | 0.0433         | 5.2734          | 0.0432              | 3     |
| 5.2285     | 0.0444         | 5.1562          | 0.0442              | 4     |
| 5.1371     | 0.0446         | 5.1133          | 0.0436              | 5     |
| 5.0673     | 0.0446         | 5.0703          | 0.0442              | 6     |
| 5.0132     | 0.0447         | 4.9883          | 0.0442              | 7     |
| 4.9642     | 0.0448         | 4.9219          | 0.0441              | 8     |
| 4.9217     | 0.0448         | 4.9258          | 0.0440              | 9     |
| 4.8871     | 0.0448         | 4.8867          | 0.0439              | 10    |
| 4.8548     | 0.0449         | 4.8672          | 0.0439              | 11    |
| 4.8277     | 0.0449         | 4.8047          | 0.0445              | 12    |
| 4.8033     | 0.0449         | 4.8477          | 0.0437              | 13    |
| 4.7807     | 0.0449         | 4.7617          | 0.0439              | 14    |
| 4.7592     | 0.0449         | 4.7773          | 0.0437              | 15    |
| 4.7388     | 0.0449         | 4.7539          | 0.0441              | 16    |
| 4.7225     | 0.0449         | 4.7266          | 0.0439              | 17    |
| 4.7052     | 0.0449         | 4.6914          | 0.0450              | 18    |
| 4.6917     | 0.0449         | 4.7188          | 0.0444              | 19    |
| 4.6789     | 0.0449         | 4.6914          | 0.0444              | 20    |
| 4.6689     | 0.0449         | 4.7031          | 0.0439              | 21    |
| 4.6570     | 0.0449         | 4.7031          | 0.0437              | 22    |
| 4.6486     | 0.0450         | 4.6758          | 0.0446              | 23    |
| 4.6393     | 0.0449         | 4.6914          | 0.0441              | 24    |
| 4.5898     | 0.0449         | 4.4688          | 0.0452              | 25    |
| 4.3024     | 0.0472         | 3.8730          | 0.0551              | 26    |
| 3.1689     | 0.0693         | 2.4375          | 0.0835              | 27    |
| 2.3780     | 0.0844         | 2.0498          | 0.0922              | 28    |
| 2.0789     | 0.0907         | 1.8604          | 0.0958              | 29    |
| 1.9204     | 0.0940         | 1.7549          | 0.0982              | 30    |
| 1.8162     | 0.0961         | 1.6836          | 0.0983              | 31    |
| 1.7370     | 0.0978         | 1.5869          | 0.1014              | 32    |
| 1.6723     | 0.0991         | 1.5381          | 0.1029              | 33    |
| 1.6215     | 0.1002         | 1.5283          | 0.1015              | 34    |
| 1.5753     | 0.1012         | 1.4736          | 0.1037              | 35    |
| 1.5295     | 0.1022         | 1.4238          | 0.1052              | 36    |
| 1.4944     | 0.1030         | 1.4141          | 0.1059              | 37    |
| 1.4631     | 0.1037         | 1.3721          | 0.1053              | 38    |
| 1.4363     | 0.1043         | 1.3467          | 0.1060              | 39    |
| 1.4098     | 0.1049         | 1.3213          | 0.1076              | 40    |
| 1.3867     | 0.1054         | 1.3018          | 0.1071              | 41    |
| 1.3658     | 0.1058         | 1.2832          | 0.1083              | 42    |
| 1.3469     | 0.1063         | 1.2637          | 0.1081              | 43    |
| 1.3288     | 0.1067         | 1.2598          | 0.1082              | 44    |
| 1.3111     | 0.1071         | 1.2334          | 0.1096              | 45    |
| 1.2962     | 0.1075         | 1.2490          | 0.1084              | 46    |
| 1.2816     | 0.1078         | 1.2168          | 0.1093              | 47    |
| 1.2672     | 0.1081         | 1.2070          | 0.1090              | 48    |
| 1.2537     | 0.1084         | 1.1680          | 0.1106              | 49    |
| 1.2411     | 0.1087         | 1.1904          | 0.1094              | 50    |
| 1.2285     | 0.1090         | 1.1709          | 0.1103              | 51    |
| 1.2180     | 0.1093         | 1.1602          | 0.1122              | 52    |
| 1.2075     | 0.1095         | 1.1396          | 0.1117              | 53    |
| 1.1973     | 0.1098         | 1.1191          | 0.1124              | 54    |
| 1.1876     | 0.1100         | 1.1260          | 0.1123              | 55    |
| 1.1782     | 0.1102         | 1.1289          | 0.1111              | 56    |
| 1.1698     | 0.1104         | 1.1211          | 0.1117              | 57    |
| 1.1596     | 0.1106         | 1.0977          | 0.1125              | 58    |
| 1.1530     | 0.1108         | 1.1172          | 0.1118              | 59    |
| 1.1462     | 0.1110         | 1.0703          | 0.1126              | 60    |
| 1.1370     | 0.1112         | 1.0830          | 0.1140              | 61    |
| 1.1309     | 0.1113         | 1.0762          | 0.1119              | 62    |
| 1.1234     | 0.1115         | 1.0625          | 0.1137              | 63    |
| 1.1162     | 0.1117         | 1.0781          | 0.1127              | 64    |
| 1.1114     | 0.1118         | 1.0474          | 0.1138              | 65    |
| 1.1036     | 0.1120         | 1.0703          | 0.1134              | 66    |
| 1.0984     | 0.1121         | 1.0366          | 0.1139              | 67    |
| 1.0931     | 0.1122         | 1.0513          | 0.1134              | 68    |
| 1.0860     | 0.1124         | 1.0264          | 0.1137              | 69    |
| 1.0807     | 0.1126         | 1.0215          | 0.1148              | 70    |
| 1.0758     | 0.1127         | 1.0269          | 0.1143              | 71    |
| 1.0704     | 0.1129         | 1.0356          | 0.1141              | 72    |
| 1.0656     | 0.1129         | 1.0195          | 0.1144              | 73    |
| 1.0607     | 0.1131         | 1.0093          | 0.1146              | 74    |
| 1.0559     | 0.1132         | 0.9956          | 0.1155              | 75    |
| 1.0517     | 0.1133         | 0.9995          | 0.1139              | 76    |
| 1.0462     | 0.1134         | 0.9839          | 0.1151              | 77    |
| 1.0422     | 0.1135         | 0.9868          | 0.1153              | 78    |
| 1.0372     | 0.1137         | 0.9995          | 0.1151              | 79    |
| 1.0340     | 0.1137         | 1.0059          | 0.1153              | 80    |
| 1.0296     | 0.1138         | 0.9961          | 0.1152              | 81    |
| 1.0272     | 0.1138         | 1.0132          | 0.1138              | 82    |
| 1.0211     | 0.1140         | 0.9575          | 0.1150              | 83    |
| 1.0182     | 0.1141         | 0.9868          | 0.1150              | 84    |
| 1.0146     | 0.1142         | 0.9678          | 0.1164              | 85    |
| 1.0111     | 0.1143         | 0.9839          | 0.1161              | 86    |
| 1.0083     | 0.1144         | 0.9722          | 0.1162              | 87    |
| 1.0039     | 0.1144         | 0.9619          | 0.1167              | 88    |
| 1.0017     | 0.1145         | 0.9575          | 0.1151              | 89    |
| 0.9973     | 0.1146         | 0.9624          | 0.1149              | 90    |
| 0.9947     | 0.1147         | 0.9570          | 0.1157              | 91    |
| 0.9921     | 0.1148         | 0.9360          | 0.1166              | 92    |
| 0.9884     | 0.1149         | 0.9546          | 0.1156              | 93    |
| 0.9851     | 0.1149         | 0.9536          | 0.1149              | 94    |
| 0.9829     | 0.1150         | 0.9575          | 0.1163              | 95    |
| 0.9795     | 0.1151         | 0.9561          | 0.1156              | 96    |
| 0.9773     | 0.1151         | 0.9438          | 0.1163              | 97    |
| 0.9740     | 0.1152         | 0.9512          | 0.1169              | 98    |
| 0.9712     | 0.1153         | 0.9375          | 0.1159              | 99    |
| 0.9678     | 0.1154         | 0.9453          | 0.1166              | 100   |
| 0.9660     | 0.1154         | 0.9507          | 0.1169              | 101   |
| 0.9636     | 0.1155         | 0.9507          | 0.1161              | 102   |
| 0.9609     | 0.1155         | 0.9727          | 0.1164              | 103   |
| 0.9589     | 0.1156         | 0.9395          | 0.1176              | 104   |
| 0.9561     | 0.1157         | 0.9346          | 0.1173              | 105   |
| 0.9537     | 0.1157         | 0.9331          | 0.1168              | 106   |
| 0.9515     | 0.1158         | 0.9434          | 0.1161              | 107   |
| 0.9488     | 0.1158         | 0.9131          | 0.1176              | 108   |
| 0.9471     | 0.1159         | 0.9360          | 0.1174              | 109   |
| 0.9449     | 0.1159         | 0.9175          | 0.1164              | 110   |
| 0.9422     | 0.1160         | 0.9121          | 0.1167              | 111   |
| 0.9412     | 0.1160         | 0.8970          | 0.1165              | 112   |
| 0.9379     | 0.1161         | 0.9111          | 0.1175              | 113   |
| 0.9362     | 0.1161         | 0.9048          | 0.1176              | 114   |
| 0.9345     | 0.1162         | 0.9082          | 0.1169              | 115   |
| 0.9317     | 0.1163         | 0.9277          | 0.1169              | 116   |
| 0.9295     | 0.1164         | 0.9292          | 0.1169              | 117   |
| 0.9287     | 0.1163         | 0.9243          | 0.1169              | 118   |
| 0.9266     | 0.1163         | 0.8892          | 0.1170              | 119   |
| 0.9233     | 0.1165         | 0.9058          | 0.1174              | 120   |
| 0.9221     | 0.1165         | 0.9106          | 0.1175              | 121   |
| 0.9205     | 0.1166         | 0.8979          | 0.1173              | 122   |
| 0.9181     | 0.1167         | 0.8989          | 0.1174              | 123   |
| 0.9180     | 0.1166         | 0.9053          | 0.1172              | 124   |
| 0.9158     | 0.1167         | 0.8877          | 0.1176              | 125   |
| 0.9135     | 0.1168         | 0.9160          | 0.1169              | 126   |
| 0.9116     | 0.1167         | 0.8940          | 0.1180              | 127   |
| 0.9095     | 0.1168         | 0.8945          | 0.1173              | 128   |
| 0.9081     | 0.1168         | 0.9126          | 0.1166              | 129   |
| 0.9064     | 0.1169         | 0.8872          | 0.1177              | 130   |
| 0.9053     | 0.1169         | 0.9175          | 0.1172              | 131   |
| 0.9035     | 0.1170         | 0.8989          | 0.1180              | 132   |
| 0.9023     | 0.1170         | 0.8965          | 0.1179              | 133   |
| 0.8999     | 0.1170         | 0.8979          | 0.1181              | 134   |
| 0.8981     | 0.1171         | 0.8799          | 0.1186              | 135   |
| 0.8976     | 0.1171         | 0.8984          | 0.1174              | 136   |
| 0.8957     | 0.1172         | 0.8857          | 0.1181              | 137   |
| 0.8948     | 0.1172         | 0.9019          | 0.1172              | 138   |
| 0.8929     | 0.1172         | 0.8804          | 0.1180              | 139   |
| 0.8915     | 0.1173         | 0.8848          | 0.1183              | 140   |
| 0.8898     | 0.1173         | 0.8911          | 0.1177              | 141   |
| 0.8894     | 0.1173         | 0.9033          | 0.1173              | 142   |
| 0.8869     | 0.1174         | 0.8853          | 0.1184              | 143   |
| 0.8863     | 0.1174         | 0.8921          | 0.1184              | 144   |
| 0.8848     | 0.1175         | 0.8848          | 0.1177              | 145   |
| 0.8838     | 0.1175         | 0.8896          | 0.1177              | 146   |
| 0.8822     | 0.1175         | 0.8945          | 0.1181              | 147   |
| 0.8804     | 0.1176         | 0.8843          | 0.1177              | 148   |
| 0.8794     | 0.1175         | 0.8774          | 0.1181              | 149   |
| 0.8780     | 0.1176         | 0.875           | 0.1178              | 150   |
| 0.8756     | 0.1176         | 0.8862          | 0.1170              | 151   |
| 0.8747     | 0.1177         | 0.8730          | 0.1178              | 152   |
| 0.8737     | 0.1177         | 0.8696          | 0.1195              | 153   |
| 0.8736     | 0.1177         | 0.8726          | 0.1184              | 154   |
| 0.8716     | 0.1178         | 0.8647          | 0.1186              | 155   |
| 0.8705     | 0.1178         | 0.8804          | 0.1179              | 156   |
| 0.8695     | 0.1178         | 0.8652          | 0.1190              | 157   |
| 0.8675     | 0.1179         | 0.8804          | 0.1197              | 158   |
| 0.8670     | 0.1179         | 0.8462          | 0.1192              | 159   |
| 0.8656     | 0.1180         | 0.8594          | 0.1188              | 160   |
| 0.8649     | 0.1180         | 0.8535          | 0.1188              | 161   |
| 0.8633     | 0.1181         | 0.8555          | 0.1185              | 162   |
| 0.8622     | 0.1180         | 0.8633          | 0.1173              | 163   |
| 0.8603     | 0.1181         | 0.8667          | 0.1177              | 164   |
| 0.8598     | 0.1181         | 0.8813          | 0.1185              | 165   |
| 0.8591     | 0.1181         | 0.8862          | 0.1176              | 166   |
| 0.8580     | 0.1181         | 0.8853          | 0.1177              | 167   |
| 0.8573     | 0.1181         | 0.8691          | 0.1181              | 168   |
| 0.8558     | 0.1182         | 0.8481          | 0.1176              | 169   |
| 0.8541     | 0.1182         | 0.8652          | 0.1187              | 170   |
| 0.8541     | 0.1183         | 0.8477          | 0.1198              | 171   |
| 0.8522     | 0.1183         | 0.8721          | 0.1190              | 172   |
| 0.8516     | 0.1183         | 0.8965          | 0.1173              | 173   |
| 0.8506     | 0.1183         | 0.8574          | 0.1173              | 174   |
| 0.8496     | 0.1183         | 0.8452          | 0.1188              | 175   |
| 0.8487     | 0.1184         | 0.8545          | 0.1183              | 176   |
| 0.8478     | 0.1184         | 0.8594          | 0.1191              | 177   |
| 0.8466     | 0.1184         | 0.8608          | 0.1187              | 178   |
| 0.8456     | 0.1184         | 0.8472          | 0.1186              | 179   |
| 0.8451     | 0.1185         | 0.8672          | 0.1178              | 180   |
| 0.8429     | 0.1185         | 0.8364          | 0.1196              | 181   |
| 0.8420     | 0.1185         | 0.8525          | 0.1187              | 182   |
| 0.8419     | 0.1186         | 0.8525          | 0.1196              | 183   |
| 0.8406     | 0.1186         | 0.8521          | 0.1193              | 184   |
| 0.8391     | 0.1186         | 0.8560          | 0.1188              | 185   |
| 0.8396     | 0.1186         | 0.8413          | 0.1188              | 186   |
| 0.8378     | 0.1186         | 0.8628          | 0.1185              | 187   |
| 0.8374     | 0.1186         | 0.8374          | 0.1195              | 188   |
| 0.8364     | 0.1187         | 0.8691          | 0.1189              | 189   |
| 0.8348     | 0.1187         | 0.8457          | 0.1196              | 190   |
| 0.8354     | 0.1187         | 0.8286          | 0.1191              | 191   |
| 0.8334     | 0.1187         | 0.8486          | 0.1187              | 192   |
| 0.8325     | 0.1188         | 0.8535          | 0.1182              | 193   |
| 0.8322     | 0.1188         | 0.8574          | 0.1199              | 194   |
| 0.8314     | 0.1188         | 0.8472          | 0.1202              | 195   |
| 0.8307     | 0.1188         | 0.8584          | 0.1186              | 196   |
| 0.8294     | 0.1189         | 0.8345          | 0.1197              | 197   |
| 0.8285     | 0.1189         | 0.8491          | 0.1181              | 198   |
| 0.8275     | 0.1189         | 0.8472          | 0.1193              | 199   |
| 0.8265     | 0.1189         | 0.8521          | 0.1185              | 200   |
| 0.8262     | 0.1190         | 0.8501          | 0.1195              | 201   |
| 0.8247     | 0.1190         | 0.8491          | 0.1194              | 202   |
| 0.8245     | 0.1190         | 0.8389          | 0.1191              | 203   |
| 0.8237     | 0.1190         | 0.8491          | 0.1184              | 204   |
| 0.8229     | 0.1190         | 0.8525          | 0.1193              | 205   |
| 0.8215     | 0.1190         | 0.8345          | 0.1199              | 206   |
| 0.8213     | 0.1190         | 0.8511          | 0.1206              | 207   |
| 0.8204     | 0.1191         | 0.8296          | 0.1195              | 208   |
| 0.8193     | 0.1192         | 0.8516          | 0.1183              | 209   |
| 0.8195     | 0.1191         | 0.8672          | 0.1181              | 210   |
| 0.8188     | 0.1191         | 0.8267          | 0.1197              | 211   |
| 0.8177     | 0.1192         | 0.8408          | 0.1185              | 212   |
| 0.8167     | 0.1192         | 0.8447          | 0.1191              | 213   |
| 0.8153     | 0.1192         | 0.8374          | 0.1191              | 214   |
| 0.8158     | 0.1192         | 0.8438          | 0.1198              | 215   |
| 0.8149     | 0.1192         | 0.8286          | 0.1191              | 216   |
| 0.8141     | 0.1193         | 0.8389          | 0.1202              | 217   |
| 0.8133     | 0.1192         | 0.8491          | 0.1202              | 218   |
| 0.8127     | 0.1193         | 0.8730          | 0.1185              | 219   |
| 0.8118     | 0.1193         | 0.8198          | 0.1183              | 220   |
| 0.8115     | 0.1193         | 0.8164          | 0.1200              | 221   |
| 0.8095     | 0.1194         | 0.8340          | 0.1195              | 222   |
| 0.8090     | 0.1194         | 0.8071          | 0.1208              | 223   |
| 0.8089     | 0.1194         | 0.8101          | 0.1195              | 224   |
| 0.8081     | 0.1194         | 0.8311          | 0.1184              | 225   |
| 0.8081     | 0.1194         | 0.8413          | 0.1198              | 226   |
| 0.8065     | 0.1195         | 0.8379          | 0.1202              | 227   |
| 0.8064     | 0.1194         | 0.8398          | 0.1196              | 228   |
| 0.8045     | 0.1195         | 0.8159          | 0.1199              | 229   |
| 0.8045     | 0.1195         | 0.8350          | 0.1187              | 230   |
| 0.8049     | 0.1195         | 0.8369          | 0.1191              | 231   |
| 0.8037     | 0.1195         | 0.8159          | 0.1201              | 232   |
| 0.8024     | 0.1196         | 0.8213          | 0.1186              | 233   |
| 0.8023     | 0.1196         | 0.8384          | 0.1187              | 234   |
| 0.8011     | 0.1196         | 0.8262          | 0.1201              | 235   |
| 0.8006     | 0.1196         | 0.8252          | 0.1195              | 236   |
| 0.8005     | 0.1196         | 0.8267          | 0.1196              | 237   |
| 0.7989     | 0.1196         | 0.8389          | 0.1199              | 238   |
| 0.7989     | 0.1196         | 0.8394          | 0.1185              | 239   |
| 0.7983     | 0.1197         | 0.8110          | 0.1208              | 240   |
| 0.7978     | 0.1197         | 0.8066          | 0.1208              | 241   |
| 0.7969     | 0.1197         | 0.8257          | 0.1185              | 242   |
| 0.7954     | 0.1197         | 0.8242          | 0.1189              | 243   |
| 0.7962     | 0.1197         | 0.8291          | 0.1197              | 244   |
| 0.7951     | 0.1197         | 0.8320          | 0.1187              | 245   |
| 0.7944     | 0.1198         | 0.8389          | 0.1184              | 246   |
| 0.7927     | 0.1198         | 0.8184          | 0.1187              | 247   |
| 0.7933     | 0.1198         | 0.8242          | 0.1199              | 248   |
| 0.7935     | 0.1198         | 0.8369          | 0.1192              | 249   |
| 0.7916     | 0.1199         | 0.8242          | 0.1202              | 250   |
| 0.7913     | 0.1198         | 0.8223          | 0.1182              | 251   |
| 0.7902     | 0.1199         | 0.8232          | 0.1192              | 252   |
| 0.7915     | 0.1199         | 0.8159          | 0.1206              | 253   |
| 0.7897     | 0.1198         | 0.8281          | 0.1195              | 254   |
| 0.7894     | 0.1199         | 0.8140          | 0.1193              | 255   |
| 0.7884     | 0.1200         | 0.8379          | 0.1204              | 256   |
| 0.7882     | 0.1199         | 0.8271          | 0.1194              | 257   |
| 0.7872     | 0.1199         | 0.8188          | 0.1198              | 258   |
| 0.7866     | 0.1200         | 0.8174          | 0.1198              | 259   |
| 0.7857     | 0.1200         | 0.8379          | 0.1198              | 260   |
| 0.7859     | 0.1200         | 0.8174          | 0.1204              | 261   |
| 0.7859     | 0.1200         | 0.8228          | 0.1199              | 262   |
| 0.7844     | 0.1200         | 0.8237          | 0.1201              | 263   |
| 0.7844     | 0.1200         | 0.8311          | 0.1185              | 264   |
| 0.7834     | 0.1201         | 0.8193          | 0.1193              | 265   |
| 0.7834     | 0.1201         | 0.8276          | 0.1191              | 266   |
| 0.7833     | 0.1200         | 0.8291          | 0.1194              | 267   |
| 0.7821     | 0.1201         | 0.8335          | 0.1195              | 268   |
| 0.7818     | 0.1201         | 0.8350          | 0.1199              | 269   |
| 0.7812     | 0.1201         | 0.8223          | 0.1184              | 270   |
| 0.7809     | 0.1201         | 0.8330          | 0.1202              | 271   |
| 0.7794     | 0.1202         | 0.8193          | 0.1196              | 272   |
| 0.7793     | 0.1201         | 0.8237          | 0.1201              | 273   |
| 0.7787     | 0.1202         | 0.8389          | 0.1206              | 274   |
| 0.7786     | 0.1202         | 0.8286          | 0.1208              | 275   |
| 0.7788     | 0.1202         | 0.8325          | 0.1202              | 276   |
| 0.7777     | 0.1202         | 0.8301          | 0.1194              | 277   |
| 0.7771     | 0.1202         | 0.8164          | 0.1207              | 278   |
| 0.7762     | 0.1202         | 0.8154          | 0.1194              | 279   |
| 0.7757     | 0.1202         | 0.8242          | 0.1196              | 280   |
| 0.7751     | 0.1203         | 0.8140          | 0.1215              | 281   |
| 0.7751     | 0.1203         | 0.8193          | 0.1197              | 282   |
| 0.7746     | 0.1203         | 0.8008          | 0.1186              | 283   |
| 0.7746     | 0.1203         | 0.8105          | 0.1193              | 284   |
| 0.7733     | 0.1203         | 0.8223          | 0.1206              | 285   |
| 0.7733     | 0.1204         | 0.8125          | 0.1199              | 286   |
| 0.7720     | 0.1204         | 0.8228          | 0.1201              | 287   |
| 0.7721     | 0.1204         | 0.8164          | 0.1203              | 288   |
| 0.7719     | 0.1203         | 0.8359          | 0.1205              | 289   |
| 0.7713     | 0.1203         | 0.8145          | 0.1204              | 290   |
| 0.7703     | 0.1204         | 0.8057          | 0.1202              | 291   |
| 0.7698     | 0.1204         | 0.8174          | 0.1204              | 292   |
| 0.7697     | 0.1204         | 0.8091          | 0.1210              | 293   |
| 0.7686     | 0.1204         | 0.8154          | 0.1195              | 294   |
| 0.7690     | 0.1204         | 0.8242          | 0.1204              | 295   |
| 0.7679     | 0.1205         | 0.7979          | 0.1208              | 296   |
| 0.7680     | 0.1205         | 0.8105          | 0.1194              | 297   |
| 0.7673     | 0.1205         | 0.8003          | 0.1215              | 298   |
| 0.7672     | 0.1205         | 0.7925          | 0.1212              | 299   |
| 0.7661     | 0.1205         | 0.8115          | 0.1191              | 300   |
| 0.7654     | 0.1205         | 0.8188          | 0.1206              | 301   |
| 0.7657     | 0.1205         | 0.8140          | 0.1202              | 302   |
| 0.7644     | 0.1206         | 0.8228          | 0.1199              | 303   |
| 0.7651     | 0.1205         | 0.7954          | 0.1213              | 304   |
| 0.7640     | 0.1206         | 0.7861          | 0.1206              | 305   |
| 0.7633     | 0.1206         | 0.8223          | 0.1194              | 306   |
| 0.7632     | 0.1206         | 0.8037          | 0.1201              | 307   |
| 0.7628     | 0.1206         | 0.8120          | 0.1196              | 308   |
| 0.7633     | 0.1206         | 0.8101          | 0.1198              | 309   |
| 0.7612     | 0.1206         | 0.8296          | 0.1203              | 310   |
| 0.7613     | 0.1206         | 0.8105          | 0.1195              | 311   |
| 0.7614     | 0.1206         | 0.8203          | 0.1201              | 312   |
| 0.7606     | 0.1207         | 0.7900          | 0.1201              | 313   |
| 0.7597     | 0.1207         | 0.8057          | 0.1201              | 314   |
| 0.7600     | 0.1207         | 0.8237          | 0.1189              | 315   |
| 0.7584     | 0.1207         | 0.8315          | 0.1198              | 316   |
| 0.7592     | 0.1207         | 0.8228          | 0.1198              | 317   |
| 0.7678     | 0.1205         | 0.8008          | 0.1205              | 318   |
| 0.7598     | 0.1207         | 0.8091          | 0.1216              | 319   |
| 0.7579     | 0.1208         | 0.8174          | 0.1202              | 320   |
| 0.7572     | 0.1207         | 0.8232          | 0.1196              | 321   |
| 0.7565     | 0.1207         | 0.8018          | 0.1192              | 322   |
| 0.7556     | 0.1208         | 0.7949          | 0.1207              | 323   |
| 0.7555     | 0.1208         | 0.8105          | 0.1200              | 324   |
| 0.7555     | 0.1208         | 0.7925          | 0.1208              | 325   |
| 0.7553     | 0.1208         | 0.7847          | 0.1201              | 326   |
| 0.7544     | 0.1208         | 0.8022          | 0.1208              | 327   |
| 0.7542     | 0.1208         | 0.8096          | 0.1203              | 328   |
| 0.7540     | 0.1208         | 0.7949          | 0.1209              | 329   |
| 0.7536     | 0.1209         | 0.8184          | 0.1205              | 330   |
| 0.7536     | 0.1208         | 0.8013          | 0.1209              | 331   |
| 0.7531     | 0.1209         | 0.8149          | 0.1197              | 332   |
| 0.7523     | 0.1209         | 0.8110          | 0.1197              | 333   |
| 0.7521     | 0.1209         | 0.7998          | 0.1208              | 334   |
| 0.7519     | 0.1209         | 0.7798          | 0.1211              | 335   |
| 0.7505     | 0.1209         | 0.8076          | 0.1202              | 336   |
| 0.7504     | 0.1210         | 0.7974          | 0.1217              | 337   |
| 0.7506     | 0.1210         | 0.7910          | 0.1206              | 338   |
| 0.7493     | 0.1209         | 0.7969          | 0.1209              | 339   |
| 0.7498     | 0.1209         | 0.8105          | 0.1205              | 340   |
| 0.7493     | 0.1209         | 0.8145          | 0.1204              | 341   |
| 0.7491     | 0.1210         | 0.8062          | 0.1209              | 342   |
| 0.7485     | 0.1210         | 0.8091          | 0.1199              | 343   |
| 0.7480     | 0.1210         | 0.8101          | 0.1201              | 344   |
| 0.7482     | 0.1209         | 0.7993          | 0.1203              | 345   |
| 0.7468     | 0.1210         | 0.7939          | 0.1213              | 346   |
| 0.7473     | 0.1210         | 0.8140          | 0.1201              | 347   |
| 0.7468     | 0.1210         | 0.8066          | 0.1201              | 348   |
| 0.7460     | 0.1211         | 0.7964          | 0.1208              | 349   |
| 0.7460     | 0.1210         | 0.8184          | 0.1206              | 350   |
| 0.7446     | 0.1211         | 0.8047          | 0.1199              | 351   |
| 0.7453     | 0.1211         | 0.8091          | 0.1197              | 352   |
| 0.7449     | 0.1211         | 0.7969          | 0.1201              | 353   |
| 0.7441     | 0.1211         | 0.7905          | 0.1210              | 354   |
| 0.7437     | 0.1211         | 0.8018          | 0.1207              | 355   |
| 0.7439     | 0.1211         | 0.8013          | 0.1203              | 356   |
| 0.7437     | 0.1211         | 0.8130          | 0.1204              | 357   |
| 0.7426     | 0.1211         | 0.8013          | 0.1205              | 358   |
| 0.7419     | 0.1211         | 0.8003          | 0.1199              | 359   |
| 0.7421     | 0.1212         | 0.8081          | 0.1200              | 360   |
| 0.7417     | 0.1212         | 0.7964          | 0.1199              | 361   |
| 0.7408     | 0.1212         | 0.8027          | 0.1203              | 362   |
| 0.7404     | 0.1212         | 0.8052          | 0.1207              | 363   |
| 0.7402     | 0.1212         | 0.7993          | 0.1204              | 364   |
| 0.7412     | 0.1212         | 0.7896          | 0.1207              | 365   |
| 0.7404     | 0.1212         | 0.8071          | 0.1208              | 366   |
| 0.7398     | 0.1212         | 0.8037          | 0.1196              | 367   |
| 0.7389     | 0.1212         | 0.7949          | 0.1194              | 368   |
| 0.7399     | 0.1212         | 0.8125          | 0.1211              | 369   |
| 0.7389     | 0.1212         | 0.8101          | 0.1201              | 370   |
| 0.7380     | 0.1212         | 0.7983          | 0.1207              | 371   |
| 0.7380     | 0.1213         | 0.7969          | 0.1210              | 372   |
| 0.7373     | 0.1212         | 0.7822          | 0.1204              | 373   |
| 0.7367     | 0.1213         | 0.8164          | 0.1204              | 374   |
| 0.7370     | 0.1213         | 0.7920          | 0.1205              | 375   |
| 0.7366     | 0.1213         | 0.7842          | 0.1205              | 376   |
| 0.7362     | 0.1213         | 0.7905          | 0.1205              | 377   |
| 0.7359     | 0.1213         | 0.8105          | 0.1200              | 378   |
| 0.7360     | 0.1213         | 0.8037          | 0.1203              | 379   |
| 0.7352     | 0.1213         | 0.7974          | 0.1203              | 380   |
| 0.7350     | 0.1213         | 0.8140          | 0.1203              | 381   |
| 0.7341     | 0.1213         | 0.7891          | 0.1217              | 382   |
| 0.7349     | 0.1214         | 0.7891          | 0.1208              | 383   |
| 0.7340     | 0.1214         | 0.7739          | 0.1208              | 384   |
| 0.7339     | 0.1214         | 0.7871          | 0.1210              | 385   |
| 0.7334     | 0.1214         | 0.7856          | 0.1205              | 386   |
| 0.7337     | 0.1214         | 0.7856          | 0.1201              | 387   |
| 0.7330     | 0.1214         | 0.7817          | 0.1203              | 388   |
| 0.7334     | 0.1214         | 0.8193          | 0.1215              | 389   |
| 0.7319     | 0.1214         | 0.7788          | 0.1208              | 390   |
| 0.7319     | 0.1214         | 0.8042          | 0.1203              | 391   |
| 0.7315     | 0.1214         | 0.7935          | 0.1211              | 392   |
| 0.7312     | 0.1214         | 0.7959          | 0.1198              | 393   |
| 0.7310     | 0.1215         | 0.7993          | 0.1207              | 394   |
| 0.7300     | 0.1214         | 0.8057          | 0.1208              | 395   |
| 0.7302     | 0.1215         | 0.8008          | 0.1202              | 396   |
| 0.7306     | 0.1214         | 0.7817          | 0.1212              | 397   |
| 0.7293     | 0.1215         | 0.7827          | 0.1207              | 398   |
| 0.7288     | 0.1215         | 0.8115          | 0.1202              | 399   |
| 0.7296     | 0.1215         | 0.7998          | 0.1206              | 400   |
| 0.7290     | 0.1215         | 0.7983          | 0.1208              | 401   |
| 0.7284     | 0.1215         | 0.7842          | 0.1219              | 402   |
| 0.7280     | 0.1215         | 0.7896          | 0.1221              | 403   |
| 0.7282     | 0.1215         | 0.7935          | 0.1199              | 404   |
| 0.7266     | 0.1215         | 0.7891          | 0.1208              | 405   |
| 0.7276     | 0.1216         | 0.7808          | 0.1209              | 406   |
| 0.7275     | 0.1215         | 0.7842          | 0.1204              | 407   |
| 0.7266     | 0.1216         | 0.7930          | 0.1210              | 408   |
| 0.7262     | 0.1215         | 0.8042          | 0.1204              | 409   |
| 0.7258     | 0.1216         | 0.8071          | 0.1217              | 410   |
| 0.7253     | 0.1216         | 0.7920          | 0.1198              | 411   |
| 0.7258     | 0.1216         | 0.7979          | 0.1211              | 412   |
| 0.7256     | 0.1215         | 0.8066          | 0.1200              | 413   |
| 0.7246     | 0.1216         | 0.7749          | 0.1213              | 414   |
| 0.7246     | 0.1216         | 0.7861          | 0.1214              | 415   |
| 0.7238     | 0.1216         | 0.8101          | 0.1204              | 416   |
| 0.7244     | 0.1216         | 0.7939          | 0.1213              | 417   |
| 0.7243     | 0.1216         | 0.7896          | 0.1219              | 418   |
| 0.7233     | 0.1216         | 0.7891          | 0.1216              | 419   |
| 0.7238     | 0.1217         | 0.7930          | 0.1216              | 420   |
| 0.7231     | 0.1216         | 0.7935          | 0.1210              | 421   |


### Framework versions

- Transformers 4.27.0.dev0
- TensorFlow 2.9.1
- Tokenizers 0.13.2