File size: 36,700 Bytes
f6854bb
 
 
 
cf470a4
 
f6854bb
 
 
 
 
 
 
 
 
 
 
cf470a4
f6854bb
2bb8538
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f6854bb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2bb8538
f6854bb
 
 
 
 
 
 
 
 
 
2bb8538
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f6854bb
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
---
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-cppe-5-10k-steps
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# detr-finetuned-cppe-5-10k-steps

This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.2634
- Map: 0.3099
- Map 50: 0.596
- Map 75: 0.2729
- Map Small: 0.0887
- Map Medium: 0.2527
- Map Large: 0.4839
- Mar 1: 0.2938
- Mar 10: 0.4679
- Mar 100: 0.4801
- Mar Small: 0.1859
- Mar Medium: 0.4322
- Mar Large: 0.6546
- Map Coverall: 0.5624
- Mar 100 Coverall: 0.6788
- Map Face Shield: 0.287
- Mar 100 Face Shield: 0.5304
- Map Gloves: 0.2456
- Mar 100 Gloves: 0.4116
- Map Goggles: 0.17
- Mar 100 Goggles: 0.3815
- Map Mask: 0.2843
- Mar 100 Mask: 0.3982

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 2.4009        | 1.0   | 107   | 2.2015          | 0.0541 | 0.1103 | 0.048  | 0.0047    | 0.0306     | 0.0619    | 0.072  | 0.1681 | 0.1971  | 0.0667    | 0.1397     | 0.2614    | 0.251        | 0.5788           | 0.0             | 0.0                 | 0.0054     | 0.1513         | 0.0         | 0.0             | 0.0142   | 0.2556       |
| 1.9619        | 2.0   | 214   | 2.0515          | 0.0655 | 0.141  | 0.0509 | 0.0082    | 0.0445     | 0.074     | 0.0896 | 0.1823 | 0.2168  | 0.0864    | 0.1683     | 0.2591    | 0.2839       | 0.577            | 0.0             | 0.0                 | 0.0139     | 0.2156         | 0.0         | 0.0             | 0.0299   | 0.2911       |
| 1.9217        | 3.0   | 321   | 2.0117          | 0.081  | 0.1819 | 0.0624 | 0.0141    | 0.0511     | 0.0972    | 0.0824 | 0.1792 | 0.201   | 0.0816    | 0.1546     | 0.2373    | 0.3187       | 0.5275           | 0.0             | 0.0                 | 0.0238     | 0.1879         | 0.0         | 0.0             | 0.0624   | 0.2893       |
| 1.8179        | 4.0   | 428   | 2.0698          | 0.0751 | 0.172  | 0.0567 | 0.017     | 0.0596     | 0.0916    | 0.0923 | 0.1794 | 0.2009  | 0.0586    | 0.1418     | 0.264     | 0.3068       | 0.5838           | 0.0051          | 0.0392              | 0.0318     | 0.1871         | 0.0         | 0.0             | 0.032    | 0.1947       |
| 1.7692        | 5.0   | 535   | 1.8755          | 0.1017 | 0.2381 | 0.0751 | 0.0271    | 0.0783     | 0.1362    | 0.1155 | 0.2277 | 0.2474  | 0.0956    | 0.1799     | 0.3309    | 0.3285       | 0.5833           | 0.0316          | 0.1392              | 0.0431     | 0.2371         | 0.0         | 0.0             | 0.1056   | 0.2773       |
| 1.7545        | 6.0   | 642   | 1.9933          | 0.0781 | 0.1909 | 0.0567 | 0.0273    | 0.0808     | 0.0976    | 0.1122 | 0.2294 | 0.2492  | 0.0865    | 0.1995     | 0.3073    | 0.2437       | 0.5523           | 0.0194          | 0.1937              | 0.0316     | 0.2259         | 0.0004      | 0.0154          | 0.0952   | 0.2587       |
| 1.6804        | 7.0   | 749   | 1.7828          | 0.1131 | 0.2575 | 0.0886 | 0.0424    | 0.0937     | 0.146     | 0.1329 | 0.2577 | 0.2782  | 0.0998    | 0.2156     | 0.3716    | 0.3505       | 0.5973           | 0.0416          | 0.2228              | 0.0332     | 0.2214         | 0.0047      | 0.0523          | 0.1357   | 0.2973       |
| 1.6654        | 8.0   | 856   | 1.9042          | 0.1083 | 0.2233 | 0.0989 | 0.0375    | 0.0856     | 0.1512    | 0.119  | 0.2209 | 0.2425  | 0.0997    | 0.184      | 0.3262    | 0.3451       | 0.5788           | 0.0116          | 0.1291              | 0.0387     | 0.2254         | 0.0005      | 0.0077          | 0.1456   | 0.2716       |
| 1.6088        | 9.0   | 963   | 1.6943          | 0.138  | 0.2833 | 0.1157 | 0.0426    | 0.1149     | 0.1627    | 0.1488 | 0.2863 | 0.312   | 0.1169    | 0.2619     | 0.3846    | 0.4569       | 0.6378           | 0.0613          | 0.2722              | 0.049      | 0.2946         | 0.005       | 0.0846          | 0.118    | 0.2707       |
| 1.5138        | 10.0  | 1070  | 1.7314          | 0.1228 | 0.2824 | 0.0887 | 0.0513    | 0.0925     | 0.1645    | 0.1352 | 0.2706 | 0.2938  | 0.1068    | 0.2145     | 0.4247    | 0.3955       | 0.6171           | 0.0583          | 0.2278              | 0.0518     | 0.2853         | 0.0018      | 0.1031          | 0.1066   | 0.2356       |
| 1.5027        | 11.0  | 1177  | 1.6321          | 0.1525 | 0.3448 | 0.1173 | 0.0483    | 0.1088     | 0.2251    | 0.1712 | 0.3401 | 0.3617  | 0.145     | 0.2811     | 0.5185    | 0.4591       | 0.6631           | 0.0774          | 0.3494              | 0.0626     | 0.267          | 0.0169      | 0.2477          | 0.1462   | 0.2813       |
| 1.4677        | 12.0  | 1284  | 2.0406          | 0.1067 | 0.2526 | 0.0761 | 0.0463    | 0.0982     | 0.1369    | 0.1356 | 0.2686 | 0.2953  | 0.1097    | 0.2651     | 0.3816    | 0.2757       | 0.4491           | 0.0601          | 0.2924              | 0.0522     | 0.2647         | 0.0058      | 0.1877          | 0.1395   | 0.2827       |
| 1.5372        | 13.0  | 1391  | 1.7044          | 0.1409 | 0.3314 | 0.1034 | 0.031     | 0.1141     | 0.2107    | 0.1673 | 0.3155 | 0.3429  | 0.1238    | 0.2776     | 0.4824    | 0.4096       | 0.645            | 0.0739          | 0.2785              | 0.0663     | 0.3125         | 0.0267      | 0.1769          | 0.1283   | 0.3018       |
| 1.4344        | 14.0  | 1498  | 1.7464          | 0.1481 | 0.3142 | 0.1286 | 0.0403    | 0.1117     | 0.2116    | 0.1794 | 0.3172 | 0.341   | 0.1046    | 0.2626     | 0.4956    | 0.4386       | 0.6342           | 0.0826          | 0.3241              | 0.0722     | 0.2982         | 0.0146      | 0.1892          | 0.1323   | 0.2591       |
| 1.4229        | 15.0  | 1605  | 1.6013          | 0.1702 | 0.3561 | 0.1491 | 0.0498    | 0.138      | 0.2444    | 0.2054 | 0.3503 | 0.3777  | 0.1116    | 0.3163     | 0.5359    | 0.4423       | 0.6284           | 0.1069          | 0.3937              | 0.074      | 0.3201         | 0.0344      | 0.2292          | 0.1933   | 0.3169       |
| 1.4626        | 16.0  | 1712  | 1.6146          | 0.1503 | 0.3349 | 0.1185 | 0.0503    | 0.1274     | 0.2149    | 0.1799 | 0.3338 | 0.3528  | 0.1451    | 0.2873     | 0.5005    | 0.4158       | 0.6068           | 0.0656          | 0.2962              | 0.0705     | 0.2982         | 0.0132      | 0.2538          | 0.1864   | 0.3089       |
| 1.3855        | 17.0  | 1819  | 1.5998          | 0.161  | 0.3442 | 0.1209 | 0.0365    | 0.133      | 0.2319    | 0.1891 | 0.3623 | 0.3843  | 0.1518    | 0.3293     | 0.5154    | 0.4465       | 0.6369           | 0.0996          | 0.3443              | 0.0744     | 0.3129         | 0.0265      | 0.3185          | 0.158    | 0.3089       |
| 1.3531        | 18.0  | 1926  | 1.5662          | 0.1806 | 0.3906 | 0.1542 | 0.0565    | 0.1444     | 0.2585    | 0.1988 | 0.3576 | 0.3809  | 0.137     | 0.3324     | 0.5082    | 0.4618       | 0.6239           | 0.1185          | 0.3519              | 0.0802     | 0.3232         | 0.0338      | 0.2723          | 0.2084   | 0.3333       |
| 1.3227        | 19.0  | 2033  | 1.5096          | 0.1851 | 0.3799 | 0.1724 | 0.0602    | 0.1443     | 0.2829    | 0.2075 | 0.3738 | 0.3996  | 0.1532    | 0.337      | 0.5536    | 0.4967       | 0.6432           | 0.1089          | 0.3418              | 0.0842     | 0.3241         | 0.0392      | 0.3415          | 0.1964   | 0.3476       |
| 1.3247        | 20.0  | 2140  | 1.6135          | 0.1667 | 0.3672 | 0.1345 | 0.0526    | 0.1349     | 0.2451    | 0.1985 | 0.343  | 0.3669  | 0.1391    | 0.2932     | 0.5312    | 0.417        | 0.5865           | 0.0951          | 0.3481              | 0.0787     | 0.3321         | 0.0545      | 0.2585          | 0.1881   | 0.3093       |
| 1.3415        | 21.0  | 2247  | 1.5346          | 0.1817 | 0.3858 | 0.1538 | 0.0469    | 0.1346     | 0.2846    | 0.208  | 0.3571 | 0.3861  | 0.1497    | 0.3171     | 0.5396    | 0.4553       | 0.6315           | 0.1341          | 0.3494              | 0.093      | 0.3665         | 0.0299      | 0.26            | 0.1963   | 0.3231       |
| 1.2842        | 22.0  | 2354  | 1.5234          | 0.1726 | 0.3864 | 0.1334 | 0.0522    | 0.1229     | 0.2889    | 0.1963 | 0.3537 | 0.3769  | 0.1175    | 0.3062     | 0.5458    | 0.4454       | 0.6347           | 0.1191          | 0.3354              | 0.1017     | 0.3281         | 0.0394      | 0.3015          | 0.1572   | 0.2849       |
| 1.2719        | 23.0  | 2461  | 1.5006          | 0.1954 | 0.4054 | 0.1682 | 0.036     | 0.1567     | 0.2928    | 0.2095 | 0.3811 | 0.4064  | 0.1288    | 0.3401     | 0.5824    | 0.486        | 0.6928           | 0.1188          | 0.343               | 0.1206     | 0.3317         | 0.033       | 0.3185          | 0.2187   | 0.3458       |
| 1.2579        | 24.0  | 2568  | 1.5025          | 0.1841 | 0.3897 | 0.1493 | 0.0533    | 0.1558     | 0.2693    | 0.2153 | 0.3749 | 0.3993  | 0.1524    | 0.3551     | 0.5345    | 0.4639       | 0.6613           | 0.1269          | 0.3304              | 0.1017     | 0.3371         | 0.0397      | 0.3462          | 0.1882   | 0.3218       |
| 1.2554        | 25.0  | 2675  | 1.4877          | 0.1827 | 0.3852 | 0.1541 | 0.0538    | 0.1533     | 0.2853    | 0.2052 | 0.3666 | 0.3852  | 0.1488    | 0.3337     | 0.5221    | 0.4777       | 0.655            | 0.1071          | 0.3253              | 0.0929     | 0.3214         | 0.0292      | 0.2846          | 0.2066   | 0.3396       |
| 1.2252        | 26.0  | 2782  | 1.5077          | 0.1859 | 0.4021 | 0.1599 | 0.0402    | 0.1372     | 0.2948    | 0.216  | 0.3777 | 0.3912  | 0.1225    | 0.3302     | 0.5665    | 0.5031       | 0.6662           | 0.0959          | 0.3848              | 0.1001     | 0.296          | 0.0513      | 0.2985          | 0.1789   | 0.3107       |
| 1.2314        | 27.0  | 2889  | 1.4769          | 0.2077 | 0.4372 | 0.1761 | 0.063     | 0.163      | 0.3194    | 0.2307 | 0.3987 | 0.4126  | 0.152     | 0.3529     | 0.5795    | 0.5016       | 0.6667           | 0.1184          | 0.3797              | 0.1413     | 0.3455         | 0.0468      | 0.3138          | 0.2302   | 0.3573       |
| 1.1945        | 28.0  | 2996  | 1.4541          | 0.2162 | 0.445  | 0.1861 | 0.071     | 0.1627     | 0.3288    | 0.2301 | 0.4001 | 0.4205  | 0.1289    | 0.3657     | 0.5911    | 0.5064       | 0.6716           | 0.1342          | 0.3873              | 0.1525     | 0.3406         | 0.0425      | 0.3446          | 0.2453   | 0.3582       |
| 1.1846        | 29.0  | 3103  | 1.4515          | 0.2166 | 0.4623 | 0.1829 | 0.0571    | 0.168      | 0.3319    | 0.233  | 0.373  | 0.3875  | 0.142     | 0.3222     | 0.5468    | 0.4959       | 0.6631           | 0.149           | 0.3291              | 0.1491     | 0.3522         | 0.0821      | 0.2862          | 0.2071   | 0.3071       |
| 1.1851        | 30.0  | 3210  | 1.3980          | 0.2164 | 0.4486 | 0.1748 | 0.0629    | 0.1659     | 0.3566    | 0.2247 | 0.39   | 0.4034  | 0.1436    | 0.3397     | 0.572     | 0.4939       | 0.6586           | 0.125           | 0.3519              | 0.1682     | 0.3857         | 0.0753      | 0.2892          | 0.2195   | 0.3316       |
| 1.1445        | 31.0  | 3317  | 1.4215          | 0.2134 | 0.4586 | 0.1612 | 0.071     | 0.1498     | 0.3323    | 0.2341 | 0.3731 | 0.3852  | 0.1735    | 0.3155     | 0.5395    | 0.5085       | 0.6626           | 0.1335          | 0.3291              | 0.1568     | 0.3491         | 0.0514      | 0.2538          | 0.2166   | 0.3316       |
| 1.1553        | 32.0  | 3424  | 1.4463          | 0.2218 | 0.4616 | 0.1857 | 0.0786    | 0.1532     | 0.3475    | 0.2378 | 0.406  | 0.4218  | 0.1866    | 0.3423     | 0.576     | 0.4982       | 0.6653           | 0.1843          | 0.4                 | 0.1508     | 0.3621         | 0.0442      | 0.3231          | 0.2314   | 0.3587       |
| 1.1677        | 33.0  | 3531  | 1.4201          | 0.2164 | 0.4494 | 0.1867 | 0.0566    | 0.1779     | 0.3404    | 0.2327 | 0.3895 | 0.4036  | 0.1341    | 0.3431     | 0.5815    | 0.4834       | 0.6685           | 0.1661          | 0.3861              | 0.1583     | 0.3362         | 0.0474      | 0.2769          | 0.2266   | 0.3502       |
| 1.1419        | 34.0  | 3638  | 1.4068          | 0.2188 | 0.4421 | 0.1864 | 0.0565    | 0.1688     | 0.3454    | 0.2314 | 0.3822 | 0.396   | 0.1336    | 0.3287     | 0.5702    | 0.5032       | 0.6599           | 0.1144          | 0.3253              | 0.157      | 0.3799         | 0.066       | 0.2723          | 0.2536   | 0.3427       |
| 1.1598        | 35.0  | 3745  | 1.4241          | 0.2107 | 0.4404 | 0.1806 | 0.0513    | 0.1618     | 0.3457    | 0.2361 | 0.3867 | 0.4023  | 0.1441    | 0.326      | 0.5865    | 0.4877       | 0.6604           | 0.1439          | 0.3557              | 0.1516     | 0.383          | 0.0728      | 0.3092          | 0.1975   | 0.3031       |
| 1.1291        | 36.0  | 3852  | 1.4203          | 0.2222 | 0.4631 | 0.1865 | 0.066     | 0.1776     | 0.3377    | 0.2356 | 0.3772 | 0.3887  | 0.1168    | 0.3203     | 0.5732    | 0.505        | 0.6644           | 0.1357          | 0.3215              | 0.1785     | 0.3723         | 0.0542      | 0.2446          | 0.2373   | 0.3404       |
| 1.096         | 37.0  | 3959  | 1.3647          | 0.2364 | 0.4779 | 0.1936 | 0.0782    | 0.1885     | 0.3579    | 0.2595 | 0.4158 | 0.4281  | 0.1397    | 0.3684     | 0.6116    | 0.5178       | 0.6649           | 0.174           | 0.4127              | 0.1687     | 0.3705         | 0.0803      | 0.3523          | 0.241    | 0.34         |
| 1.0876        | 38.0  | 4066  | 1.3592          | 0.2274 | 0.4462 | 0.1904 | 0.0677    | 0.1866     | 0.3538    | 0.2517 | 0.4023 | 0.4187  | 0.1562    | 0.3569     | 0.5983    | 0.4942       | 0.6554           | 0.1468          | 0.3772              | 0.1491     | 0.3781         | 0.0961      | 0.3246          | 0.2509   | 0.3582       |
| 1.075         | 39.0  | 4173  | 1.3624          | 0.237  | 0.482  | 0.1985 | 0.0592    | 0.1942     | 0.3643    | 0.2539 | 0.4113 | 0.4271  | 0.1483    | 0.3677     | 0.6145    | 0.5251       | 0.6689           | 0.2008          | 0.4468              | 0.1737     | 0.3759         | 0.0632      | 0.3108          | 0.2222   | 0.3333       |
| 1.0633        | 40.0  | 4280  | 1.3988          | 0.2331 | 0.4787 | 0.2002 | 0.0776    | 0.1857     | 0.3435    | 0.2543 | 0.4143 | 0.429   | 0.1688    | 0.3526     | 0.6167    | 0.5078       | 0.6689           | 0.1643          | 0.4063              | 0.163      | 0.3415         | 0.0704      | 0.36            | 0.2599   | 0.3684       |
| 1.0683        | 41.0  | 4387  | 1.3223          | 0.2351 | 0.4708 | 0.2088 | 0.0783    | 0.1803     | 0.3628    | 0.2589 | 0.4306 | 0.4437  | 0.1782    | 0.3797     | 0.6223    | 0.5129       | 0.6523           | 0.1562          | 0.4595              | 0.1643     | 0.3817         | 0.0694      | 0.3431          | 0.2727   | 0.3818       |
| 1.0511        | 42.0  | 4494  | 1.3158          | 0.2453 | 0.4814 | 0.2198 | 0.0672    | 0.1869     | 0.3895    | 0.2569 | 0.4248 | 0.4392  | 0.1584    | 0.3756     | 0.6266    | 0.5327       | 0.673            | 0.1771          | 0.4456              | 0.1861     | 0.3888         | 0.0701      | 0.3246          | 0.2603   | 0.364        |
| 1.0551        | 43.0  | 4601  | 1.3500          | 0.2295 | 0.479  | 0.2007 | 0.0772    | 0.1804     | 0.3539    | 0.2472 | 0.3923 | 0.4077  | 0.1766    | 0.3437     | 0.5737    | 0.4986       | 0.6446           | 0.1586          | 0.3696              | 0.1691     | 0.3705         | 0.0699      | 0.3015          | 0.2511   | 0.352        |
| 1.0341        | 44.0  | 4708  | 1.3675          | 0.2456 | 0.4914 | 0.2131 | 0.0711    | 0.1904     | 0.3756    | 0.255  | 0.4115 | 0.425   | 0.1642    | 0.3599     | 0.6005    | 0.5271       | 0.6644           | 0.1833          | 0.4278              | 0.1683     | 0.3536         | 0.0662      | 0.2969          | 0.2829   | 0.3822       |
| 1.0243        | 45.0  | 4815  | 1.3230          | 0.2437 | 0.4966 | 0.207  | 0.0669    | 0.1826     | 0.3743    | 0.2617 | 0.4168 | 0.4305  | 0.1695    | 0.3629     | 0.5994    | 0.5194       | 0.6586           | 0.1745          | 0.4152              | 0.1893     | 0.3795         | 0.0703      | 0.3308          | 0.265    | 0.3684       |
| 1.0241        | 46.0  | 4922  | 1.3187          | 0.2588 | 0.5071 | 0.2314 | 0.0786    | 0.1978     | 0.4126    | 0.2605 | 0.4227 | 0.4347  | 0.1652    | 0.3725     | 0.6235    | 0.5458       | 0.6644           | 0.1982          | 0.4278              | 0.1938     | 0.3625         | 0.0753      | 0.3262          | 0.2808   | 0.3924       |
| 1.0048        | 47.0  | 5029  | 1.3505          | 0.2531 | 0.5007 | 0.2184 | 0.0709    | 0.2029     | 0.3913    | 0.2573 | 0.4229 | 0.4368  | 0.1606    | 0.3813     | 0.6183    | 0.5414       | 0.6604           | 0.192           | 0.4278              | 0.1871     | 0.3768         | 0.0701      | 0.34            | 0.2748   | 0.3791       |
| 0.9981        | 48.0  | 5136  | 1.3362          | 0.2565 | 0.5238 | 0.212  | 0.0778    | 0.2031     | 0.407     | 0.2666 | 0.4311 | 0.4462  | 0.1734    | 0.3905     | 0.6217    | 0.5228       | 0.6622           | 0.1931          | 0.4316              | 0.2016     | 0.3848         | 0.094       | 0.3677          | 0.2708   | 0.3844       |
| 1.0127        | 49.0  | 5243  | 1.3352          | 0.2625 | 0.5179 | 0.2331 | 0.0792    | 0.2182     | 0.3988    | 0.2685 | 0.4368 | 0.4503  | 0.1771    | 0.397      | 0.6254    | 0.5292       | 0.6514           | 0.2139          | 0.4646              | 0.1983     | 0.3772         | 0.0746      | 0.3692          | 0.2966   | 0.3889       |
| 0.9859        | 50.0  | 5350  | 1.3692          | 0.2409 | 0.5163 | 0.1868 | 0.0749    | 0.1902     | 0.3812    | 0.2533 | 0.4147 | 0.4263  | 0.1627    | 0.3588     | 0.6132    | 0.5044       | 0.6459           | 0.206           | 0.4506              | 0.1907     | 0.3723         | 0.0675      | 0.3292          | 0.2358   | 0.3333       |
| 1.0001        | 51.0  | 5457  | 1.3070          | 0.2558 | 0.5255 | 0.2112 | 0.0744    | 0.2043     | 0.4002    | 0.2606 | 0.4254 | 0.4382  | 0.202     | 0.3623     | 0.6226    | 0.5164       | 0.6477           | 0.1989          | 0.4253              | 0.1925     | 0.4098         | 0.0936      | 0.3477          | 0.2777   | 0.3604       |
| 0.9725        | 52.0  | 5564  | 1.3240          | 0.2516 | 0.5075 | 0.2051 | 0.0853    | 0.2073     | 0.3728    | 0.2582 | 0.4193 | 0.4324  | 0.2053    | 0.3656     | 0.5998    | 0.533        | 0.6505           | 0.1893          | 0.4038              | 0.1737     | 0.3915         | 0.0938      | 0.34            | 0.2681   | 0.3764       |
| 0.9618        | 53.0  | 5671  | 1.3466          | 0.2592 | 0.5248 | 0.2268 | 0.088     | 0.2087     | 0.3949    | 0.2596 | 0.4196 | 0.4346  | 0.1842    | 0.3713     | 0.61      | 0.5231       | 0.6568           | 0.202           | 0.4038              | 0.1989     | 0.3879         | 0.1008      | 0.36            | 0.2713   | 0.3644       |
| 0.9775        | 54.0  | 5778  | 1.3195          | 0.2684 | 0.5322 | 0.2327 | 0.0851    | 0.2242     | 0.411     | 0.2726 | 0.4355 | 0.4464  | 0.1777    | 0.3968     | 0.6122    | 0.5223       | 0.6532           | 0.2329          | 0.4506              | 0.2149     | 0.404          | 0.1117      | 0.3692          | 0.2599   | 0.3551       |
| 0.9391        | 55.0  | 5885  | 1.3204          | 0.2688 | 0.5417 | 0.2249 | 0.0816    | 0.2112     | 0.4168    | 0.2738 | 0.4409 | 0.4507  | 0.1725    | 0.3875     | 0.6407    | 0.5387       | 0.664            | 0.2201          | 0.4734              | 0.2148     | 0.3987         | 0.0962      | 0.3477          | 0.2743   | 0.3698       |
| 0.9541        | 56.0  | 5992  | 1.2930          | 0.2616 | 0.5317 | 0.2214 | 0.0889    | 0.2025     | 0.4198    | 0.2653 | 0.4307 | 0.4439  | 0.1817    | 0.3764     | 0.6269    | 0.5406       | 0.6617           | 0.1994          | 0.4405              | 0.2144     | 0.4138         | 0.0954      | 0.3492          | 0.2581   | 0.3542       |
| 0.9568        | 57.0  | 6099  | 1.2989          | 0.2688 | 0.5365 | 0.2288 | 0.089     | 0.2143     | 0.4042    | 0.2656 | 0.4275 | 0.443   | 0.1895    | 0.3806     | 0.6086    | 0.543        | 0.6604           | 0.2119          | 0.4316              | 0.2265     | 0.4161         | 0.1127      | 0.3508          | 0.2499   | 0.356        |
| 0.9645        | 58.0  | 6206  | 1.3244          | 0.2699 | 0.5519 | 0.2355 | 0.0917    | 0.2067     | 0.4132    | 0.2753 | 0.4351 | 0.446   | 0.1724    | 0.3728     | 0.6313    | 0.5372       | 0.6518           | 0.2168          | 0.457               | 0.217      | 0.3964         | 0.1166      | 0.3615          | 0.2618   | 0.3631       |
| 0.9285        | 59.0  | 6313  | 1.3308          | 0.2661 | 0.5385 | 0.2281 | 0.0796    | 0.2149     | 0.4029    | 0.2671 | 0.4376 | 0.4493  | 0.1661    | 0.3847     | 0.6328    | 0.5365       | 0.6536           | 0.2171          | 0.4506              | 0.2137     | 0.3946         | 0.1008      | 0.38            | 0.2622   | 0.3676       |
| 0.9151        | 60.0  | 6420  | 1.3176          | 0.2749 | 0.5582 | 0.2233 | 0.0797    | 0.2237     | 0.4157    | 0.2752 | 0.4417 | 0.4556  | 0.1726    | 0.3899     | 0.6438    | 0.5504       | 0.6649           | 0.2197          | 0.4443              | 0.2224     | 0.4058         | 0.1294      | 0.4046          | 0.2524   | 0.3582       |
| 0.9231        | 61.0  | 6527  | 1.3251          | 0.2736 | 0.5457 | 0.2328 | 0.0858    | 0.2211     | 0.4141    | 0.28   | 0.4476 | 0.4649  | 0.1793    | 0.4134     | 0.6428    | 0.5545       | 0.6797           | 0.2151          | 0.4835              | 0.2106     | 0.3853         | 0.1338      | 0.4046          | 0.254    | 0.3711       |
| 0.9036        | 62.0  | 6634  | 1.3277          | 0.2707 | 0.5603 | 0.2283 | 0.0871    | 0.2209     | 0.4124    | 0.2692 | 0.4346 | 0.4524  | 0.1708    | 0.3979     | 0.6312    | 0.5524       | 0.6698           | 0.24            | 0.4696              | 0.1991     | 0.4134         | 0.1045      | 0.3415          | 0.2574   | 0.3676       |
| 0.9324        | 63.0  | 6741  | 1.3008          | 0.2719 | 0.5527 | 0.2376 | 0.0811    | 0.2206     | 0.4372    | 0.2749 | 0.4544 | 0.471   | 0.2098    | 0.4175     | 0.6394    | 0.5352       | 0.6653           | 0.2224          | 0.5076              | 0.2045     | 0.4103         | 0.1294      | 0.3985          | 0.2681   | 0.3733       |
| 0.9173        | 64.0  | 6848  | 1.3151          | 0.2771 | 0.5587 | 0.2383 | 0.085     | 0.2308     | 0.4134    | 0.2692 | 0.4427 | 0.4583  | 0.1829    | 0.4031     | 0.6247    | 0.5393       | 0.6599           | 0.2378          | 0.4911              | 0.2174     | 0.4054         | 0.1284      | 0.3692          | 0.2626   | 0.3658       |
| 0.8888        | 65.0  | 6955  | 1.3025          | 0.2699 | 0.5572 | 0.2266 | 0.0791    | 0.2175     | 0.4154    | 0.2734 | 0.4414 | 0.4628  | 0.1806    | 0.4118     | 0.6332    | 0.5383       | 0.6694           | 0.2183          | 0.481               | 0.2194     | 0.4067         | 0.1118      | 0.3754          | 0.2616   | 0.3813       |
| 0.9065        | 66.0  | 7062  | 1.2758          | 0.2802 | 0.5637 | 0.2433 | 0.0902    | 0.2236     | 0.4358    | 0.2789 | 0.4549 | 0.4706  | 0.1955    | 0.4238     | 0.6349    | 0.5384       | 0.6658           | 0.2309          | 0.481               | 0.2173     | 0.4036         | 0.1419      | 0.4231          | 0.2726   | 0.3796       |
| 0.897         | 67.0  | 7169  | 1.3021          | 0.2805 | 0.5637 | 0.2403 | 0.0809    | 0.2307     | 0.4264    | 0.2737 | 0.4464 | 0.4641  | 0.1876    | 0.4117     | 0.6413    | 0.5409       | 0.6626           | 0.2351          | 0.4797              | 0.2338     | 0.4201         | 0.1229      | 0.3754          | 0.2697   | 0.3827       |
| 0.891         | 68.0  | 7276  | 1.2872          | 0.2814 | 0.5506 | 0.2468 | 0.0858    | 0.2227     | 0.4234    | 0.2822 | 0.4526 | 0.4707  | 0.2078    | 0.411      | 0.6428    | 0.5462       | 0.6698           | 0.2382          | 0.4759              | 0.2301     | 0.4187         | 0.1228      | 0.4123          | 0.2695   | 0.3769       |
| 0.8814        | 69.0  | 7383  | 1.3457          | 0.2767 | 0.5416 | 0.2428 | 0.0826    | 0.2218     | 0.4196    | 0.2723 | 0.4518 | 0.4679  | 0.19      | 0.4114     | 0.6432    | 0.54         | 0.6671           | 0.2364          | 0.4987              | 0.2268     | 0.4009         | 0.0994      | 0.3908          | 0.281    | 0.3822       |
| 0.8809        | 70.0  | 7490  | 1.2750          | 0.2746 | 0.5531 | 0.2313 | 0.0862    | 0.2193     | 0.4354    | 0.2746 | 0.454  | 0.4707  | 0.2008    | 0.4142     | 0.6397    | 0.5393       | 0.6739           | 0.2295          | 0.4962              | 0.2255     | 0.4125         | 0.1085      | 0.3831          | 0.2701   | 0.388        |
| 0.8715        | 71.0  | 7597  | 1.2738          | 0.2859 | 0.5705 | 0.2399 | 0.0812    | 0.2312     | 0.4419    | 0.28   | 0.4552 | 0.4697  | 0.1821    | 0.4226     | 0.6393    | 0.5552       | 0.6829           | 0.2552          | 0.4962              | 0.2122     | 0.3848         | 0.1366      | 0.3954          | 0.2705   | 0.3893       |
| 0.8582        | 72.0  | 7704  | 1.2803          | 0.2854 | 0.5632 | 0.2472 | 0.0868    | 0.2308     | 0.4345    | 0.2814 | 0.4576 | 0.471   | 0.2112    | 0.4218     | 0.639     | 0.5483       | 0.6689           | 0.2621          | 0.5                 | 0.2144     | 0.3969         | 0.125       | 0.3938          | 0.2772   | 0.3956       |
| 0.8798        | 73.0  | 7811  | 1.2991          | 0.2921 | 0.5724 | 0.2629 | 0.0801    | 0.2378     | 0.4484    | 0.291  | 0.4619 | 0.4757  | 0.1914    | 0.4178     | 0.6572    | 0.5481       | 0.6721           | 0.265           | 0.4937              | 0.2187     | 0.3969         | 0.1445      | 0.4231          | 0.2841   | 0.3929       |
| 0.8687        | 74.0  | 7918  | 1.2795          | 0.2751 | 0.5415 | 0.2449 | 0.0743    | 0.2224     | 0.433     | 0.2813 | 0.4525 | 0.4716  | 0.1991    | 0.4103     | 0.6554    | 0.5447       | 0.6788           | 0.2197          | 0.4886              | 0.2193     | 0.4009         | 0.1251      | 0.4062          | 0.2668   | 0.3836       |
| 0.8579        | 75.0  | 8025  | 1.2965          | 0.2827 | 0.5554 | 0.2457 | 0.0834    | 0.2274     | 0.439     | 0.2805 | 0.4568 | 0.4697  | 0.1736    | 0.4164     | 0.6491    | 0.5527       | 0.6739           | 0.2374          | 0.4772              | 0.2244     | 0.4022         | 0.1261      | 0.4154          | 0.2728   | 0.38         |
| 0.8444        | 76.0  | 8132  | 1.2692          | 0.286  | 0.5675 | 0.2456 | 0.0845    | 0.2298     | 0.452     | 0.2844 | 0.4569 | 0.4701  | 0.18      | 0.4201     | 0.6516    | 0.5577       | 0.6716           | 0.2472          | 0.4759              | 0.2247     | 0.4085         | 0.1367      | 0.4154          | 0.2637   | 0.3791       |
| 0.8655        | 77.0  | 8239  | 1.2678          | 0.2914 | 0.5743 | 0.2529 | 0.0802    | 0.2412     | 0.4548    | 0.2854 | 0.4584 | 0.4711  | 0.1862    | 0.42       | 0.6467    | 0.5584       | 0.6725           | 0.2484          | 0.4899              | 0.2155     | 0.4027         | 0.1618      | 0.4015          | 0.2731   | 0.3889       |
| 0.8424        | 78.0  | 8346  | 1.2859          | 0.2871 | 0.5697 | 0.2433 | 0.0843    | 0.2281     | 0.4464    | 0.2792 | 0.4522 | 0.4682  | 0.1924    | 0.4191     | 0.6409    | 0.5575       | 0.6739           | 0.2389          | 0.4797              | 0.2161     | 0.3964         | 0.1444      | 0.4             | 0.2787   | 0.3911       |
| 0.8373        | 79.0  | 8453  | 1.2665          | 0.2952 | 0.5753 | 0.2589 | 0.0917    | 0.2446     | 0.4617    | 0.2813 | 0.4646 | 0.4779  | 0.2011    | 0.4253     | 0.6561    | 0.5594       | 0.6761           | 0.2481          | 0.4962              | 0.2305     | 0.417          | 0.1652      | 0.4062          | 0.2727   | 0.3942       |
| 0.841         | 80.0  | 8560  | 1.2720          | 0.2872 | 0.5588 | 0.2596 | 0.07      | 0.2247     | 0.4592    | 0.2784 | 0.4556 | 0.4691  | 0.1936    | 0.403      | 0.6516    | 0.557        | 0.6779           | 0.242           | 0.5025              | 0.2246     | 0.3929         | 0.1446      | 0.3908          | 0.268    | 0.3813       |
| 0.8207        | 81.0  | 8667  | 1.2764          | 0.2914 | 0.5691 | 0.2633 | 0.0891    | 0.2287     | 0.4633    | 0.285  | 0.4633 | 0.4752  | 0.2079    | 0.4133     | 0.6549    | 0.5568       | 0.6712           | 0.2442          | 0.5266              | 0.2274     | 0.3924         | 0.1589      | 0.4092          | 0.2697   | 0.3764       |
| 0.8151        | 82.0  | 8774  | 1.2726          | 0.292  | 0.5664 | 0.2575 | 0.0899    | 0.2383     | 0.4532    | 0.2838 | 0.4575 | 0.4703  | 0.2029    | 0.4171     | 0.6444    | 0.5498       | 0.6734           | 0.2589          | 0.4949              | 0.2227     | 0.3969         | 0.1539      | 0.3954          | 0.2746   | 0.3911       |
| 0.8118        | 83.0  | 8881  | 1.2791          | 0.2909 | 0.5647 | 0.2645 | 0.0803    | 0.2349     | 0.4543    | 0.2866 | 0.4635 | 0.477   | 0.206     | 0.4167     | 0.659     | 0.554        | 0.673            | 0.2542          | 0.5203              | 0.2257     | 0.4045         | 0.1511      | 0.4             | 0.2695   | 0.3871       |
| 0.8101        | 84.0  | 8988  | 1.2793          | 0.2971 | 0.579  | 0.2669 | 0.0869    | 0.2459     | 0.4703    | 0.2877 | 0.4546 | 0.4646  | 0.1792    | 0.4059     | 0.6583    | 0.5589       | 0.6797           | 0.2452          | 0.4696              | 0.2401     | 0.4107         | 0.1757      | 0.3862          | 0.2656   | 0.3769       |
| 0.8002        | 85.0  | 9095  | 1.2649          | 0.2916 | 0.5718 | 0.2551 | 0.0885    | 0.2432     | 0.4412    | 0.2867 | 0.4527 | 0.4686  | 0.1907    | 0.4215     | 0.6414    | 0.5598       | 0.6824           | 0.2361          | 0.4823              | 0.2377     | 0.4134         | 0.1537      | 0.38            | 0.2708   | 0.3849       |
| 0.8174        | 86.0  | 9202  | 1.2749          | 0.2965 | 0.5785 | 0.2577 | 0.0941    | 0.238      | 0.4623    | 0.2907 | 0.457  | 0.4704  | 0.1919    | 0.4187     | 0.6478    | 0.5581       | 0.6829           | 0.2565          | 0.4886              | 0.2404     | 0.4138         | 0.157       | 0.3815          | 0.2704   | 0.3849       |
| 0.8068        | 87.0  | 9309  | 1.2789          | 0.2965 | 0.5781 | 0.2649 | 0.0934    | 0.2408     | 0.4661    | 0.2908 | 0.4632 | 0.4755  | 0.2036    | 0.4241     | 0.6541    | 0.5563       | 0.6793           | 0.252           | 0.4975              | 0.2397     | 0.4165         | 0.1639      | 0.4015          | 0.2704   | 0.3827       |
| 0.8127        | 88.0  | 9416  | 1.2787          | 0.304  | 0.5921 | 0.2676 | 0.0994    | 0.2394     | 0.4855    | 0.2914 | 0.4612 | 0.4722  | 0.2184    | 0.4099     | 0.6616    | 0.5532       | 0.6716           | 0.273           | 0.4962              | 0.2379     | 0.4058         | 0.1739      | 0.3954          | 0.2821   | 0.392        |
| 0.7997        | 89.0  | 9523  | 1.2658          | 0.3001 | 0.5766 | 0.2665 | 0.0946    | 0.2411     | 0.4831    | 0.288  | 0.4546 | 0.4652  | 0.1939    | 0.4102     | 0.6501    | 0.5544       | 0.6703           | 0.2613          | 0.4785              | 0.2433     | 0.4103         | 0.1727      | 0.3862          | 0.2685   | 0.3809       |
| 0.8024        | 90.0  | 9630  | 1.2593          | 0.3068 | 0.5908 | 0.2714 | 0.0915    | 0.2519     | 0.4812    | 0.2898 | 0.464  | 0.4767  | 0.2179    | 0.4211     | 0.6596    | 0.5597       | 0.6784           | 0.2731          | 0.5038              | 0.2445     | 0.4143         | 0.1755      | 0.3954          | 0.2813   | 0.3916       |
| 0.7874        | 91.0  | 9737  | 1.2550          | 0.3075 | 0.5939 | 0.2726 | 0.0901    | 0.256      | 0.4814    | 0.2923 | 0.4638 | 0.4769  | 0.2131    | 0.4226     | 0.6615    | 0.5592       | 0.6757           | 0.2796          | 0.5101              | 0.2407     | 0.4098         | 0.1739      | 0.3954          | 0.284    | 0.3933       |
| 0.7839        | 92.0  | 9844  | 1.2722          | 0.305  | 0.5851 | 0.2756 | 0.0861    | 0.2542     | 0.4784    | 0.2901 | 0.4597 | 0.4779  | 0.1932    | 0.4302     | 0.6527    | 0.5611       | 0.6779           | 0.2631          | 0.5051              | 0.2454     | 0.408          | 0.1728      | 0.4             | 0.2828   | 0.3987       |
| 0.7865        | 93.0  | 9951  | 1.2689          | 0.3044 | 0.5847 | 0.2748 | 0.0853    | 0.2531     | 0.4763    | 0.2897 | 0.4636 | 0.4764  | 0.1984    | 0.4191     | 0.6621    | 0.561        | 0.6784           | 0.2708          | 0.5                 | 0.2446     | 0.4125         | 0.1603      | 0.3892          | 0.2856   | 0.4018       |
| 0.7676        | 94.0  | 10058 | 1.2595          | 0.3073 | 0.5925 | 0.2782 | 0.0846    | 0.2547     | 0.4834    | 0.2948 | 0.4629 | 0.4746  | 0.1864    | 0.4242     | 0.6547    | 0.5625       | 0.6757           | 0.2772          | 0.5114              | 0.2458     | 0.4085         | 0.1709      | 0.3815          | 0.2802   | 0.396        |
| 0.7873        | 95.0  | 10165 | 1.2731          | 0.3075 | 0.5954 | 0.2752 | 0.085     | 0.2526     | 0.4841    | 0.2921 | 0.4613 | 0.4736  | 0.1966    | 0.4234     | 0.6534    | 0.5582       | 0.6721           | 0.2776          | 0.5063              | 0.245      | 0.404          | 0.1738      | 0.3862          | 0.2831   | 0.3996       |
| 0.7912        | 96.0  | 10272 | 1.2655          | 0.3077 | 0.5965 | 0.2658 | 0.0871    | 0.2541     | 0.4834    | 0.2928 | 0.4656 | 0.4784  | 0.2007    | 0.4261     | 0.659     | 0.5578       | 0.6703           | 0.2803          | 0.5241              | 0.2425     | 0.4116         | 0.1728      | 0.3862          | 0.2851   | 0.4          |
| 0.7586        | 97.0  | 10379 | 1.2672          | 0.3099 | 0.6012 | 0.2733 | 0.0839    | 0.2545     | 0.4886    | 0.2937 | 0.4665 | 0.479   | 0.1899    | 0.429      | 0.6617    | 0.5596       | 0.677            | 0.2901          | 0.5278              | 0.2436     | 0.4098         | 0.1694      | 0.3831          | 0.2869   | 0.3973       |
| 0.7833        | 98.0  | 10486 | 1.2673          | 0.3092 | 0.6021 | 0.2687 | 0.0887    | 0.2519     | 0.4851    | 0.2938 | 0.4657 | 0.4792  | 0.1963    | 0.4315     | 0.6522    | 0.5617       | 0.6775           | 0.2847          | 0.5304              | 0.2454     | 0.4125         | 0.1726      | 0.3815          | 0.2818   | 0.3942       |
| 0.7676        | 99.0  | 10593 | 1.2649          | 0.3089 | 0.594  | 0.2724 | 0.0895    | 0.2514     | 0.4833    | 0.2947 | 0.4666 | 0.4791  | 0.1832    | 0.4304     | 0.6531    | 0.5616       | 0.6779           | 0.2868          | 0.5278              | 0.246      | 0.4156         | 0.1689      | 0.3785          | 0.2811   | 0.3956       |
| 0.7743        | 100.0 | 10700 | 1.2634          | 0.3099 | 0.596  | 0.2729 | 0.0887    | 0.2527     | 0.4839    | 0.2938 | 0.4679 | 0.4801  | 0.1859    | 0.4322     | 0.6546    | 0.5624       | 0.6788           | 0.287           | 0.5304              | 0.2456     | 0.4116         | 0.17        | 0.3815          | 0.2843   | 0.3982       |


### Framework versions

- Transformers 4.42.0.dev0
- Pytorch 2.3.0+cu118
- Datasets 2.19.2
- Tokenizers 0.19.1