File size: 37,002 Bytes
129f6a3
 
 
 
237dda3
 
129f6a3
 
 
 
 
 
 
 
 
 
 
237dda3
129f6a3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
---
license: apache-2.0
base_model: SenseTime/deformable-detr
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: sensetime-deformable-detr-finetuned-10k-cppe5
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# sensetime-deformable-detr-finetuned-10k-cppe5

This model is a fine-tuned version of [SenseTime/deformable-detr](https://huggingface.co/SenseTime/deformable-detr) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.1028
- Map: 0.2808
- Map 50: 0.5257
- Map 75: 0.2589
- Map Small: 0.2879
- Map Medium: 0.1953
- Map Large: 0.4546
- Mar 1: 0.3004
- Mar 10: 0.5007
- Mar 100: 0.534
- Mar Small: 0.4339
- Mar Medium: 0.4079
- Mar Large: 0.7629
- Map Coverall: 0.5566
- Mar 100 Coverall: 0.7331
- Map Face Shield: 0.2761
- Mar 100 Face Shield: 0.549
- Map Gloves: 0.1484
- Mar 100 Gloves: 0.3943
- Map Goggles: 0.1271
- Mar 100 Goggles: 0.5085
- Map Mask: 0.2956
- Mar 100 Mask: 0.4853

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 8
- seed: 1337
- gradient_accumulation_steps: 2
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch   | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-------:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 9.1039        | 0.9953  | 106   | 2.6450          | 0.0073 | 0.0229 | 0.0025 | 0.0       | 0.0001     | 0.0088    | 0.0123 | 0.0311 | 0.0381  | 0.0009    | 0.0248     | 0.0329    | 0.0358       | 0.1186           | 0.0001          | 0.0204              | 0.0        | 0.0066         | 0.0002      | 0.0034          | 0.0002   | 0.0417       |
| 2.3921        | 2.0     | 213   | 2.4742          | 0.0067 | 0.0207 | 0.0017 | 0.0009    | 0.0009     | 0.008     | 0.0157 | 0.0582 | 0.0923  | 0.0038    | 0.0276     | 0.1516    | 0.0296       | 0.3349           | 0.0011          | 0.0327              | 0.0        | 0.0199         | 0.0016      | 0.0203          | 0.0013   | 0.0536       |
| 2.28          | 2.9953  | 319   | 2.5260          | 0.0064 | 0.0198 | 0.0024 | 0.0342    | 0.0005     | 0.0063    | 0.0124 | 0.0547 | 0.0777  | 0.1079    | 0.0291     | 0.0848    | 0.0294       | 0.2849           | 0.0009          | 0.0082              | 0.0        | 0.0057         | 0.0         | 0.0             | 0.0019   | 0.0896       |
| 2.1883        | 4.0     | 426   | 2.2302          | 0.0077 | 0.0193 | 0.006  | 0.0013    | 0.001      | 0.0126    | 0.0259 | 0.0653 | 0.1098  | 0.0109    | 0.035      | 0.1264    | 0.0323       | 0.4203           | 0.0             | 0.0                 | 0.0        | 0.01           | 0.0023      | 0.0119          | 0.0036   | 0.1066       |
| 2.1263        | 4.9953  | 532   | 2.1512          | 0.0105 | 0.0306 | 0.0069 | 0.0021    | 0.0015     | 0.0105    | 0.0323 | 0.0757 | 0.1144  | 0.0199    | 0.0328     | 0.1168    | 0.0467       | 0.45             | 0.0001          | 0.002               | 0.0001     | 0.0175         | 0.0         | 0.0             | 0.0058   | 0.1024       |
| 2.0232        | 6.0     | 639   | 2.1045          | 0.0133 | 0.0323 | 0.0103 | 0.0049    | 0.0023     | 0.0143    | 0.0357 | 0.0882 | 0.1265  | 0.0147    | 0.044      | 0.1458    | 0.0575       | 0.4773           | 0.0             | 0.0                 | 0.0002     | 0.0147         | 0.0         | 0.0             | 0.0086   | 0.1403       |
| 2.0103        | 6.9953  | 745   | 2.1646          | 0.0219 | 0.0466 | 0.0178 | 0.0049    | 0.0015     | 0.0232    | 0.0438 | 0.1018 | 0.1274  | 0.0085    | 0.0471     | 0.1658    | 0.1033       | 0.4698           | 0.0013          | 0.0184              | 0.0001     | 0.0251         | 0.0003      | 0.0136          | 0.0046   | 0.1104       |
| 1.9723        | 8.0     | 852   | 1.9693          | 0.021  | 0.052  | 0.0165 | 0.0048    | 0.0036     | 0.0274    | 0.039  | 0.113  | 0.1558  | 0.0241    | 0.053      | 0.2211    | 0.0881       | 0.5407           | 0.0029          | 0.0286              | 0.0001     | 0.0265         | 0.0007      | 0.0119          | 0.013    | 0.1716       |
| 1.9425        | 8.9953  | 958   | 1.9505          | 0.0199 | 0.0505 | 0.0148 | 0.003     | 0.0051     | 0.0195    | 0.0387 | 0.1041 | 0.1534  | 0.0233    | 0.0595     | 0.1477    | 0.0826       | 0.564            | 0.0037          | 0.0122              | 0.0001     | 0.0156         | 0.0003      | 0.0068          | 0.0126   | 0.1682       |
| 1.8248        | 10.0    | 1065  | 1.9128          | 0.0237 | 0.0603 | 0.0166 | 0.0064    | 0.0079     | 0.0335    | 0.0558 | 0.137  | 0.1739  | 0.0569    | 0.089      | 0.1711    | 0.0872       | 0.5314           | 0.015           | 0.0939              | 0.0002     | 0.019          | 0.0018      | 0.0492          | 0.0143   | 0.1763       |
| 1.7923        | 10.9953 | 1171  | 1.8334          | 0.0281 | 0.0628 | 0.0223 | 0.0069    | 0.0081     | 0.0302    | 0.0546 | 0.1543 | 0.204   | 0.0577    | 0.1129     | 0.2174    | 0.1088       | 0.5523           | 0.0103          | 0.0857              | 0.0002     | 0.0265         | 0.0048      | 0.1424          | 0.0163   | 0.2133       |
| 1.7922        | 12.0    | 1278  | 1.8679          | 0.0405 | 0.0964 | 0.0281 | 0.0165    | 0.0126     | 0.0444    | 0.0596 | 0.1629 | 0.2031  | 0.0387    | 0.1127     | 0.2102    | 0.1462       | 0.5709           | 0.0299          | 0.1408              | 0.0002     | 0.0213         | 0.0099      | 0.0966          | 0.0163   | 0.1858       |
| 1.7797        | 12.9953 | 1384  | 1.7715          | 0.036  | 0.0739 | 0.0337 | 0.0066    | 0.0089     | 0.042     | 0.0647 | 0.1644 | 0.2102  | 0.0472    | 0.1088     | 0.2326    | 0.1429       | 0.5924           | 0.014           | 0.1082              | 0.0006     | 0.0469         | 0.0016      | 0.0797          | 0.0207   | 0.2237       |
| 1.6925        | 14.0    | 1491  | 1.7633          | 0.0427 | 0.0897 | 0.044  | 0.0073    | 0.0069     | 0.0564    | 0.061  | 0.163  | 0.2152  | 0.0631    | 0.1133     | 0.2339    | 0.1819       | 0.5988           | 0.0063          | 0.0429              | 0.0007     | 0.0493         | 0.0069      | 0.1695          | 0.0175   | 0.2156       |
| 1.6927        | 14.9953 | 1597  | 1.7455          | 0.0429 | 0.0973 | 0.0311 | 0.0081    | 0.0139     | 0.0464    | 0.0718 | 0.196  | 0.243   | 0.059     | 0.1603     | 0.2494    | 0.1594       | 0.5959           | 0.0283          | 0.1592              | 0.0008     | 0.0559         | 0.0069      | 0.1627          | 0.0191   | 0.2412       |
| 1.6409        | 16.0    | 1704  | 1.6922          | 0.0414 | 0.1001 | 0.0295 | 0.0186    | 0.0152     | 0.0447    | 0.0612 | 0.203  | 0.2566  | 0.0805    | 0.1605     | 0.3192    | 0.1449       | 0.5965           | 0.0235          | 0.151               | 0.0012     | 0.073          | 0.0108      | 0.2254          | 0.0264   | 0.237        |
| 1.6535        | 16.9953 | 1810  | 1.6837          | 0.0508 | 0.0973 | 0.0468 | 0.011     | 0.021      | 0.0457    | 0.088  | 0.2063 | 0.2565  | 0.0518    | 0.1584     | 0.2943    | 0.1717       | 0.6256           | 0.0426          | 0.1694              | 0.0007     | 0.0507         | 0.0081      | 0.1712          | 0.0307   | 0.2654       |
| 1.5853        | 18.0    | 1917  | 1.6565          | 0.0424 | 0.0842 | 0.0379 | 0.0103    | 0.0177     | 0.0497    | 0.0954 | 0.2317 | 0.2809  | 0.0502    | 0.1839     | 0.3685    | 0.1457       | 0.639            | 0.0169          | 0.1673              | 0.002      | 0.0986         | 0.0155      | 0.2339          | 0.0318   | 0.2659       |
| 1.5743        | 18.9953 | 2023  | 1.6498          | 0.0409 | 0.0877 | 0.0367 | 0.0989    | 0.0149     | 0.0487    | 0.1    | 0.2277 | 0.2841  | 0.2421    | 0.1812     | 0.3256    | 0.1417       | 0.6535           | 0.0225          | 0.2286              | 0.0025     | 0.1052         | 0.0073      | 0.1407          | 0.0306   | 0.2924       |
| 1.5241        | 20.0    | 2130  | 1.6974          | 0.0496 | 0.1014 | 0.0484 | 0.0401    | 0.0168     | 0.0579    | 0.099  | 0.2179 | 0.2668  | 0.0939    | 0.1701     | 0.3058    | 0.179        | 0.632            | 0.0278          | 0.2531              | 0.003      | 0.0825         | 0.0096      | 0.1525          | 0.0283   | 0.2137       |
| 1.5431        | 20.9953 | 2236  | 1.5908          | 0.0584 | 0.1168 | 0.0529 | 0.098     | 0.0376     | 0.0581    | 0.1182 | 0.2721 | 0.3191  | 0.15      | 0.2129     | 0.3986    | 0.1837       | 0.6558           | 0.0505          | 0.3224              | 0.0039     | 0.1005         | 0.0151      | 0.2508          | 0.0388   | 0.2659       |
| 1.5106        | 22.0    | 2343  | 1.6095          | 0.0593 | 0.1366 | 0.0445 | 0.0125    | 0.0284     | 0.0639    | 0.1034 | 0.2407 | 0.2845  | 0.063     | 0.1819     | 0.3299    | 0.1892       | 0.6238           | 0.0521          | 0.2327              | 0.006      | 0.1118         | 0.0147      | 0.1864          | 0.0345   | 0.2678       |
| 1.5372        | 22.9953 | 2449  | 1.5951          | 0.0636 | 0.1316 | 0.0576 | 0.0282    | 0.0416     | 0.0537    | 0.1163 | 0.266  | 0.312   | 0.0853    | 0.2239     | 0.3533    | 0.1781       | 0.6052           | 0.0692          | 0.3286              | 0.008      | 0.1393         | 0.0153      | 0.1983          | 0.0475   | 0.2886       |
| 1.4386        | 24.0    | 2556  | 1.5187          | 0.0622 | 0.123  | 0.0587 | 0.0185    | 0.0405     | 0.0661    | 0.1229 | 0.2786 | 0.3385  | 0.0898    | 0.2326     | 0.4092    | 0.1881       | 0.6599           | 0.0659          | 0.351               | 0.0061     | 0.1332         | 0.0147      | 0.2407          | 0.0362   | 0.3076       |
| 1.4267        | 24.9953 | 2662  | 1.5143          | 0.0664 | 0.1359 | 0.0569 | 0.0405    | 0.0475     | 0.0664    | 0.1284 | 0.2935 | 0.3396  | 0.0994    | 0.2523     | 0.3919    | 0.1845       | 0.6512           | 0.0576          | 0.3204              | 0.0088     | 0.1393         | 0.0233      | 0.2508          | 0.0576   | 0.3365       |
| 1.397         | 26.0    | 2769  | 1.5084          | 0.0689 | 0.1464 | 0.0617 | 0.0567    | 0.047      | 0.0686    | 0.1508 | 0.3158 | 0.363   | 0.1653    | 0.2526     | 0.453     | 0.1731       | 0.6605           | 0.0708          | 0.3796              | 0.009      | 0.1569         | 0.0347      | 0.2932          | 0.057    | 0.3246       |
| 1.3846        | 26.9953 | 2875  | 1.4379          | 0.077  | 0.1554 | 0.0671 | 0.052     | 0.0457     | 0.0747    | 0.1576 | 0.3191 | 0.3686  | 0.2459    | 0.2615     | 0.4191    | 0.2061       | 0.6762           | 0.0678          | 0.3939              | 0.0154     | 0.19           | 0.027       | 0.2136          | 0.069    | 0.3692       |
| 1.3763        | 28.0    | 2982  | 1.4605          | 0.0727 | 0.1483 | 0.0675 | 0.0761    | 0.037      | 0.0817    | 0.1428 | 0.3136 | 0.3706  | 0.1434    | 0.2537     | 0.4855    | 0.2099       | 0.6663           | 0.0653          | 0.398               | 0.0116     | 0.1801         | 0.0247      | 0.2678          | 0.052    | 0.3408       |
| 1.3449        | 28.9953 | 3088  | 1.4449          | 0.0808 | 0.1637 | 0.0757 | 0.1455    | 0.0567     | 0.0952    | 0.1746 | 0.3383 | 0.3933  | 0.3418    | 0.2831     | 0.5146    | 0.2091       | 0.6779           | 0.0717          | 0.4449              | 0.0119     | 0.1635         | 0.032       | 0.3085          | 0.0794   | 0.3716       |
| 1.3355        | 30.0    | 3195  | 1.4498          | 0.0727 | 0.1544 | 0.0677 | 0.0271    | 0.0509     | 0.0832    | 0.1562 | 0.3189 | 0.3589  | 0.2176    | 0.2815     | 0.4364    | 0.2056       | 0.6715           | 0.0554          | 0.3245              | 0.0152     | 0.1773         | 0.0149      | 0.2458          | 0.0723   | 0.3754       |
| 1.3218        | 30.9953 | 3301  | 1.4156          | 0.0784 | 0.1641 | 0.0656 | 0.0608    | 0.0528     | 0.0978    | 0.1575 | 0.3344 | 0.3867  | 0.1655    | 0.2825     | 0.5141    | 0.2088       | 0.686            | 0.0624          | 0.398               | 0.0211     | 0.21           | 0.0238      | 0.2661          | 0.0761   | 0.3735       |
| 1.2773        | 32.0    | 3408  | 1.3722          | 0.0823 | 0.1682 | 0.0764 | 0.0641    | 0.056      | 0.1128    | 0.1602 | 0.3656 | 0.4143  | 0.1975    | 0.308      | 0.5599    | 0.2192       | 0.6913           | 0.0704          | 0.449               | 0.0199     | 0.2213         | 0.0216      | 0.3153          | 0.0803   | 0.3948       |
| 1.2839        | 32.9953 | 3514  | 1.3795          | 0.09   | 0.186  | 0.0785 | 0.0733    | 0.0697     | 0.14      | 0.1867 | 0.3742 | 0.416   | 0.2753    | 0.2984     | 0.5739    | 0.2294       | 0.693            | 0.0819          | 0.4673              | 0.0212     | 0.2218         | 0.0293      | 0.3119          | 0.0883   | 0.3858       |
| 1.2384        | 34.0    | 3621  | 1.3960          | 0.1002 | 0.2061 | 0.0858 | 0.0783    | 0.0594     | 0.1223    | 0.175  | 0.36   | 0.4115  | 0.2457    | 0.2905     | 0.5741    | 0.2479       | 0.6895           | 0.0775          | 0.402               | 0.0246     | 0.2479         | 0.0371      | 0.3136          | 0.114    | 0.4047       |
| 1.2495        | 34.9953 | 3727  | 1.3261          | 0.1007 | 0.2102 | 0.087  | 0.0847    | 0.0659     | 0.1473    | 0.1918 | 0.3789 | 0.4263  | 0.2146    | 0.3201     | 0.5737    | 0.246        | 0.7035           | 0.0753          | 0.4204              | 0.0362     | 0.2588         | 0.0315      | 0.3593          | 0.1145   | 0.3896       |
| 1.2032        | 36.0    | 3834  | 1.3012          | 0.1024 | 0.2052 | 0.0886 | 0.105     | 0.0723     | 0.157     | 0.1899 | 0.394  | 0.4376  | 0.2237    | 0.3284     | 0.5945    | 0.2543       | 0.6907           | 0.0731          | 0.4673              | 0.0369     | 0.272          | 0.0294      | 0.3542          | 0.1184   | 0.4038       |
| 1.2024        | 36.9953 | 3940  | 1.2989          | 0.107  | 0.2271 | 0.0844 | 0.2679    | 0.0987     | 0.1728    | 0.1961 | 0.4048 | 0.4467  | 0.3934    | 0.348      | 0.5898    | 0.2451       | 0.7035           | 0.0819          | 0.449               | 0.0419     | 0.2773         | 0.0373      | 0.3814          | 0.1288   | 0.4223       |
| 1.1714        | 38.0    | 4047  | 1.3187          | 0.1186 | 0.2361 | 0.1052 | 0.0464    | 0.0813     | 0.16      | 0.1932 | 0.3883 | 0.4304  | 0.2583    | 0.321      | 0.6007    | 0.3029       | 0.7058           | 0.0951          | 0.4143              | 0.0472     | 0.2739         | 0.0372      | 0.3373          | 0.1108   | 0.4209       |
| 1.1702        | 38.9953 | 4153  | 1.3017          | 0.1158 | 0.2338 | 0.1025 | 0.1431    | 0.0923     | 0.1729    | 0.1998 | 0.4178 | 0.4544  | 0.2428    | 0.3371     | 0.6742    | 0.2624       | 0.7134           | 0.0981          | 0.4694              | 0.0458     | 0.2981         | 0.0427      | 0.3559          | 0.1299   | 0.4351       |
| 1.1745        | 40.0    | 4260  | 1.2802          | 0.1167 | 0.2351 | 0.1035 | 0.0578    | 0.095      | 0.1591    | 0.2099 | 0.4126 | 0.4571  | 0.3426    | 0.3457     | 0.6024    | 0.2627       | 0.7174           | 0.1144          | 0.4939              | 0.0403     | 0.29           | 0.0334      | 0.3407          | 0.1328   | 0.4436       |
| 1.1502        | 40.9953 | 4366  | 1.2797          | 0.1283 | 0.2538 | 0.1168 | 0.082     | 0.0831     | 0.1653    | 0.2048 | 0.4136 | 0.4552  | 0.322     | 0.3349     | 0.6206    | 0.301        | 0.7169           | 0.1078          | 0.449               | 0.0513     | 0.3085         | 0.043       | 0.3627          | 0.1382   | 0.4389       |
| 1.1149        | 42.0    | 4473  | 1.2880          | 0.134  | 0.2744 | 0.1197 | 0.1218    | 0.1095     | 0.2147    | 0.2133 | 0.4295 | 0.4717  | 0.2168    | 0.3639     | 0.7173    | 0.3046       | 0.7238           | 0.1305          | 0.5286              | 0.0479     | 0.3005         | 0.0425      | 0.3746          | 0.1445   | 0.4313       |
| 1.1224        | 42.9953 | 4579  | 1.2321          | 0.1477 | 0.2839 | 0.1314 | 0.1361    | 0.1143     | 0.2275    | 0.22   | 0.4406 | 0.4751  | 0.3523    | 0.3623     | 0.6821    | 0.3288       | 0.7326           | 0.1463          | 0.4918              | 0.0582     | 0.3242         | 0.0434      | 0.3915          | 0.1616   | 0.4355       |
| 1.0958        | 44.0    | 4686  | 1.2293          | 0.1416 | 0.2833 | 0.1279 | 0.1761    | 0.1067     | 0.2186    | 0.2211 | 0.4368 | 0.4815  | 0.3122    | 0.3702     | 0.6796    | 0.3046       | 0.732            | 0.1434          | 0.4959              | 0.054      | 0.3171         | 0.0355      | 0.3915          | 0.1702   | 0.4711       |
| 1.081         | 44.9953 | 4792  | 1.2400          | 0.1403 | 0.2807 | 0.1243 | 0.1979    | 0.1054     | 0.24      | 0.2378 | 0.4331 | 0.4761  | 0.3035    | 0.3484     | 0.7158    | 0.297        | 0.7291           | 0.1405          | 0.4959              | 0.0624     | 0.328          | 0.0345      | 0.3814          | 0.167    | 0.446        |
| 1.0659        | 46.0    | 4899  | 1.2180          | 0.1518 | 0.2984 | 0.1404 | 0.0926    | 0.1198     | 0.2352    | 0.2261 | 0.4455 | 0.4907  | 0.3604    | 0.3798     | 0.6992    | 0.3282       | 0.7262           | 0.1433          | 0.5102              | 0.0668     | 0.3502         | 0.0452      | 0.4085          | 0.1757   | 0.4583       |
| 1.0741        | 46.9953 | 5005  | 1.2355          | 0.1501 | 0.3066 | 0.1381 | 0.2278    | 0.1125     | 0.2314    | 0.2259 | 0.4356 | 0.4874  | 0.3453    | 0.3694     | 0.6911    | 0.3114       | 0.7134           | 0.1447          | 0.5367              | 0.0688     | 0.336          | 0.0354      | 0.3763          | 0.1904   | 0.4744       |
| 1.074         | 48.0    | 5112  | 1.2082          | 0.1495 | 0.2917 | 0.1343 | 0.0927    | 0.1293     | 0.2343    | 0.2247 | 0.4535 | 0.4956  | 0.346     | 0.396      | 0.712     | 0.3327       | 0.732            | 0.1477          | 0.5122              | 0.056      | 0.3498         | 0.0308      | 0.4237          | 0.1805   | 0.4602       |
| 1.067         | 48.9953 | 5218  | 1.2123          | 0.165  | 0.3104 | 0.1467 | 0.0957    | 0.1188     | 0.2524    | 0.2522 | 0.4578 | 0.5     | 0.3661    | 0.3737     | 0.7116    | 0.3553       | 0.7291           | 0.1624          | 0.5286              | 0.0706     | 0.3417         | 0.0463      | 0.422           | 0.1902   | 0.4787       |
| 1.0404        | 50.0    | 5325  | 1.2088          | 0.1569 | 0.3099 | 0.1328 | 0.1295    | 0.1105     | 0.2661    | 0.235  | 0.4425 | 0.4879  | 0.3104    | 0.3708     | 0.7181    | 0.3615       | 0.7273           | 0.1395          | 0.4796              | 0.0763     | 0.3597         | 0.0414      | 0.439           | 0.1658   | 0.4336       |
| 1.052         | 50.9953 | 5431  | 1.1966          | 0.1676 | 0.3345 | 0.1453 | 0.1543    | 0.1219     | 0.2477    | 0.2439 | 0.4492 | 0.493   | 0.2986    | 0.387      | 0.72      | 0.3652       | 0.725            | 0.1442          | 0.502               | 0.0701     | 0.3578         | 0.0622      | 0.4119          | 0.1963   | 0.4682       |
| 1.0249        | 52.0    | 5538  | 1.2046          | 0.1601 | 0.324  | 0.1455 | 0.0884    | 0.1159     | 0.2423    | 0.2383 | 0.4475 | 0.4907  | 0.3318    | 0.3694     | 0.7025    | 0.3368       | 0.7186           | 0.1664          | 0.4959              | 0.072      | 0.3758         | 0.0313      | 0.3915          | 0.1941   | 0.4716       |
| 1.0286        | 52.9953 | 5644  | 1.2160          | 0.1732 | 0.3482 | 0.1486 | 0.0809    | 0.124      | 0.2539    | 0.2465 | 0.4497 | 0.4899  | 0.2724    | 0.3755     | 0.6934    | 0.3827       | 0.7192           | 0.1516          | 0.5061              | 0.0716     | 0.337          | 0.0494      | 0.4322          | 0.2107   | 0.455        |
| 1.0085        | 54.0    | 5751  | 1.2242          | 0.169  | 0.3425 | 0.1446 | 0.0889    | 0.1154     | 0.2541    | 0.2335 | 0.4485 | 0.4852  | 0.3407    | 0.3658     | 0.6959    | 0.3834       | 0.718            | 0.1546          | 0.4959              | 0.0797     | 0.3365         | 0.0465      | 0.4373          | 0.1805   | 0.4384       |
| 1.0105        | 54.9953 | 5857  | 1.1761          | 0.1885 | 0.3678 | 0.1675 | 0.1149    | 0.1313     | 0.2775    | 0.2653 | 0.4731 | 0.5102  | 0.3635    | 0.3872     | 0.724     | 0.4022       | 0.736            | 0.1799          | 0.5429              | 0.0971     | 0.3739         | 0.0536      | 0.4288          | 0.2098   | 0.4692       |
| 0.9725        | 56.0    | 5964  | 1.2053          | 0.1867 | 0.3609 | 0.1665 | 0.2528    | 0.1335     | 0.2908    | 0.2491 | 0.4626 | 0.5064  | 0.3851    | 0.3879     | 0.7348    | 0.4134       | 0.7372           | 0.1765          | 0.5367              | 0.0808     | 0.3398         | 0.0615      | 0.4644          | 0.2013   | 0.454        |
| 0.9825        | 56.9953 | 6070  | 1.1839          | 0.1857 | 0.361  | 0.1718 | 0.1396    | 0.1366     | 0.2957    | 0.2667 | 0.4622 | 0.5012  | 0.3591    | 0.3848     | 0.715     | 0.4079       | 0.7395           | 0.2112          | 0.5245              | 0.0823     | 0.3664         | 0.0412      | 0.4237          | 0.1858   | 0.4517       |
| 0.9768        | 58.0    | 6177  | 1.1782          | 0.1909 | 0.3696 | 0.1677 | 0.1695    | 0.1316     | 0.3046    | 0.2637 | 0.4752 | 0.5143  | 0.3641    | 0.3965     | 0.7246    | 0.4094       | 0.7285           | 0.1889          | 0.5367              | 0.0866     | 0.3758         | 0.0526      | 0.4559          | 0.2171   | 0.4744       |
| 0.9646        | 58.9953 | 6283  | 1.2234          | 0.1752 | 0.3522 | 0.1485 | 0.0982    | 0.1131     | 0.2967    | 0.2342 | 0.4388 | 0.4825  | 0.3028    | 0.3743     | 0.6903    | 0.4095       | 0.711            | 0.1621          | 0.4939              | 0.0666     | 0.3308         | 0.0441      | 0.4322          | 0.1937   | 0.4445       |
| 0.9433        | 60.0    | 6390  | 1.1778          | 0.2039 | 0.3913 | 0.1795 | 0.1085    | 0.1387     | 0.3213    | 0.2627 | 0.4721 | 0.5035  | 0.3112    | 0.3827     | 0.7032    | 0.4448       | 0.7448           | 0.2013          | 0.5245              | 0.0995     | 0.3678         | 0.0554      | 0.422           | 0.2184   | 0.4583       |
| 0.9539        | 60.9953 | 6496  | 1.1710          | 0.2142 | 0.3998 | 0.1909 | 0.0873    | 0.1439     | 0.3343    | 0.258  | 0.4688 | 0.5159  | 0.3227    | 0.3985     | 0.71      | 0.4632       | 0.7448           | 0.2376          | 0.5286              | 0.0976     | 0.3645         | 0.0512      | 0.4661          | 0.2214   | 0.4758       |
| 0.9323        | 62.0    | 6603  | 1.1525          | 0.2241 | 0.4084 | 0.2017 | 0.1758    | 0.1621     | 0.3357    | 0.2827 | 0.4755 | 0.5187  | 0.3303    | 0.3996     | 0.7289    | 0.4692       | 0.7413           | 0.2387          | 0.5367              | 0.1032     | 0.3635         | 0.0586      | 0.4542          | 0.2508   | 0.4976       |
| 0.9312        | 62.9953 | 6709  | 1.1400          | 0.2201 | 0.4184 | 0.1825 | 0.2621    | 0.1752     | 0.3242    | 0.2887 | 0.4916 | 0.531   | 0.4282    | 0.4101     | 0.7258    | 0.4556       | 0.7413           | 0.2209          | 0.5469              | 0.0957     | 0.3716         | 0.0663      | 0.4898          | 0.2622   | 0.5052       |
| 0.9131        | 64.0    | 6816  | 1.1468          | 0.2239 | 0.4165 | 0.2042 | 0.2835    | 0.1687     | 0.3288    | 0.2852 | 0.4906 | 0.5291  | 0.4339    | 0.4064     | 0.7331    | 0.4363       | 0.7302           | 0.2399          | 0.5612              | 0.1086     | 0.3754         | 0.0774      | 0.4847          | 0.2575   | 0.4938       |
| 0.924         | 64.9953 | 6922  | 1.1554          | 0.2301 | 0.4351 | 0.2124 | 0.239     | 0.1666     | 0.357     | 0.2763 | 0.4864 | 0.5214  | 0.3761    | 0.398      | 0.7455    | 0.4637       | 0.725            | 0.2383          | 0.5327              | 0.1101     | 0.3545         | 0.09        | 0.5017          | 0.2487   | 0.4934       |
| 0.9114        | 66.0    | 7029  | 1.1486          | 0.2231 | 0.4351 | 0.2016 | 0.2949    | 0.1585     | 0.3553    | 0.2745 | 0.4848 | 0.5247  | 0.426     | 0.4126     | 0.7391    | 0.4658       | 0.7366           | 0.2095          | 0.5347              | 0.1104     | 0.3768         | 0.0835      | 0.4932          | 0.2465   | 0.482        |
| 0.9218        | 66.9953 | 7135  | 1.1245          | 0.2343 | 0.4329 | 0.2067 | 0.2009    | 0.1752     | 0.3804    | 0.2929 | 0.4957 | 0.5349  | 0.3876    | 0.4202     | 0.7486    | 0.4825       | 0.7494           | 0.2458          | 0.549               | 0.1214     | 0.3915         | 0.0671      | 0.4831          | 0.2549   | 0.5014       |
| 0.8886        | 68.0    | 7242  | 1.1260          | 0.236  | 0.4351 | 0.2162 | 0.2133    | 0.1619     | 0.3728    | 0.2844 | 0.4972 | 0.5283  | 0.3972    | 0.3923     | 0.7581    | 0.4756       | 0.7273           | 0.2387          | 0.549               | 0.1187     | 0.391          | 0.0872      | 0.4678          | 0.2601   | 0.5062       |
| 0.898         | 68.9953 | 7348  | 1.1272          | 0.2419 | 0.4601 | 0.2178 | 0.2485    | 0.1736     | 0.3688    | 0.2919 | 0.4958 | 0.5333  | 0.3847    | 0.41       | 0.7582    | 0.4948       | 0.7314           | 0.2347          | 0.5388              | 0.1286     | 0.3938         | 0.0871      | 0.5             | 0.264    | 0.5024       |
| 0.88          | 70.0    | 7455  | 1.1621          | 0.2398 | 0.4532 | 0.2123 | 0.2639    | 0.1676     | 0.3743    | 0.2785 | 0.4865 | 0.5151  | 0.3999    | 0.3942     | 0.7292    | 0.4905       | 0.7215           | 0.256           | 0.5408              | 0.1072     | 0.3526         | 0.0876      | 0.4746          | 0.2574   | 0.4858       |
| 0.8868        | 70.9953 | 7561  | 1.1089          | 0.2574 | 0.4713 | 0.2332 | 0.2675    | 0.1874     | 0.392     | 0.2957 | 0.5025 | 0.5356  | 0.4084    | 0.4319     | 0.7417    | 0.5181       | 0.7413           | 0.2715          | 0.5571              | 0.13       | 0.3844         | 0.1029      | 0.5017          | 0.2642   | 0.4934       |
| 0.876         | 72.0    | 7668  | 1.1296          | 0.2469 | 0.4705 | 0.2256 | 0.2927    | 0.1699     | 0.3973    | 0.2881 | 0.4892 | 0.5235  | 0.4206    | 0.4026     | 0.7447    | 0.5116       | 0.7314           | 0.2526          | 0.5653              | 0.1131     | 0.3739         | 0.1002      | 0.4542          | 0.257    | 0.4924       |
| 0.8786        | 72.9953 | 7774  | 1.1189          | 0.2503 | 0.4775 | 0.2262 | 0.2579    | 0.1729     | 0.4036    | 0.2811 | 0.4968 | 0.5319  | 0.4364    | 0.4133     | 0.7461    | 0.5128       | 0.7308           | 0.2551          | 0.549               | 0.1207     | 0.3915         | 0.0923      | 0.4915          | 0.2707   | 0.4967       |
| 0.8646        | 74.0    | 7881  | 1.1545          | 0.2503 | 0.4782 | 0.2289 | 0.2576    | 0.1648     | 0.4083    | 0.2792 | 0.4817 | 0.5187  | 0.4232    | 0.3924     | 0.7514    | 0.5224       | 0.7198           | 0.2514          | 0.5224              | 0.1166     | 0.3635         | 0.1066      | 0.5051          | 0.2547   | 0.4825       |
| 0.8624        | 74.9953 | 7987  | 1.1148          | 0.2612 | 0.4931 | 0.2276 | 0.2794    | 0.1776     | 0.4119    | 0.2917 | 0.4974 | 0.5361  | 0.4242    | 0.4151     | 0.7662    | 0.5376       | 0.7401           | 0.2444          | 0.5633              | 0.1307     | 0.3848         | 0.1186      | 0.5119          | 0.275    | 0.4806       |
| 0.838         | 76.0    | 8094  | 1.0995          | 0.2687 | 0.493  | 0.2477 | 0.2754    | 0.1831     | 0.4188    | 0.303  | 0.497  | 0.5302  | 0.3972    | 0.406      | 0.7602    | 0.5425       | 0.7349           | 0.2761          | 0.5367              | 0.1306     | 0.3991         | 0.1082      | 0.4915          | 0.2861   | 0.4886       |
| 0.8483        | 76.9953 | 8200  | 1.1110          | 0.2698 | 0.4914 | 0.2511 | 0.1734    | 0.1845     | 0.4311    | 0.2965 | 0.4996 | 0.532   | 0.405     | 0.4092     | 0.7608    | 0.5616       | 0.7477           | 0.2642          | 0.5367              | 0.135      | 0.3924         | 0.1092      | 0.4966          | 0.2791   | 0.4867       |
| 0.8413        | 78.0    | 8307  | 1.1064          | 0.2644 | 0.4912 | 0.2444 | 0.1873    | 0.1831     | 0.4319    | 0.2896 | 0.4983 | 0.5336  | 0.3939    | 0.4117     | 0.7562    | 0.5319       | 0.7343           | 0.2637          | 0.5265              | 0.1325     | 0.4095         | 0.1126      | 0.5             | 0.2812   | 0.4976       |
| 0.8424        | 78.9953 | 8413  | 1.1112          | 0.2682 | 0.496  | 0.2498 | 0.1394    | 0.184      | 0.4279    | 0.2966 | 0.4985 | 0.5272  | 0.358     | 0.4079     | 0.7394    | 0.552        | 0.7395           | 0.2704          | 0.5429              | 0.1313     | 0.3815         | 0.1094      | 0.5             | 0.2779   | 0.472        |
| 0.8277        | 80.0    | 8520  | 1.1451          | 0.2504 | 0.4758 | 0.2206 | 0.2244    | 0.1643     | 0.4229    | 0.2734 | 0.4878 | 0.517   | 0.3697    | 0.3882     | 0.7498    | 0.5308       | 0.7308           | 0.2379          | 0.5347              | 0.1187     | 0.373          | 0.0919      | 0.4678          | 0.2725   | 0.4787       |
| 0.8269        | 80.9953 | 8626  | 1.1064          | 0.2697 | 0.5029 | 0.2497 | 0.2324    | 0.1932     | 0.4296    | 0.2832 | 0.5024 | 0.5379  | 0.3857    | 0.4293     | 0.7615    | 0.5475       | 0.7424           | 0.2713          | 0.5673              | 0.1481     | 0.3953         | 0.1         | 0.4898          | 0.2818   | 0.4948       |
| 0.8159        | 82.0    | 8733  | 1.1055          | 0.2668 | 0.5022 | 0.2361 | 0.3082    | 0.1789     | 0.4284    | 0.2955 | 0.4975 | 0.5315  | 0.4478    | 0.4038     | 0.7377    | 0.5396       | 0.7267           | 0.2607          | 0.5429              | 0.1491     | 0.4024         | 0.1042      | 0.5051          | 0.2805   | 0.4806       |
| 0.8195        | 82.9953 | 8839  | 1.1321          | 0.2674 | 0.505  | 0.2418 | 0.3007    | 0.1856     | 0.4311    | 0.289  | 0.4912 | 0.528   | 0.4278    | 0.4039     | 0.7507    | 0.5368       | 0.7267           | 0.2728          | 0.5633              | 0.1336     | 0.3863         | 0.1169      | 0.4898          | 0.2772   | 0.4739       |
| 0.8138        | 84.0    | 8946  | 1.1110          | 0.2731 | 0.5061 | 0.2498 | 0.2881    | 0.192      | 0.44      | 0.2935 | 0.503  | 0.5382  | 0.4484    | 0.4141     | 0.7625    | 0.5537       | 0.7407           | 0.272           | 0.5796              | 0.1368     | 0.3863         | 0.1223      | 0.5             | 0.2808   | 0.4844       |
| 0.8113        | 84.9953 | 9052  | 1.1105          | 0.2722 | 0.5054 | 0.255  | 0.2724    | 0.1862     | 0.4388    | 0.2906 | 0.4969 | 0.536   | 0.4272    | 0.412      | 0.7586    | 0.5428       | 0.7314           | 0.2666          | 0.5592              | 0.1484     | 0.4033         | 0.125       | 0.5051          | 0.2784   | 0.481        |
| 0.808         | 86.0    | 9159  | 1.1130          | 0.2733 | 0.5056 | 0.253  | 0.2557    | 0.1873     | 0.4403    | 0.2926 | 0.502  | 0.5359  | 0.4107    | 0.4037     | 0.7613    | 0.5414       | 0.7384           | 0.2814          | 0.5612              | 0.1421     | 0.3948         | 0.1221      | 0.5085          | 0.2798   | 0.4768       |
| 0.8052        | 86.9953 | 9265  | 1.1015          | 0.2786 | 0.5087 | 0.2612 | 0.2996    | 0.192      | 0.4411    | 0.2995 | 0.5082 | 0.5401  | 0.4446    | 0.4152     | 0.7531    | 0.555        | 0.7326           | 0.2882          | 0.5653              | 0.1422     | 0.4076         | 0.1207      | 0.5119          | 0.2867   | 0.4834       |
| 0.7967        | 88.0    | 9372  | 1.1301          | 0.2689 | 0.5019 | 0.2442 | 0.3262    | 0.1843     | 0.4353    | 0.2939 | 0.4921 | 0.5253  | 0.452     | 0.3952     | 0.7619    | 0.5423       | 0.7279           | 0.2769          | 0.5612              | 0.1295     | 0.3668         | 0.1215      | 0.4983          | 0.2745   | 0.472        |
| 0.7837        | 88.9953 | 9478  | 1.1018          | 0.276  | 0.5116 | 0.2489 | 0.2803    | 0.1919     | 0.4484    | 0.304  | 0.5015 | 0.5301  | 0.401     | 0.4065     | 0.7623    | 0.5529       | 0.7308           | 0.2728          | 0.549               | 0.153      | 0.4014         | 0.1207      | 0.4898          | 0.2806   | 0.4796       |
| 0.7865        | 90.0    | 9585  | 1.1292          | 0.2712 | 0.5082 | 0.2462 | 0.2705    | 0.1855     | 0.4462    | 0.2898 | 0.494  | 0.524   | 0.3992    | 0.3985     | 0.7521    | 0.5493       | 0.7267           | 0.2821          | 0.5429              | 0.127      | 0.3673         | 0.1233      | 0.5085          | 0.2742   | 0.4744       |
| 0.7882        | 90.9953 | 9691  | 1.1164          | 0.2766 | 0.5191 | 0.2477 | 0.3024    | 0.1952     | 0.4425    | 0.296  | 0.5001 | 0.529   | 0.4275    | 0.4097     | 0.751     | 0.5528       | 0.7308           | 0.2731          | 0.5347              | 0.1424     | 0.3848         | 0.1298      | 0.5119          | 0.2849   | 0.4829       |
| 0.7887        | 92.0    | 9798  | 1.1070          | 0.2776 | 0.5169 | 0.2512 | 0.2553    | 0.1923     | 0.4504    | 0.2999 | 0.5033 | 0.5333  | 0.4005    | 0.4078     | 0.7665    | 0.5547       | 0.7343           | 0.2719          | 0.5449              | 0.1517     | 0.3962         | 0.1237      | 0.5068          | 0.2861   | 0.4844       |
| 0.7905        | 92.9953 | 9904  | 1.0951          | 0.2753 | 0.5169 | 0.2526 | 0.2849    | 0.1916     | 0.4366    | 0.2928 | 0.504  | 0.54    | 0.4511    | 0.411      | 0.7577    | 0.5602       | 0.7337           | 0.2639          | 0.549               | 0.1435     | 0.4019         | 0.1204      | 0.5339          | 0.2884   | 0.4815       |
| 0.7743        | 94.0    | 10011 | 1.0933          | 0.2819 | 0.521  | 0.2597 | 0.2878    | 0.1949     | 0.4462    | 0.2988 | 0.5049 | 0.541   | 0.4443    | 0.4101     | 0.772     | 0.572        | 0.7378           | 0.2717          | 0.551               | 0.1474     | 0.4043         | 0.1252      | 0.5254          | 0.2933   | 0.4867       |
| 0.7762        | 94.9953 | 10117 | 1.1082          | 0.2785 | 0.5219 | 0.2596 | 0.2847    | 0.1917     | 0.4507    | 0.2935 | 0.4993 | 0.5339  | 0.4327    | 0.4051     | 0.7669    | 0.5695       | 0.7355           | 0.2691          | 0.5531              | 0.1402     | 0.3834         | 0.1218      | 0.5169          | 0.2921   | 0.4806       |
| 0.7618        | 96.0    | 10224 | 1.1062          | 0.2774 | 0.5204 | 0.2555 | 0.287     | 0.1876     | 0.4483    | 0.2982 | 0.5005 | 0.532   | 0.436     | 0.4003     | 0.7614    | 0.5632       | 0.7326           | 0.2667          | 0.5408              | 0.1435     | 0.3938         | 0.1251      | 0.5153          | 0.2886   | 0.4777       |
| 0.783         | 96.9953 | 10330 | 1.1082          | 0.279  | 0.523  | 0.2572 | 0.284     | 0.1949     | 0.4486    | 0.302  | 0.4993 | 0.5334  | 0.4331    | 0.4071     | 0.7629    | 0.5593       | 0.7308           | 0.2744          | 0.5531              | 0.1447     | 0.3915         | 0.1238      | 0.5085          | 0.293    | 0.4834       |
| 0.7681        | 98.0    | 10437 | 1.0984          | 0.2819 | 0.5263 | 0.257  | 0.288     | 0.1948     | 0.4534    | 0.304  | 0.503  | 0.5368  | 0.4351    | 0.413      | 0.7653    | 0.5622       | 0.7326           | 0.277           | 0.549               | 0.1479     | 0.3957         | 0.129       | 0.5169          | 0.2933   | 0.4896       |
| 0.7742        | 98.9953 | 10543 | 1.1026          | 0.2806 | 0.5263 | 0.2569 | 0.2889    | 0.1948     | 0.4543    | 0.3014 | 0.5012 | 0.5341  | 0.4352    | 0.4077     | 0.7639    | 0.5568       | 0.732            | 0.2749          | 0.549               | 0.1484     | 0.3948         | 0.1271      | 0.5102          | 0.2957   | 0.4848       |
| 0.7654        | 99.5305 | 10600 | 1.1028          | 0.2808 | 0.5257 | 0.2589 | 0.2879    | 0.1953     | 0.4546    | 0.3004 | 0.5007 | 0.534   | 0.4339    | 0.4079     | 0.7629    | 0.5566       | 0.7331           | 0.2761          | 0.549               | 0.1484     | 0.3943         | 0.1271      | 0.5085          | 0.2956   | 0.4853       |


### Framework versions

- Transformers 4.40.0.dev0
- Pytorch 1.13.0+cu117
- Datasets 2.18.0
- Tokenizers 0.19.0