File size: 36,794 Bytes
f9f2595
 
 
 
53912ab
 
f9f2595
 
 
 
 
 
 
 
 
 
 
53912ab
f9f2595
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
---
license: apache-2.0
base_model: microsoft/conditional-detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: microsoft-conditional-detr-resnet-50-finetuned-10k-cppe5
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# microsoft-conditional-detr-resnet-50-finetuned-10k-cppe5

This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.3007
- Map: 0.3131
- Map 50: 0.6268
- Map 75: 0.2698
- Map Small: 0.2089
- Map Medium: 0.2237
- Map Large: 0.5358
- Mar 1: 0.3352
- Mar 10: 0.4586
- Mar 100: 0.4682
- Mar Small: 0.2773
- Mar Medium: 0.3748
- Mar Large: 0.6417
- Map Coverall: 0.5362
- Mar 100 Coverall: 0.6844
- Map Face Shield: 0.3199
- Mar 100 Face Shield: 0.4635
- Map Gloves: 0.1628
- Mar 100 Gloves: 0.3176
- Map Goggles: 0.2427
- Mar 100 Goggles: 0.4475
- Map Mask: 0.3038
- Mar 100 Mask: 0.4278

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 13.6734       | 1.0   | 107   | 3.0782          | 0.0022 | 0.009  | 0.0004 | 0.0002    | 0.0002     | 0.0027    | 0.0054 | 0.0291 | 0.0632  | 0.0028    | 0.0108     | 0.0955    | 0.0105       | 0.2595           | 0.0             | 0.0                 | 0.0        | 0.0126         | 0.0         | 0.0             | 0.0005   | 0.0438       |
| 2.9712        | 2.0   | 214   | 2.7340          | 0.0089 | 0.0267 | 0.0034 | 0.0036    | 0.0017     | 0.0114    | 0.0186 | 0.0749 | 0.1162  | 0.0082    | 0.0358     | 0.1266    | 0.0374       | 0.4457           | 0.0             | 0.0                 | 0.0004     | 0.0101         | 0.0         | 0.0             | 0.0069   | 0.1253       |
| 2.6599        | 3.0   | 321   | 2.6057          | 0.0122 | 0.0432 | 0.0034 | 0.0011    | 0.003      | 0.0138    | 0.0281 | 0.1003 | 0.1355  | 0.0324    | 0.0542     | 0.1526    | 0.0538       | 0.4428           | 0.0004          | 0.0288              | 0.0003     | 0.0322         | 0.0         | 0.0049          | 0.0064   | 0.1686       |
| 2.53          | 4.0   | 428   | 2.3681          | 0.0187 | 0.0542 | 0.0099 | 0.0061    | 0.0057     | 0.0372    | 0.0494 | 0.1502 | 0.1831  | 0.0272    | 0.1134     | 0.1631    | 0.0737       | 0.5191           | 0.0032          | 0.1                 | 0.0012     | 0.0487         | 0.0058      | 0.0656          | 0.0097   | 0.182        |
| 2.3495        | 5.0   | 535   | 2.2947          | 0.0282 | 0.0843 | 0.0163 | 0.0163    | 0.0175     | 0.0387    | 0.0796 | 0.194  | 0.2282  | 0.0407    | 0.1538     | 0.2516    | 0.0928       | 0.5798           | 0.015           | 0.1577              | 0.0009     | 0.0563         | 0.0131      | 0.123           | 0.0193   | 0.2242       |
| 2.2478        | 6.0   | 642   | 2.2016          | 0.0346 | 0.0914 | 0.0186 | 0.0079    | 0.0116     | 0.0668    | 0.0938 | 0.2406 | 0.2729  | 0.0362    | 0.1578     | 0.4043    | 0.1208       | 0.6121           | 0.0178          | 0.2577              | 0.0021     | 0.0925         | 0.0152      | 0.2033          | 0.017    | 0.199        |
| 2.1515        | 7.0   | 749   | 2.1026          | 0.0424 | 0.1121 | 0.0226 | 0.0162    | 0.0197     | 0.0747    | 0.1058 | 0.2613 | 0.2973  | 0.0996    | 0.2269     | 0.3484    | 0.1382       | 0.5769           | 0.0236          | 0.3                 | 0.0052     | 0.1216         | 0.0125      | 0.2246          | 0.0327   | 0.2634       |
| 2.0571        | 8.0   | 856   | 2.1115          | 0.0485 | 0.1183 | 0.0346 | 0.0078    | 0.0287     | 0.0922    | 0.1332 | 0.2587 | 0.2995  | 0.0573    | 0.1973     | 0.424     | 0.1446       | 0.6318           | 0.0442          | 0.2808              | 0.0027     | 0.1211         | 0.0182      | 0.1836          | 0.0327   | 0.2804       |
| 1.9981        | 9.0   | 963   | 2.0429          | 0.0433 | 0.1161 | 0.0242 | 0.0239    | 0.0216     | 0.0831    | 0.1163 | 0.2543 | 0.2985  | 0.1208    | 0.1892     | 0.4359    | 0.1403       | 0.6358           | 0.0251          | 0.2365              | 0.0059     | 0.1673         | 0.0187      | 0.1754          | 0.0265   | 0.2773       |
| 1.9338        | 10.0  | 1070  | 1.9025          | 0.079  | 0.1694 | 0.061  | 0.0175    | 0.0481     | 0.1245    | 0.1621 | 0.313  | 0.3524  | 0.1106    | 0.2565     | 0.5211    | 0.2324       | 0.6809           | 0.0753          | 0.3269              | 0.0094     | 0.198          | 0.0112      | 0.2328          | 0.0667   | 0.3232       |
| 1.8745        | 11.0  | 1177  | 1.8462          | 0.0938 | 0.2008 | 0.0772 | 0.0191    | 0.0666     | 0.1644    | 0.1632 | 0.3078 | 0.3485  | 0.1358    | 0.2725     | 0.483     | 0.3093       | 0.6618           | 0.0471          | 0.3442              | 0.0104     | 0.2005         | 0.0122      | 0.2033          | 0.0899   | 0.3325       |
| 1.7669        | 12.0  | 1284  | 1.7660          | 0.12   | 0.271  | 0.0939 | 0.0298    | 0.0714     | 0.2035    | 0.1928 | 0.3391 | 0.366   | 0.1539    | 0.2852     | 0.5395    | 0.368        | 0.6566           | 0.0741          | 0.3327              | 0.0236     | 0.2442         | 0.0363      | 0.2459          | 0.0981   | 0.3505       |
| 1.7122        | 13.0  | 1391  | 1.7355          | 0.1376 | 0.2863 | 0.1139 | 0.027     | 0.0899     | 0.2379    | 0.2151 | 0.3567 | 0.3878  | 0.1285    | 0.2998     | 0.5798    | 0.3958       | 0.637            | 0.0969          | 0.3712              | 0.0389     | 0.2548         | 0.0271      | 0.3115          | 0.1294   | 0.3644       |
| 1.6336        | 14.0  | 1498  | 1.6695          | 0.1609 | 0.3374 | 0.1317 | 0.0196    | 0.107      | 0.2757    | 0.2211 | 0.3673 | 0.3964  | 0.1449    | 0.3237     | 0.5801    | 0.4353       | 0.6595           | 0.146           | 0.3923              | 0.034      | 0.2482         | 0.0437      | 0.3361          | 0.1455   | 0.3459       |
| 1.5696        | 15.0  | 1605  | 1.6275          | 0.1601 | 0.3509 | 0.127  | 0.0231    | 0.102      | 0.2989    | 0.2181 | 0.3813 | 0.4083  | 0.1688    | 0.3313     | 0.5781    | 0.4323       | 0.6549           | 0.1061          | 0.4038              | 0.0618     | 0.3005         | 0.029       | 0.3246          | 0.1714   | 0.3577       |
| 1.5149        | 16.0  | 1712  | 1.5810          | 0.1862 | 0.3984 | 0.1463 | 0.0622    | 0.1143     | 0.3439    | 0.2268 | 0.3819 | 0.4019  | 0.1881    | 0.3158     | 0.6013    | 0.4779       | 0.6624           | 0.1141          | 0.4                 | 0.0694     | 0.2668         | 0.0704      | 0.3262          | 0.1991   | 0.3541       |
| 1.4732        | 17.0  | 1819  | 1.5458          | 0.1905 | 0.4135 | 0.1472 | 0.0514    | 0.1196     | 0.3237    | 0.2289 | 0.3868 | 0.4171  | 0.167     | 0.3378     | 0.5905    | 0.4746       | 0.6538           | 0.1547          | 0.4519              | 0.0932     | 0.3055         | 0.0488      | 0.3279          | 0.1812   | 0.3464       |
| 1.4327        | 18.0  | 1926  | 1.5617          | 0.1887 | 0.4038 | 0.142  | 0.0323    | 0.1178     | 0.3574    | 0.2395 | 0.3855 | 0.4114  | 0.1902    | 0.3236     | 0.589     | 0.4801       | 0.6595           | 0.1518          | 0.4462              | 0.0866     | 0.2829         | 0.0389      | 0.3197          | 0.186    | 0.349        |
| 1.3925        | 19.0  | 2033  | 1.5032          | 0.2162 | 0.4531 | 0.1701 | 0.0303    | 0.1292     | 0.3854    | 0.2572 | 0.4077 | 0.4328  | 0.1759    | 0.3377     | 0.6233    | 0.5043       | 0.6734           | 0.169           | 0.4442              | 0.1341     | 0.3221         | 0.0725      | 0.3754          | 0.201    | 0.349        |
| 1.3582        | 20.0  | 2140  | 1.4728          | 0.2077 | 0.4357 | 0.1744 | 0.0412    | 0.1414     | 0.3759    | 0.2516 | 0.4017 | 0.4251  | 0.1842    | 0.3402     | 0.6106    | 0.4879       | 0.6607           | 0.1537          | 0.4404              | 0.1159     | 0.2955         | 0.0633      | 0.359           | 0.2178   | 0.3701       |
| 1.329         | 21.0  | 2247  | 1.4826          | 0.2062 | 0.4509 | 0.1642 | 0.0325    | 0.1256     | 0.4185    | 0.2559 | 0.3974 | 0.4214  | 0.1371    | 0.3201     | 0.619     | 0.4879       | 0.6584           | 0.146           | 0.4212              | 0.1136     | 0.2698         | 0.0884      | 0.4164          | 0.195    | 0.3412       |
| 1.3458        | 22.0  | 2354  | 1.4653          | 0.2244 | 0.4636 | 0.1859 | 0.074     | 0.1501     | 0.4031    | 0.272  | 0.4102 | 0.4276  | 0.1735    | 0.3346     | 0.6213    | 0.5139       | 0.6711           | 0.1848          | 0.4712              | 0.1083     | 0.2769         | 0.0732      | 0.323           | 0.2419   | 0.3959       |
| 1.3028        | 23.0  | 2461  | 1.4139          | 0.2289 | 0.4906 | 0.1886 | 0.0572    | 0.1524     | 0.4043    | 0.2721 | 0.4191 | 0.4353  | 0.1771    | 0.3517     | 0.5964    | 0.4964       | 0.6653           | 0.1865          | 0.4481              | 0.1575     | 0.3211         | 0.0746      | 0.3738          | 0.2293   | 0.368        |
| 1.2704        | 24.0  | 2568  | 1.4173          | 0.2371 | 0.4973 | 0.199  | 0.0605    | 0.1634     | 0.419     | 0.2752 | 0.4172 | 0.4401  | 0.1776    | 0.3515     | 0.6027    | 0.5033       | 0.6636           | 0.2403          | 0.4596              | 0.1149     | 0.3005         | 0.1009      | 0.4066          | 0.2261   | 0.3701       |
| 1.2379        | 25.0  | 2675  | 1.3933          | 0.2608 | 0.5303 | 0.2271 | 0.0541    | 0.188      | 0.4582    | 0.2849 | 0.4189 | 0.4396  | 0.158     | 0.3455     | 0.6343    | 0.5376       | 0.6913           | 0.2509          | 0.4635              | 0.1194     | 0.3065         | 0.1534      | 0.3623          | 0.2428   | 0.3742       |
| 1.2257        | 26.0  | 2782  | 1.4209          | 0.2467 | 0.5049 | 0.2078 | 0.0557    | 0.1592     | 0.4446    | 0.2708 | 0.4135 | 0.4292  | 0.1526    | 0.3298     | 0.6245    | 0.5239       | 0.6636           | 0.2282          | 0.4288              | 0.134      | 0.294          | 0.1079      | 0.3902          | 0.2394   | 0.3696       |
| 1.1706        | 27.0  | 2889  | 1.3593          | 0.2631 | 0.5273 | 0.2353 | 0.0955    | 0.1891     | 0.4521    | 0.2912 | 0.4196 | 0.4422  | 0.1554    | 0.3475     | 0.6437    | 0.5374       | 0.685            | 0.261           | 0.4692              | 0.1276     | 0.2925         | 0.1269      | 0.3803          | 0.2624   | 0.384        |
| 1.1512        | 28.0  | 2996  | 1.3320          | 0.27   | 0.5371 | 0.2171 | 0.0727    | 0.192      | 0.456     | 0.2981 | 0.4398 | 0.4609  | 0.1954    | 0.3663     | 0.6427    | 0.5406       | 0.6971           | 0.2264          | 0.5                 | 0.1629     | 0.3131         | 0.1617      | 0.4066          | 0.2584   | 0.3876       |
| 1.1511        | 29.0  | 3103  | 1.3592          | 0.2641 | 0.526  | 0.2346 | 0.0526    | 0.1701     | 0.498     | 0.2977 | 0.4249 | 0.4395  | 0.1836    | 0.3263     | 0.6367    | 0.5376       | 0.6717           | 0.2129          | 0.4154              | 0.1414     | 0.291          | 0.1589      | 0.418           | 0.2697   | 0.4015       |
| 1.1312        | 30.0  | 3210  | 1.3863          | 0.2582 | 0.5328 | 0.2115 | 0.0667    | 0.1747     | 0.4443    | 0.283  | 0.4188 | 0.4418  | 0.2191    | 0.332      | 0.6478    | 0.5086       | 0.6526           | 0.2387          | 0.4808              | 0.1249     | 0.295          | 0.1609      | 0.3787          | 0.2579   | 0.4021       |
| 1.1207        | 31.0  | 3317  | 1.3294          | 0.2813 | 0.5581 | 0.252  | 0.1121    | 0.1988     | 0.4749    | 0.296  | 0.4362 | 0.4568  | 0.2423    | 0.3532     | 0.6468    | 0.5314       | 0.6775           | 0.2837          | 0.4788              | 0.1526     | 0.3131         | 0.1613      | 0.4033          | 0.2777   | 0.4113       |
| 1.0856        | 32.0  | 3424  | 1.3426          | 0.274  | 0.565  | 0.2282 | 0.1612    | 0.2023     | 0.4789    | 0.2989 | 0.4375 | 0.4541  | 0.2492    | 0.3497     | 0.6661    | 0.5195       | 0.6844           | 0.2952          | 0.4731              | 0.149      | 0.298          | 0.1551      | 0.4393          | 0.2516   | 0.3758       |
| 1.0909        | 33.0  | 3531  | 1.3174          | 0.2868 | 0.5799 | 0.2445 | 0.0956    | 0.2097     | 0.4865    | 0.3119 | 0.4466 | 0.4652  | 0.2553    | 0.3672     | 0.653     | 0.536        | 0.704            | 0.3096          | 0.4788              | 0.1576     | 0.3211         | 0.1758      | 0.441           | 0.2552   | 0.3809       |
| 1.0726        | 34.0  | 3638  | 1.3767          | 0.2751 | 0.561  | 0.2242 | 0.0993    | 0.1951     | 0.4811    | 0.2831 | 0.4241 | 0.452   | 0.2247    | 0.3529     | 0.6578    | 0.5375       | 0.6919           | 0.2638          | 0.4692              | 0.1562     | 0.3075         | 0.1456      | 0.3885          | 0.2724   | 0.4026       |
| 1.0799        | 35.0  | 3745  | 1.3316          | 0.2691 | 0.5569 | 0.2126 | 0.1108    | 0.1876     | 0.4522    | 0.2913 | 0.4243 | 0.4443  | 0.2217    | 0.3366     | 0.6247    | 0.5257       | 0.6879           | 0.2661          | 0.4712              | 0.1575     | 0.3055         | 0.1659      | 0.3869          | 0.2301   | 0.3701       |
| 1.0402        | 36.0  | 3852  | 1.3501          | 0.2735 | 0.5757 | 0.207  | 0.1217    | 0.2057     | 0.4564    | 0.284  | 0.4377 | 0.4568  | 0.2358    | 0.3814     | 0.6465    | 0.5171       | 0.685            | 0.2325          | 0.4481              | 0.1429     | 0.3035         | 0.2158      | 0.4656          | 0.2594   | 0.382        |
| 1.0531        | 37.0  | 3959  | 1.3324          | 0.2701 | 0.5336 | 0.2233 | 0.0834    | 0.1907     | 0.4826    | 0.2852 | 0.4439 | 0.4644  | 0.2142    | 0.3754     | 0.6658    | 0.5318       | 0.7052           | 0.2218          | 0.4596              | 0.1431     | 0.2995         | 0.1909      | 0.4639          | 0.2632   | 0.3938       |
| 1.028         | 38.0  | 4066  | 1.3593          | 0.2637 | 0.5412 | 0.2147 | 0.0638    | 0.1752     | 0.4642    | 0.2853 | 0.4231 | 0.4438  | 0.1997    | 0.3274     | 0.6417    | 0.5256       | 0.6705           | 0.2526          | 0.4327              | 0.1312     | 0.2854         | 0.1766      | 0.4344          | 0.2324   | 0.3959       |
| 1.0211        | 39.0  | 4173  | 1.3359          | 0.2728 | 0.5553 | 0.2294 | 0.1086    | 0.1991     | 0.4663    | 0.3018 | 0.4335 | 0.4525  | 0.2277    | 0.3625     | 0.6463    | 0.5408       | 0.6821           | 0.2664          | 0.4635              | 0.1253     | 0.2995         | 0.1883      | 0.4377          | 0.2433   | 0.3799       |
| 0.9986        | 40.0  | 4280  | 1.2900          | 0.2921 | 0.5961 | 0.2449 | 0.1617    | 0.2199     | 0.4851    | 0.3028 | 0.4506 | 0.4659  | 0.2422    | 0.3836     | 0.6408    | 0.546        | 0.696            | 0.2649          | 0.4538              | 0.1729     | 0.3111         | 0.2041      | 0.4574          | 0.2725   | 0.4113       |
| 0.9951        | 41.0  | 4387  | 1.3541          | 0.2695 | 0.5709 | 0.2055 | 0.1418    | 0.1857     | 0.4392    | 0.2921 | 0.4326 | 0.4456  | 0.2248    | 0.3602     | 0.602     | 0.5355       | 0.6855           | 0.2612          | 0.4365              | 0.137      | 0.2879         | 0.1907      | 0.4344          | 0.2233   | 0.3835       |
| 0.9838        | 42.0  | 4494  | 1.2978          | 0.2868 | 0.5888 | 0.2326 | 0.1262    | 0.209      | 0.5085    | 0.3099 | 0.4478 | 0.463   | 0.2469    | 0.3642     | 0.6518    | 0.5266       | 0.6867           | 0.2904          | 0.4692              | 0.1673     | 0.3291         | 0.2         | 0.4295          | 0.2497   | 0.4005       |
| 0.9637        | 43.0  | 4601  | 1.2950          | 0.285  | 0.5769 | 0.2351 | 0.1588    | 0.2034     | 0.4954    | 0.3066 | 0.4479 | 0.463   | 0.2504    | 0.3566     | 0.658     | 0.5326       | 0.689            | 0.2793          | 0.4615              | 0.1678     | 0.3171         | 0.1861      | 0.4262          | 0.2593   | 0.4211       |
| 0.9408        | 44.0  | 4708  | 1.3063          | 0.2795 | 0.5601 | 0.2375 | 0.1689    | 0.1905     | 0.5034    | 0.3126 | 0.4407 | 0.4552  | 0.2524    | 0.3763     | 0.6449    | 0.5461       | 0.6884           | 0.2866          | 0.4635              | 0.1291     | 0.2935         | 0.1614      | 0.4262          | 0.2741   | 0.4046       |
| 0.9457        | 45.0  | 4815  | 1.2866          | 0.2851 | 0.5794 | 0.2471 | 0.1712    | 0.2011     | 0.5017    | 0.3168 | 0.448  | 0.4642  | 0.2719    | 0.3629     | 0.6464    | 0.544        | 0.6896           | 0.2772          | 0.4692              | 0.1691     | 0.3176         | 0.1561      | 0.4328          | 0.279    | 0.4119       |
| 0.9476        | 46.0  | 4922  | 1.3047          | 0.2737 | 0.5779 | 0.2219 | 0.1539    | 0.1932     | 0.4666    | 0.3059 | 0.4356 | 0.449   | 0.2126    | 0.3626     | 0.6348    | 0.5344       | 0.6896           | 0.2537          | 0.4615              | 0.1547     | 0.3055         | 0.1925      | 0.4393          | 0.233    | 0.349        |
| 0.9206        | 47.0  | 5029  | 1.2955          | 0.283  | 0.579  | 0.2365 | 0.1437    | 0.1993     | 0.5024    | 0.3048 | 0.4388 | 0.4501  | 0.2412    | 0.3643     | 0.6283    | 0.5501       | 0.6913           | 0.2723          | 0.4096              | 0.1598     | 0.302          | 0.1965      | 0.4689          | 0.2364   | 0.3789       |
| 0.9431        | 48.0  | 5136  | 1.2809          | 0.2955 | 0.6039 | 0.2482 | 0.0914    | 0.2308     | 0.5222    | 0.3096 | 0.4442 | 0.4548  | 0.2012    | 0.3786     | 0.6271    | 0.5476       | 0.6855           | 0.3006          | 0.4154              | 0.1713     | 0.3246         | 0.2015      | 0.441           | 0.2567   | 0.4072       |
| 0.8965        | 49.0  | 5243  | 1.2968          | 0.2935 | 0.6015 | 0.2566 | 0.1579    | 0.2276     | 0.4831    | 0.3112 | 0.4451 | 0.4623  | 0.2279    | 0.3816     | 0.6389    | 0.5336       | 0.6844           | 0.2907          | 0.4558              | 0.1725     | 0.3317         | 0.1938      | 0.4344          | 0.2771   | 0.4052       |
| 0.8636        | 50.0  | 5350  | 1.2918          | 0.2933 | 0.611  | 0.2363 | 0.1728    | 0.2087     | 0.5035    | 0.3236 | 0.4496 | 0.468   | 0.2535    | 0.3745     | 0.6468    | 0.5353       | 0.6786           | 0.2819          | 0.4769              | 0.1849     | 0.3432         | 0.2064      | 0.4475          | 0.2583   | 0.3938       |
| 0.8769        | 51.0  | 5457  | 1.2744          | 0.2959 | 0.6161 | 0.2408 | 0.1599    | 0.2291     | 0.4925    | 0.3212 | 0.4461 | 0.4567  | 0.2249    | 0.3782     | 0.6405    | 0.5475       | 0.6942           | 0.289           | 0.4365              | 0.1629     | 0.3191         | 0.2061      | 0.4361          | 0.2737   | 0.3974       |
| 0.8591        | 52.0  | 5564  | 1.3174          | 0.2949 | 0.6031 | 0.254  | 0.1589    | 0.2241     | 0.5068    | 0.3164 | 0.4543 | 0.4668  | 0.2307    | 0.3872     | 0.6637    | 0.5382       | 0.6884           | 0.2941          | 0.4596              | 0.1565     | 0.3106         | 0.2212      | 0.4689          | 0.2645   | 0.4067       |
| 0.8347        | 53.0  | 5671  | 1.2626          | 0.3071 | 0.6126 | 0.2618 | 0.1107    | 0.228      | 0.5266    | 0.3237 | 0.4523 | 0.4672  | 0.2187    | 0.3786     | 0.6472    | 0.5428       | 0.6809           | 0.3195          | 0.4673              | 0.1497     | 0.3156         | 0.2318      | 0.4377          | 0.2917   | 0.4345       |
| 0.8474        | 54.0  | 5778  | 1.2730          | 0.3094 | 0.6174 | 0.2591 | 0.1729    | 0.2387     | 0.5153    | 0.3268 | 0.4591 | 0.4714  | 0.2482    | 0.3975     | 0.645     | 0.5352       | 0.6925           | 0.3235          | 0.4615              | 0.1627     | 0.3151         | 0.2273      | 0.459           | 0.2983   | 0.4289       |
| 0.8326        | 55.0  | 5885  | 1.3201          | 0.2977 | 0.6056 | 0.259  | 0.1635    | 0.2296     | 0.4971    | 0.3159 | 0.4505 | 0.4619  | 0.2297    | 0.3789     | 0.6458    | 0.5208       | 0.6769           | 0.3094          | 0.4462              | 0.1661     | 0.3075         | 0.1961      | 0.4508          | 0.2963   | 0.4284       |
| 0.8263        | 56.0  | 5992  | 1.2886          | 0.3029 | 0.6093 | 0.2592 | 0.1656    | 0.2243     | 0.5254    | 0.3256 | 0.4529 | 0.471   | 0.2464    | 0.3875     | 0.6623    | 0.5289       | 0.6838           | 0.3448          | 0.4808              | 0.1479     | 0.3095         | 0.2026      | 0.4574          | 0.2906   | 0.4237       |
| 0.8222        | 57.0  | 6099  | 1.2601          | 0.3086 | 0.6085 | 0.2789 | 0.1746    | 0.2259     | 0.5201    | 0.3328 | 0.4596 | 0.4718  | 0.2474    | 0.3766     | 0.6718    | 0.5455       | 0.6931           | 0.3148          | 0.4769              | 0.1575     | 0.3181         | 0.2356      | 0.4525          | 0.2895   | 0.4186       |
| 0.8328        | 58.0  | 6206  | 1.2603          | 0.3137 | 0.6183 | 0.2922 | 0.1647    | 0.2253     | 0.5418    | 0.3307 | 0.4605 | 0.4712  | 0.243     | 0.3802     | 0.6654    | 0.5519       | 0.6936           | 0.3174          | 0.4615              | 0.1559     | 0.3276         | 0.2486      | 0.4492          | 0.2948   | 0.4242       |
| 0.8005        | 59.0  | 6313  | 1.2536          | 0.3103 | 0.6141 | 0.266  | 0.173     | 0.2226     | 0.5386    | 0.3322 | 0.4597 | 0.4703  | 0.2512    | 0.3798     | 0.6546    | 0.5517       | 0.6867           | 0.3166          | 0.4673              | 0.1487     | 0.309          | 0.2489      | 0.4623          | 0.2857   | 0.4263       |
| 0.7786        | 60.0  | 6420  | 1.2642          | 0.309  | 0.6275 | 0.2553 | 0.1445    | 0.2286     | 0.5254    | 0.3205 | 0.4492 | 0.4578  | 0.223     | 0.3713     | 0.6501    | 0.5394       | 0.6786           | 0.3146          | 0.4346              | 0.1573     | 0.3126         | 0.2571      | 0.4623          | 0.2764   | 0.401        |
| 0.8077        | 61.0  | 6527  | 1.2750          | 0.2959 | 0.6106 | 0.236  | 0.1838    | 0.2134     | 0.5175    | 0.3227 | 0.4463 | 0.4581  | 0.2573    | 0.3555     | 0.662     | 0.5316       | 0.6884           | 0.3034          | 0.4308              | 0.1394     | 0.302          | 0.2304      | 0.459           | 0.2748   | 0.4103       |
| 0.7867        | 62.0  | 6634  | 1.2521          | 0.3135 | 0.6255 | 0.2768 | 0.1781    | 0.2267     | 0.5261    | 0.3347 | 0.4584 | 0.4696  | 0.2595    | 0.3671     | 0.6675    | 0.5386       | 0.6925           | 0.3145          | 0.4635              | 0.1656     | 0.3211         | 0.258       | 0.4639          | 0.2908   | 0.4072       |
| 0.772         | 63.0  | 6741  | 1.2546          | 0.3072 | 0.6313 | 0.2524 | 0.1802    | 0.2297     | 0.5233    | 0.3295 | 0.4587 | 0.4696  | 0.2715    | 0.3667     | 0.6625    | 0.5381       | 0.6913           | 0.277           | 0.4346              | 0.1792     | 0.3327         | 0.2497      | 0.4787          | 0.2918   | 0.4108       |
| 0.7736        | 64.0  | 6848  | 1.2673          | 0.3021 | 0.614  | 0.244  | 0.1813    | 0.2327     | 0.4996    | 0.3305 | 0.4561 | 0.4622  | 0.2509    | 0.3738     | 0.6488    | 0.5308       | 0.6803           | 0.3057          | 0.4423              | 0.1597     | 0.306          | 0.2247      | 0.459           | 0.2895   | 0.4232       |
| 0.7561        | 65.0  | 6955  | 1.3063          | 0.2936 | 0.6089 | 0.2321 | 0.1759    | 0.2158     | 0.5179    | 0.3244 | 0.4481 | 0.4604  | 0.2518    | 0.3706     | 0.6391    | 0.519        | 0.6769           | 0.3054          | 0.4558              | 0.1472     | 0.308          | 0.2309      | 0.459           | 0.2653   | 0.4021       |
| 0.7316        | 66.0  | 7062  | 1.2575          | 0.315  | 0.6168 | 0.2804 | 0.1995    | 0.2251     | 0.5303    | 0.3363 | 0.464  | 0.4719  | 0.2563    | 0.3883     | 0.6547    | 0.5418       | 0.6913           | 0.3304          | 0.4577              | 0.1497     | 0.3141         | 0.2533      | 0.4738          | 0.3001   | 0.4227       |
| 0.746         | 67.0  | 7169  | 1.2713          | 0.3118 | 0.6229 | 0.2625 | 0.1695    | 0.2338     | 0.5371    | 0.3323 | 0.4597 | 0.4707  | 0.2419    | 0.3916     | 0.6594    | 0.5428       | 0.6896           | 0.3193          | 0.4538              | 0.1503     | 0.3166         | 0.2676      | 0.4787          | 0.2791   | 0.4149       |
| 0.7539        | 68.0  | 7276  | 1.2705          | 0.3161 | 0.6353 | 0.2591 | 0.1718    | 0.2332     | 0.5451    | 0.3343 | 0.4568 | 0.4702  | 0.2554    | 0.3826     | 0.6569    | 0.5358       | 0.6803           | 0.3318          | 0.4577              | 0.1494     | 0.3146         | 0.2715      | 0.4918          | 0.292    | 0.4067       |
| 0.7219        | 69.0  | 7383  | 1.2644          | 0.3175 | 0.6321 | 0.2758 | 0.1924    | 0.2341     | 0.5379    | 0.3404 | 0.4653 | 0.4744  | 0.2457    | 0.3925     | 0.6648    | 0.5442       | 0.6988           | 0.3151          | 0.4712              | 0.1662     | 0.3176         | 0.2727      | 0.4672          | 0.2895   | 0.417        |
| 0.7202        | 70.0  | 7490  | 1.2718          | 0.3124 | 0.6233 | 0.2622 | 0.1758    | 0.2246     | 0.5305    | 0.334  | 0.4534 | 0.4602  | 0.2437    | 0.3718     | 0.6419    | 0.547        | 0.6954           | 0.3204          | 0.4327              | 0.16       | 0.3251         | 0.2487      | 0.4361          | 0.2858   | 0.4119       |
| 0.7019        | 71.0  | 7597  | 1.2819          | 0.3073 | 0.6104 | 0.2737 | 0.1777    | 0.2295     | 0.5232    | 0.3287 | 0.4558 | 0.4679  | 0.2492    | 0.3812     | 0.6526    | 0.548        | 0.6913           | 0.3097          | 0.4269              | 0.1571     | 0.3176         | 0.2321      | 0.4951          | 0.2894   | 0.4088       |
| 0.6951        | 72.0  | 7704  | 1.2853          | 0.3099 | 0.6174 | 0.2613 | 0.1872    | 0.2375     | 0.5177    | 0.3358 | 0.463  | 0.4711  | 0.2495    | 0.3905     | 0.6495    | 0.5493       | 0.6954           | 0.3007          | 0.4462              | 0.1597     | 0.3312         | 0.2477      | 0.4689          | 0.2921   | 0.4139       |
| 0.6821        | 73.0  | 7811  | 1.2949          | 0.304  | 0.6157 | 0.2543 | 0.1795    | 0.2194     | 0.5134    | 0.3303 | 0.4579 | 0.4682  | 0.2485    | 0.3667     | 0.6627    | 0.5392       | 0.6884           | 0.3043          | 0.4596              | 0.1457     | 0.3106         | 0.2493      | 0.4803          | 0.2817   | 0.4021       |
| 0.6943        | 74.0  | 7918  | 1.2790          | 0.3101 | 0.6194 | 0.2567 | 0.1863    | 0.2366     | 0.52      | 0.3337 | 0.4559 | 0.4647  | 0.2422    | 0.3708     | 0.6517    | 0.5416       | 0.6844           | 0.3093          | 0.4442              | 0.1441     | 0.3005         | 0.2547      | 0.4754          | 0.3007   | 0.4191       |
| 0.6786        | 75.0  | 8025  | 1.2823          | 0.3121 | 0.6285 | 0.2576 | 0.1497    | 0.2309     | 0.5135    | 0.3348 | 0.4575 | 0.4686  | 0.2583    | 0.3764     | 0.6485    | 0.5449       | 0.6838           | 0.3174          | 0.4635              | 0.1517     | 0.3111         | 0.2466      | 0.4639          | 0.2997   | 0.4206       |
| 0.6606        | 76.0  | 8132  | 1.2780          | 0.3191 | 0.628  | 0.2754 | 0.1958    | 0.2363     | 0.5414    | 0.3399 | 0.4597 | 0.4708  | 0.2592    | 0.3744     | 0.6633    | 0.5547       | 0.7              | 0.316           | 0.4442              | 0.1575     | 0.3111         | 0.2601      | 0.4672          | 0.3071   | 0.4314       |
| 0.6585        | 77.0  | 8239  | 1.2696          | 0.3162 | 0.6344 | 0.2645 | 0.1962    | 0.2277     | 0.5346    | 0.3365 | 0.4586 | 0.4682  | 0.2466    | 0.3861     | 0.6505    | 0.544        | 0.6931           | 0.3221          | 0.4462              | 0.1604     | 0.3231         | 0.243       | 0.4541          | 0.3117   | 0.4247       |
| 0.6592        | 78.0  | 8346  | 1.2684          | 0.3196 | 0.6245 | 0.2718 | 0.2043    | 0.2306     | 0.5384    | 0.3429 | 0.4657 | 0.4755  | 0.2704    | 0.3934     | 0.6572    | 0.5458       | 0.6902           | 0.3302          | 0.4577              | 0.1748     | 0.3377         | 0.2455      | 0.4672          | 0.3014   | 0.4247       |
| 0.6585        | 79.0  | 8453  | 1.2727          | 0.3178 | 0.6234 | 0.2755 | 0.2032    | 0.2309     | 0.5422    | 0.337  | 0.4627 | 0.4718  | 0.2685    | 0.3828     | 0.6604    | 0.5462       | 0.6879           | 0.334           | 0.4538              | 0.1643     | 0.3337         | 0.2447      | 0.4738          | 0.2997   | 0.4098       |
| 0.6463        | 80.0  | 8560  | 1.2868          | 0.3123 | 0.6186 | 0.2752 | 0.1921    | 0.2364     | 0.5315    | 0.3377 | 0.4535 | 0.465   | 0.2578    | 0.3804     | 0.6535    | 0.5375       | 0.6879           | 0.333           | 0.4519              | 0.1566     | 0.3201         | 0.2372      | 0.4525          | 0.2973   | 0.4129       |
| 0.6458        | 81.0  | 8667  | 1.2962          | 0.3167 | 0.6227 | 0.277  | 0.1767    | 0.2339     | 0.5406    | 0.3376 | 0.4549 | 0.4652  | 0.244     | 0.3766     | 0.6626    | 0.5454       | 0.6948           | 0.3445          | 0.4692              | 0.1444     | 0.3146         | 0.2609      | 0.441           | 0.2885   | 0.4062       |
| 0.6207        | 82.0  | 8774  | 1.2957          | 0.3139 | 0.6258 | 0.2759 | 0.202     | 0.2299     | 0.5281    | 0.3389 | 0.4568 | 0.47    | 0.2643    | 0.3793     | 0.6634    | 0.5374       | 0.6896           | 0.3243          | 0.4692              | 0.151      | 0.3246         | 0.258       | 0.4443          | 0.2987   | 0.4222       |
| 0.6356        | 83.0  | 8881  | 1.3102          | 0.31   | 0.618  | 0.2765 | 0.1833    | 0.229      | 0.5134    | 0.3317 | 0.4583 | 0.4686  | 0.2588    | 0.394      | 0.642     | 0.5361       | 0.689            | 0.3412          | 0.4769              | 0.1453     | 0.3241         | 0.241       | 0.4443          | 0.2865   | 0.4088       |
| 0.6286        | 84.0  | 8988  | 1.2985          | 0.3066 | 0.6197 | 0.2678 | 0.1879    | 0.2187     | 0.524     | 0.3336 | 0.4478 | 0.4549  | 0.2533    | 0.3669     | 0.6431    | 0.5354       | 0.6844           | 0.3222          | 0.4423              | 0.1468     | 0.306          | 0.2344      | 0.4344          | 0.294    | 0.4072       |
| 0.6269        | 85.0  | 9095  | 1.2769          | 0.3174 | 0.6259 | 0.2708 | 0.2034    | 0.2266     | 0.5397    | 0.3425 | 0.4593 | 0.4669  | 0.2736    | 0.3741     | 0.6577    | 0.5429       | 0.6919           | 0.3334          | 0.4596              | 0.1592     | 0.3211         | 0.2454      | 0.441           | 0.3061   | 0.4211       |
| 0.5998        | 86.0  | 9202  | 1.2841          | 0.317  | 0.616  | 0.2823 | 0.1881    | 0.2347     | 0.538     | 0.3419 | 0.4606 | 0.4711  | 0.2701    | 0.3843     | 0.6488    | 0.5414       | 0.6896           | 0.3243          | 0.4692              | 0.1586     | 0.3256         | 0.2489      | 0.4443          | 0.3116   | 0.4268       |
| 0.6054        | 87.0  | 9309  | 1.2951          | 0.3163 | 0.6223 | 0.2731 | 0.1937    | 0.2287     | 0.541     | 0.3368 | 0.4578 | 0.4648  | 0.2732    | 0.3682     | 0.6534    | 0.5436       | 0.6832           | 0.3263          | 0.4577              | 0.1617     | 0.3196         | 0.251       | 0.4377          | 0.2988   | 0.4258       |
| 0.6138        | 88.0  | 9416  | 1.2934          | 0.3144 | 0.6109 | 0.2739 | 0.1932    | 0.2315     | 0.5285    | 0.3451 | 0.4584 | 0.4683  | 0.264     | 0.3767     | 0.6479    | 0.5384       | 0.6844           | 0.3286          | 0.4712              | 0.1513     | 0.3131         | 0.2518      | 0.4492          | 0.3019   | 0.4237       |
| 0.5887        | 89.0  | 9523  | 1.2940          | 0.3171 | 0.6147 | 0.279  | 0.2023    | 0.2306     | 0.5411    | 0.3377 | 0.4613 | 0.4698  | 0.2773    | 0.3725     | 0.6505    | 0.5397       | 0.689            | 0.336           | 0.4673              | 0.161      | 0.3161         | 0.248       | 0.4541          | 0.3008   | 0.4227       |
| 0.6026        | 90.0  | 9630  | 1.3081          | 0.3106 | 0.6154 | 0.2657 | 0.2063    | 0.2143     | 0.5398    | 0.3342 | 0.4543 | 0.4616  | 0.2846    | 0.3601     | 0.6397    | 0.5287       | 0.6769           | 0.3076          | 0.4442              | 0.1675     | 0.3146         | 0.2498      | 0.4426          | 0.2996   | 0.4299       |
| 0.6116        | 91.0  | 9737  | 1.3193          | 0.3046 | 0.5974 | 0.2664 | 0.215     | 0.2096     | 0.5344    | 0.3349 | 0.4514 | 0.4594  | 0.2806    | 0.3671     | 0.6362    | 0.5371       | 0.6844           | 0.2908          | 0.4327              | 0.1537     | 0.3121         | 0.2481      | 0.4475          | 0.2931   | 0.4201       |
| 0.5874        | 92.0  | 9844  | 1.3148          | 0.307  | 0.5997 | 0.2706 | 0.207     | 0.2168     | 0.5303    | 0.3364 | 0.457  | 0.4653  | 0.2759    | 0.38       | 0.6418    | 0.5305       | 0.6827           | 0.3038          | 0.4519              | 0.1554     | 0.3176         | 0.2488      | 0.4541          | 0.2965   | 0.4201       |
| 0.5765        | 93.0  | 9951  | 1.3114          | 0.31   | 0.6063 | 0.2757 | 0.2056    | 0.2172     | 0.5388    | 0.3349 | 0.4549 | 0.4625  | 0.275     | 0.369      | 0.6406    | 0.5308       | 0.6827           | 0.3106          | 0.4538              | 0.1567     | 0.309          | 0.2532      | 0.4459          | 0.2988   | 0.4211       |
| 0.5799        | 94.0  | 10058 | 1.3074          | 0.3101 | 0.6134 | 0.2681 | 0.2042    | 0.2135     | 0.5519    | 0.3365 | 0.454  | 0.4634  | 0.272     | 0.3674     | 0.6508    | 0.53         | 0.6821           | 0.3105          | 0.4596              | 0.1525     | 0.3161         | 0.2582      | 0.4377          | 0.2993   | 0.4216       |
| 0.5678        | 95.0  | 10165 | 1.3073          | 0.3102 | 0.6184 | 0.2637 | 0.2103    | 0.2233     | 0.537     | 0.3327 | 0.4527 | 0.461   | 0.2775    | 0.3668     | 0.6309    | 0.537        | 0.6884           | 0.3217          | 0.4404              | 0.1558     | 0.3106         | 0.2354      | 0.4459          | 0.3011   | 0.4196       |
| 0.5776        | 96.0  | 10272 | 1.3083          | 0.3146 | 0.6177 | 0.2751 | 0.2083    | 0.2193     | 0.5465    | 0.3364 | 0.4548 | 0.4627  | 0.2731    | 0.3681     | 0.6399    | 0.5359       | 0.6861           | 0.3306          | 0.4538              | 0.1566     | 0.3176         | 0.2484      | 0.4361          | 0.3012   | 0.4201       |
| 0.5768        | 97.0  | 10379 | 1.3027          | 0.3134 | 0.6204 | 0.2681 | 0.2056    | 0.2203     | 0.5453    | 0.3365 | 0.4545 | 0.4622  | 0.2774    | 0.3652     | 0.6417    | 0.5329       | 0.6832           | 0.3282          | 0.4538              | 0.1591     | 0.3181         | 0.2445      | 0.4328          | 0.3021   | 0.4232       |
| 0.5708        | 98.0  | 10486 | 1.3045          | 0.3094 | 0.6223 | 0.2705 | 0.2077    | 0.2196     | 0.5411    | 0.3325 | 0.4544 | 0.4623  | 0.2754    | 0.3668     | 0.641     | 0.5342       | 0.6838           | 0.3201          | 0.4519              | 0.1588     | 0.3181         | 0.2347      | 0.4361          | 0.299    | 0.4216       |
| 0.5779        | 99.0  | 10593 | 1.3050          | 0.3104 | 0.6231 | 0.2616 | 0.2049    | 0.2159     | 0.5424    | 0.3324 | 0.455  | 0.4645  | 0.274     | 0.3682     | 0.6457    | 0.536        | 0.6838           | 0.3162          | 0.4615              | 0.1593     | 0.3176         | 0.2376      | 0.4377          | 0.303    | 0.4216       |
| 0.5571        | 100.0 | 10700 | 1.3007          | 0.3131 | 0.6268 | 0.2698 | 0.2089    | 0.2237     | 0.5358    | 0.3352 | 0.4586 | 0.4682  | 0.2773    | 0.3748     | 0.6417    | 0.5362       | 0.6844           | 0.3199          | 0.4635              | 0.1628     | 0.3176         | 0.2427      | 0.4475          | 0.3038   | 0.4278       |


### Framework versions

- Transformers 4.40.0.dev0
- Pytorch 1.13.0+cu117
- Datasets 2.18.0
- Tokenizers 0.19.0