--- license: apache-2.0 base_model: facebook/detr-resnet-50 tags: - object-detection - vision - generated_from_trainer model-index: - name: detr-finetuned-cppe-5-10k-steps results: [] --- # detr-finetuned-cppe-5-10k-steps This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset. It achieves the following results on the evaluation set: - Loss: 1.2634 - Map: 0.3099 - Map 50: 0.596 - Map 75: 0.2729 - Map Small: 0.0887 - Map Medium: 0.2527 - Map Large: 0.4839 - Mar 1: 0.2938 - Mar 10: 0.4679 - Mar 100: 0.4801 - Mar Small: 0.1859 - Mar Medium: 0.4322 - Mar Large: 0.6546 - Map Coverall: 0.5624 - Mar 100 Coverall: 0.6788 - Map Face Shield: 0.287 - Mar 100 Face Shield: 0.5304 - Map Gloves: 0.2456 - Mar 100 Gloves: 0.4116 - Map Goggles: 0.17 - Mar 100 Goggles: 0.3815 - Map Mask: 0.2843 - Mar 100 Mask: 0.3982 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 1337 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:| | 2.4009 | 1.0 | 107 | 2.2015 | 0.0541 | 0.1103 | 0.048 | 0.0047 | 0.0306 | 0.0619 | 0.072 | 0.1681 | 0.1971 | 0.0667 | 0.1397 | 0.2614 | 0.251 | 0.5788 | 0.0 | 0.0 | 0.0054 | 0.1513 | 0.0 | 0.0 | 0.0142 | 0.2556 | | 1.9619 | 2.0 | 214 | 2.0515 | 0.0655 | 0.141 | 0.0509 | 0.0082 | 0.0445 | 0.074 | 0.0896 | 0.1823 | 0.2168 | 0.0864 | 0.1683 | 0.2591 | 0.2839 | 0.577 | 0.0 | 0.0 | 0.0139 | 0.2156 | 0.0 | 0.0 | 0.0299 | 0.2911 | | 1.9217 | 3.0 | 321 | 2.0117 | 0.081 | 0.1819 | 0.0624 | 0.0141 | 0.0511 | 0.0972 | 0.0824 | 0.1792 | 0.201 | 0.0816 | 0.1546 | 0.2373 | 0.3187 | 0.5275 | 0.0 | 0.0 | 0.0238 | 0.1879 | 0.0 | 0.0 | 0.0624 | 0.2893 | | 1.8179 | 4.0 | 428 | 2.0698 | 0.0751 | 0.172 | 0.0567 | 0.017 | 0.0596 | 0.0916 | 0.0923 | 0.1794 | 0.2009 | 0.0586 | 0.1418 | 0.264 | 0.3068 | 0.5838 | 0.0051 | 0.0392 | 0.0318 | 0.1871 | 0.0 | 0.0 | 0.032 | 0.1947 | | 1.7692 | 5.0 | 535 | 1.8755 | 0.1017 | 0.2381 | 0.0751 | 0.0271 | 0.0783 | 0.1362 | 0.1155 | 0.2277 | 0.2474 | 0.0956 | 0.1799 | 0.3309 | 0.3285 | 0.5833 | 0.0316 | 0.1392 | 0.0431 | 0.2371 | 0.0 | 0.0 | 0.1056 | 0.2773 | | 1.7545 | 6.0 | 642 | 1.9933 | 0.0781 | 0.1909 | 0.0567 | 0.0273 | 0.0808 | 0.0976 | 0.1122 | 0.2294 | 0.2492 | 0.0865 | 0.1995 | 0.3073 | 0.2437 | 0.5523 | 0.0194 | 0.1937 | 0.0316 | 0.2259 | 0.0004 | 0.0154 | 0.0952 | 0.2587 | | 1.6804 | 7.0 | 749 | 1.7828 | 0.1131 | 0.2575 | 0.0886 | 0.0424 | 0.0937 | 0.146 | 0.1329 | 0.2577 | 0.2782 | 0.0998 | 0.2156 | 0.3716 | 0.3505 | 0.5973 | 0.0416 | 0.2228 | 0.0332 | 0.2214 | 0.0047 | 0.0523 | 0.1357 | 0.2973 | | 1.6654 | 8.0 | 856 | 1.9042 | 0.1083 | 0.2233 | 0.0989 | 0.0375 | 0.0856 | 0.1512 | 0.119 | 0.2209 | 0.2425 | 0.0997 | 0.184 | 0.3262 | 0.3451 | 0.5788 | 0.0116 | 0.1291 | 0.0387 | 0.2254 | 0.0005 | 0.0077 | 0.1456 | 0.2716 | | 1.6088 | 9.0 | 963 | 1.6943 | 0.138 | 0.2833 | 0.1157 | 0.0426 | 0.1149 | 0.1627 | 0.1488 | 0.2863 | 0.312 | 0.1169 | 0.2619 | 0.3846 | 0.4569 | 0.6378 | 0.0613 | 0.2722 | 0.049 | 0.2946 | 0.005 | 0.0846 | 0.118 | 0.2707 | | 1.5138 | 10.0 | 1070 | 1.7314 | 0.1228 | 0.2824 | 0.0887 | 0.0513 | 0.0925 | 0.1645 | 0.1352 | 0.2706 | 0.2938 | 0.1068 | 0.2145 | 0.4247 | 0.3955 | 0.6171 | 0.0583 | 0.2278 | 0.0518 | 0.2853 | 0.0018 | 0.1031 | 0.1066 | 0.2356 | | 1.5027 | 11.0 | 1177 | 1.6321 | 0.1525 | 0.3448 | 0.1173 | 0.0483 | 0.1088 | 0.2251 | 0.1712 | 0.3401 | 0.3617 | 0.145 | 0.2811 | 0.5185 | 0.4591 | 0.6631 | 0.0774 | 0.3494 | 0.0626 | 0.267 | 0.0169 | 0.2477 | 0.1462 | 0.2813 | | 1.4677 | 12.0 | 1284 | 2.0406 | 0.1067 | 0.2526 | 0.0761 | 0.0463 | 0.0982 | 0.1369 | 0.1356 | 0.2686 | 0.2953 | 0.1097 | 0.2651 | 0.3816 | 0.2757 | 0.4491 | 0.0601 | 0.2924 | 0.0522 | 0.2647 | 0.0058 | 0.1877 | 0.1395 | 0.2827 | | 1.5372 | 13.0 | 1391 | 1.7044 | 0.1409 | 0.3314 | 0.1034 | 0.031 | 0.1141 | 0.2107 | 0.1673 | 0.3155 | 0.3429 | 0.1238 | 0.2776 | 0.4824 | 0.4096 | 0.645 | 0.0739 | 0.2785 | 0.0663 | 0.3125 | 0.0267 | 0.1769 | 0.1283 | 0.3018 | | 1.4344 | 14.0 | 1498 | 1.7464 | 0.1481 | 0.3142 | 0.1286 | 0.0403 | 0.1117 | 0.2116 | 0.1794 | 0.3172 | 0.341 | 0.1046 | 0.2626 | 0.4956 | 0.4386 | 0.6342 | 0.0826 | 0.3241 | 0.0722 | 0.2982 | 0.0146 | 0.1892 | 0.1323 | 0.2591 | | 1.4229 | 15.0 | 1605 | 1.6013 | 0.1702 | 0.3561 | 0.1491 | 0.0498 | 0.138 | 0.2444 | 0.2054 | 0.3503 | 0.3777 | 0.1116 | 0.3163 | 0.5359 | 0.4423 | 0.6284 | 0.1069 | 0.3937 | 0.074 | 0.3201 | 0.0344 | 0.2292 | 0.1933 | 0.3169 | | 1.4626 | 16.0 | 1712 | 1.6146 | 0.1503 | 0.3349 | 0.1185 | 0.0503 | 0.1274 | 0.2149 | 0.1799 | 0.3338 | 0.3528 | 0.1451 | 0.2873 | 0.5005 | 0.4158 | 0.6068 | 0.0656 | 0.2962 | 0.0705 | 0.2982 | 0.0132 | 0.2538 | 0.1864 | 0.3089 | | 1.3855 | 17.0 | 1819 | 1.5998 | 0.161 | 0.3442 | 0.1209 | 0.0365 | 0.133 | 0.2319 | 0.1891 | 0.3623 | 0.3843 | 0.1518 | 0.3293 | 0.5154 | 0.4465 | 0.6369 | 0.0996 | 0.3443 | 0.0744 | 0.3129 | 0.0265 | 0.3185 | 0.158 | 0.3089 | | 1.3531 | 18.0 | 1926 | 1.5662 | 0.1806 | 0.3906 | 0.1542 | 0.0565 | 0.1444 | 0.2585 | 0.1988 | 0.3576 | 0.3809 | 0.137 | 0.3324 | 0.5082 | 0.4618 | 0.6239 | 0.1185 | 0.3519 | 0.0802 | 0.3232 | 0.0338 | 0.2723 | 0.2084 | 0.3333 | | 1.3227 | 19.0 | 2033 | 1.5096 | 0.1851 | 0.3799 | 0.1724 | 0.0602 | 0.1443 | 0.2829 | 0.2075 | 0.3738 | 0.3996 | 0.1532 | 0.337 | 0.5536 | 0.4967 | 0.6432 | 0.1089 | 0.3418 | 0.0842 | 0.3241 | 0.0392 | 0.3415 | 0.1964 | 0.3476 | | 1.3247 | 20.0 | 2140 | 1.6135 | 0.1667 | 0.3672 | 0.1345 | 0.0526 | 0.1349 | 0.2451 | 0.1985 | 0.343 | 0.3669 | 0.1391 | 0.2932 | 0.5312 | 0.417 | 0.5865 | 0.0951 | 0.3481 | 0.0787 | 0.3321 | 0.0545 | 0.2585 | 0.1881 | 0.3093 | | 1.3415 | 21.0 | 2247 | 1.5346 | 0.1817 | 0.3858 | 0.1538 | 0.0469 | 0.1346 | 0.2846 | 0.208 | 0.3571 | 0.3861 | 0.1497 | 0.3171 | 0.5396 | 0.4553 | 0.6315 | 0.1341 | 0.3494 | 0.093 | 0.3665 | 0.0299 | 0.26 | 0.1963 | 0.3231 | | 1.2842 | 22.0 | 2354 | 1.5234 | 0.1726 | 0.3864 | 0.1334 | 0.0522 | 0.1229 | 0.2889 | 0.1963 | 0.3537 | 0.3769 | 0.1175 | 0.3062 | 0.5458 | 0.4454 | 0.6347 | 0.1191 | 0.3354 | 0.1017 | 0.3281 | 0.0394 | 0.3015 | 0.1572 | 0.2849 | | 1.2719 | 23.0 | 2461 | 1.5006 | 0.1954 | 0.4054 | 0.1682 | 0.036 | 0.1567 | 0.2928 | 0.2095 | 0.3811 | 0.4064 | 0.1288 | 0.3401 | 0.5824 | 0.486 | 0.6928 | 0.1188 | 0.343 | 0.1206 | 0.3317 | 0.033 | 0.3185 | 0.2187 | 0.3458 | | 1.2579 | 24.0 | 2568 | 1.5025 | 0.1841 | 0.3897 | 0.1493 | 0.0533 | 0.1558 | 0.2693 | 0.2153 | 0.3749 | 0.3993 | 0.1524 | 0.3551 | 0.5345 | 0.4639 | 0.6613 | 0.1269 | 0.3304 | 0.1017 | 0.3371 | 0.0397 | 0.3462 | 0.1882 | 0.3218 | | 1.2554 | 25.0 | 2675 | 1.4877 | 0.1827 | 0.3852 | 0.1541 | 0.0538 | 0.1533 | 0.2853 | 0.2052 | 0.3666 | 0.3852 | 0.1488 | 0.3337 | 0.5221 | 0.4777 | 0.655 | 0.1071 | 0.3253 | 0.0929 | 0.3214 | 0.0292 | 0.2846 | 0.2066 | 0.3396 | | 1.2252 | 26.0 | 2782 | 1.5077 | 0.1859 | 0.4021 | 0.1599 | 0.0402 | 0.1372 | 0.2948 | 0.216 | 0.3777 | 0.3912 | 0.1225 | 0.3302 | 0.5665 | 0.5031 | 0.6662 | 0.0959 | 0.3848 | 0.1001 | 0.296 | 0.0513 | 0.2985 | 0.1789 | 0.3107 | | 1.2314 | 27.0 | 2889 | 1.4769 | 0.2077 | 0.4372 | 0.1761 | 0.063 | 0.163 | 0.3194 | 0.2307 | 0.3987 | 0.4126 | 0.152 | 0.3529 | 0.5795 | 0.5016 | 0.6667 | 0.1184 | 0.3797 | 0.1413 | 0.3455 | 0.0468 | 0.3138 | 0.2302 | 0.3573 | | 1.1945 | 28.0 | 2996 | 1.4541 | 0.2162 | 0.445 | 0.1861 | 0.071 | 0.1627 | 0.3288 | 0.2301 | 0.4001 | 0.4205 | 0.1289 | 0.3657 | 0.5911 | 0.5064 | 0.6716 | 0.1342 | 0.3873 | 0.1525 | 0.3406 | 0.0425 | 0.3446 | 0.2453 | 0.3582 | | 1.1846 | 29.0 | 3103 | 1.4515 | 0.2166 | 0.4623 | 0.1829 | 0.0571 | 0.168 | 0.3319 | 0.233 | 0.373 | 0.3875 | 0.142 | 0.3222 | 0.5468 | 0.4959 | 0.6631 | 0.149 | 0.3291 | 0.1491 | 0.3522 | 0.0821 | 0.2862 | 0.2071 | 0.3071 | | 1.1851 | 30.0 | 3210 | 1.3980 | 0.2164 | 0.4486 | 0.1748 | 0.0629 | 0.1659 | 0.3566 | 0.2247 | 0.39 | 0.4034 | 0.1436 | 0.3397 | 0.572 | 0.4939 | 0.6586 | 0.125 | 0.3519 | 0.1682 | 0.3857 | 0.0753 | 0.2892 | 0.2195 | 0.3316 | | 1.1445 | 31.0 | 3317 | 1.4215 | 0.2134 | 0.4586 | 0.1612 | 0.071 | 0.1498 | 0.3323 | 0.2341 | 0.3731 | 0.3852 | 0.1735 | 0.3155 | 0.5395 | 0.5085 | 0.6626 | 0.1335 | 0.3291 | 0.1568 | 0.3491 | 0.0514 | 0.2538 | 0.2166 | 0.3316 | | 1.1553 | 32.0 | 3424 | 1.4463 | 0.2218 | 0.4616 | 0.1857 | 0.0786 | 0.1532 | 0.3475 | 0.2378 | 0.406 | 0.4218 | 0.1866 | 0.3423 | 0.576 | 0.4982 | 0.6653 | 0.1843 | 0.4 | 0.1508 | 0.3621 | 0.0442 | 0.3231 | 0.2314 | 0.3587 | | 1.1677 | 33.0 | 3531 | 1.4201 | 0.2164 | 0.4494 | 0.1867 | 0.0566 | 0.1779 | 0.3404 | 0.2327 | 0.3895 | 0.4036 | 0.1341 | 0.3431 | 0.5815 | 0.4834 | 0.6685 | 0.1661 | 0.3861 | 0.1583 | 0.3362 | 0.0474 | 0.2769 | 0.2266 | 0.3502 | | 1.1419 | 34.0 | 3638 | 1.4068 | 0.2188 | 0.4421 | 0.1864 | 0.0565 | 0.1688 | 0.3454 | 0.2314 | 0.3822 | 0.396 | 0.1336 | 0.3287 | 0.5702 | 0.5032 | 0.6599 | 0.1144 | 0.3253 | 0.157 | 0.3799 | 0.066 | 0.2723 | 0.2536 | 0.3427 | | 1.1598 | 35.0 | 3745 | 1.4241 | 0.2107 | 0.4404 | 0.1806 | 0.0513 | 0.1618 | 0.3457 | 0.2361 | 0.3867 | 0.4023 | 0.1441 | 0.326 | 0.5865 | 0.4877 | 0.6604 | 0.1439 | 0.3557 | 0.1516 | 0.383 | 0.0728 | 0.3092 | 0.1975 | 0.3031 | | 1.1291 | 36.0 | 3852 | 1.4203 | 0.2222 | 0.4631 | 0.1865 | 0.066 | 0.1776 | 0.3377 | 0.2356 | 0.3772 | 0.3887 | 0.1168 | 0.3203 | 0.5732 | 0.505 | 0.6644 | 0.1357 | 0.3215 | 0.1785 | 0.3723 | 0.0542 | 0.2446 | 0.2373 | 0.3404 | | 1.096 | 37.0 | 3959 | 1.3647 | 0.2364 | 0.4779 | 0.1936 | 0.0782 | 0.1885 | 0.3579 | 0.2595 | 0.4158 | 0.4281 | 0.1397 | 0.3684 | 0.6116 | 0.5178 | 0.6649 | 0.174 | 0.4127 | 0.1687 | 0.3705 | 0.0803 | 0.3523 | 0.241 | 0.34 | | 1.0876 | 38.0 | 4066 | 1.3592 | 0.2274 | 0.4462 | 0.1904 | 0.0677 | 0.1866 | 0.3538 | 0.2517 | 0.4023 | 0.4187 | 0.1562 | 0.3569 | 0.5983 | 0.4942 | 0.6554 | 0.1468 | 0.3772 | 0.1491 | 0.3781 | 0.0961 | 0.3246 | 0.2509 | 0.3582 | | 1.075 | 39.0 | 4173 | 1.3624 | 0.237 | 0.482 | 0.1985 | 0.0592 | 0.1942 | 0.3643 | 0.2539 | 0.4113 | 0.4271 | 0.1483 | 0.3677 | 0.6145 | 0.5251 | 0.6689 | 0.2008 | 0.4468 | 0.1737 | 0.3759 | 0.0632 | 0.3108 | 0.2222 | 0.3333 | | 1.0633 | 40.0 | 4280 | 1.3988 | 0.2331 | 0.4787 | 0.2002 | 0.0776 | 0.1857 | 0.3435 | 0.2543 | 0.4143 | 0.429 | 0.1688 | 0.3526 | 0.6167 | 0.5078 | 0.6689 | 0.1643 | 0.4063 | 0.163 | 0.3415 | 0.0704 | 0.36 | 0.2599 | 0.3684 | | 1.0683 | 41.0 | 4387 | 1.3223 | 0.2351 | 0.4708 | 0.2088 | 0.0783 | 0.1803 | 0.3628 | 0.2589 | 0.4306 | 0.4437 | 0.1782 | 0.3797 | 0.6223 | 0.5129 | 0.6523 | 0.1562 | 0.4595 | 0.1643 | 0.3817 | 0.0694 | 0.3431 | 0.2727 | 0.3818 | | 1.0511 | 42.0 | 4494 | 1.3158 | 0.2453 | 0.4814 | 0.2198 | 0.0672 | 0.1869 | 0.3895 | 0.2569 | 0.4248 | 0.4392 | 0.1584 | 0.3756 | 0.6266 | 0.5327 | 0.673 | 0.1771 | 0.4456 | 0.1861 | 0.3888 | 0.0701 | 0.3246 | 0.2603 | 0.364 | | 1.0551 | 43.0 | 4601 | 1.3500 | 0.2295 | 0.479 | 0.2007 | 0.0772 | 0.1804 | 0.3539 | 0.2472 | 0.3923 | 0.4077 | 0.1766 | 0.3437 | 0.5737 | 0.4986 | 0.6446 | 0.1586 | 0.3696 | 0.1691 | 0.3705 | 0.0699 | 0.3015 | 0.2511 | 0.352 | | 1.0341 | 44.0 | 4708 | 1.3675 | 0.2456 | 0.4914 | 0.2131 | 0.0711 | 0.1904 | 0.3756 | 0.255 | 0.4115 | 0.425 | 0.1642 | 0.3599 | 0.6005 | 0.5271 | 0.6644 | 0.1833 | 0.4278 | 0.1683 | 0.3536 | 0.0662 | 0.2969 | 0.2829 | 0.3822 | | 1.0243 | 45.0 | 4815 | 1.3230 | 0.2437 | 0.4966 | 0.207 | 0.0669 | 0.1826 | 0.3743 | 0.2617 | 0.4168 | 0.4305 | 0.1695 | 0.3629 | 0.5994 | 0.5194 | 0.6586 | 0.1745 | 0.4152 | 0.1893 | 0.3795 | 0.0703 | 0.3308 | 0.265 | 0.3684 | | 1.0241 | 46.0 | 4922 | 1.3187 | 0.2588 | 0.5071 | 0.2314 | 0.0786 | 0.1978 | 0.4126 | 0.2605 | 0.4227 | 0.4347 | 0.1652 | 0.3725 | 0.6235 | 0.5458 | 0.6644 | 0.1982 | 0.4278 | 0.1938 | 0.3625 | 0.0753 | 0.3262 | 0.2808 | 0.3924 | | 1.0048 | 47.0 | 5029 | 1.3505 | 0.2531 | 0.5007 | 0.2184 | 0.0709 | 0.2029 | 0.3913 | 0.2573 | 0.4229 | 0.4368 | 0.1606 | 0.3813 | 0.6183 | 0.5414 | 0.6604 | 0.192 | 0.4278 | 0.1871 | 0.3768 | 0.0701 | 0.34 | 0.2748 | 0.3791 | | 0.9981 | 48.0 | 5136 | 1.3362 | 0.2565 | 0.5238 | 0.212 | 0.0778 | 0.2031 | 0.407 | 0.2666 | 0.4311 | 0.4462 | 0.1734 | 0.3905 | 0.6217 | 0.5228 | 0.6622 | 0.1931 | 0.4316 | 0.2016 | 0.3848 | 0.094 | 0.3677 | 0.2708 | 0.3844 | | 1.0127 | 49.0 | 5243 | 1.3352 | 0.2625 | 0.5179 | 0.2331 | 0.0792 | 0.2182 | 0.3988 | 0.2685 | 0.4368 | 0.4503 | 0.1771 | 0.397 | 0.6254 | 0.5292 | 0.6514 | 0.2139 | 0.4646 | 0.1983 | 0.3772 | 0.0746 | 0.3692 | 0.2966 | 0.3889 | | 0.9859 | 50.0 | 5350 | 1.3692 | 0.2409 | 0.5163 | 0.1868 | 0.0749 | 0.1902 | 0.3812 | 0.2533 | 0.4147 | 0.4263 | 0.1627 | 0.3588 | 0.6132 | 0.5044 | 0.6459 | 0.206 | 0.4506 | 0.1907 | 0.3723 | 0.0675 | 0.3292 | 0.2358 | 0.3333 | | 1.0001 | 51.0 | 5457 | 1.3070 | 0.2558 | 0.5255 | 0.2112 | 0.0744 | 0.2043 | 0.4002 | 0.2606 | 0.4254 | 0.4382 | 0.202 | 0.3623 | 0.6226 | 0.5164 | 0.6477 | 0.1989 | 0.4253 | 0.1925 | 0.4098 | 0.0936 | 0.3477 | 0.2777 | 0.3604 | | 0.9725 | 52.0 | 5564 | 1.3240 | 0.2516 | 0.5075 | 0.2051 | 0.0853 | 0.2073 | 0.3728 | 0.2582 | 0.4193 | 0.4324 | 0.2053 | 0.3656 | 0.5998 | 0.533 | 0.6505 | 0.1893 | 0.4038 | 0.1737 | 0.3915 | 0.0938 | 0.34 | 0.2681 | 0.3764 | | 0.9618 | 53.0 | 5671 | 1.3466 | 0.2592 | 0.5248 | 0.2268 | 0.088 | 0.2087 | 0.3949 | 0.2596 | 0.4196 | 0.4346 | 0.1842 | 0.3713 | 0.61 | 0.5231 | 0.6568 | 0.202 | 0.4038 | 0.1989 | 0.3879 | 0.1008 | 0.36 | 0.2713 | 0.3644 | | 0.9775 | 54.0 | 5778 | 1.3195 | 0.2684 | 0.5322 | 0.2327 | 0.0851 | 0.2242 | 0.411 | 0.2726 | 0.4355 | 0.4464 | 0.1777 | 0.3968 | 0.6122 | 0.5223 | 0.6532 | 0.2329 | 0.4506 | 0.2149 | 0.404 | 0.1117 | 0.3692 | 0.2599 | 0.3551 | | 0.9391 | 55.0 | 5885 | 1.3204 | 0.2688 | 0.5417 | 0.2249 | 0.0816 | 0.2112 | 0.4168 | 0.2738 | 0.4409 | 0.4507 | 0.1725 | 0.3875 | 0.6407 | 0.5387 | 0.664 | 0.2201 | 0.4734 | 0.2148 | 0.3987 | 0.0962 | 0.3477 | 0.2743 | 0.3698 | | 0.9541 | 56.0 | 5992 | 1.2930 | 0.2616 | 0.5317 | 0.2214 | 0.0889 | 0.2025 | 0.4198 | 0.2653 | 0.4307 | 0.4439 | 0.1817 | 0.3764 | 0.6269 | 0.5406 | 0.6617 | 0.1994 | 0.4405 | 0.2144 | 0.4138 | 0.0954 | 0.3492 | 0.2581 | 0.3542 | | 0.9568 | 57.0 | 6099 | 1.2989 | 0.2688 | 0.5365 | 0.2288 | 0.089 | 0.2143 | 0.4042 | 0.2656 | 0.4275 | 0.443 | 0.1895 | 0.3806 | 0.6086 | 0.543 | 0.6604 | 0.2119 | 0.4316 | 0.2265 | 0.4161 | 0.1127 | 0.3508 | 0.2499 | 0.356 | | 0.9645 | 58.0 | 6206 | 1.3244 | 0.2699 | 0.5519 | 0.2355 | 0.0917 | 0.2067 | 0.4132 | 0.2753 | 0.4351 | 0.446 | 0.1724 | 0.3728 | 0.6313 | 0.5372 | 0.6518 | 0.2168 | 0.457 | 0.217 | 0.3964 | 0.1166 | 0.3615 | 0.2618 | 0.3631 | | 0.9285 | 59.0 | 6313 | 1.3308 | 0.2661 | 0.5385 | 0.2281 | 0.0796 | 0.2149 | 0.4029 | 0.2671 | 0.4376 | 0.4493 | 0.1661 | 0.3847 | 0.6328 | 0.5365 | 0.6536 | 0.2171 | 0.4506 | 0.2137 | 0.3946 | 0.1008 | 0.38 | 0.2622 | 0.3676 | | 0.9151 | 60.0 | 6420 | 1.3176 | 0.2749 | 0.5582 | 0.2233 | 0.0797 | 0.2237 | 0.4157 | 0.2752 | 0.4417 | 0.4556 | 0.1726 | 0.3899 | 0.6438 | 0.5504 | 0.6649 | 0.2197 | 0.4443 | 0.2224 | 0.4058 | 0.1294 | 0.4046 | 0.2524 | 0.3582 | | 0.9231 | 61.0 | 6527 | 1.3251 | 0.2736 | 0.5457 | 0.2328 | 0.0858 | 0.2211 | 0.4141 | 0.28 | 0.4476 | 0.4649 | 0.1793 | 0.4134 | 0.6428 | 0.5545 | 0.6797 | 0.2151 | 0.4835 | 0.2106 | 0.3853 | 0.1338 | 0.4046 | 0.254 | 0.3711 | | 0.9036 | 62.0 | 6634 | 1.3277 | 0.2707 | 0.5603 | 0.2283 | 0.0871 | 0.2209 | 0.4124 | 0.2692 | 0.4346 | 0.4524 | 0.1708 | 0.3979 | 0.6312 | 0.5524 | 0.6698 | 0.24 | 0.4696 | 0.1991 | 0.4134 | 0.1045 | 0.3415 | 0.2574 | 0.3676 | | 0.9324 | 63.0 | 6741 | 1.3008 | 0.2719 | 0.5527 | 0.2376 | 0.0811 | 0.2206 | 0.4372 | 0.2749 | 0.4544 | 0.471 | 0.2098 | 0.4175 | 0.6394 | 0.5352 | 0.6653 | 0.2224 | 0.5076 | 0.2045 | 0.4103 | 0.1294 | 0.3985 | 0.2681 | 0.3733 | | 0.9173 | 64.0 | 6848 | 1.3151 | 0.2771 | 0.5587 | 0.2383 | 0.085 | 0.2308 | 0.4134 | 0.2692 | 0.4427 | 0.4583 | 0.1829 | 0.4031 | 0.6247 | 0.5393 | 0.6599 | 0.2378 | 0.4911 | 0.2174 | 0.4054 | 0.1284 | 0.3692 | 0.2626 | 0.3658 | | 0.8888 | 65.0 | 6955 | 1.3025 | 0.2699 | 0.5572 | 0.2266 | 0.0791 | 0.2175 | 0.4154 | 0.2734 | 0.4414 | 0.4628 | 0.1806 | 0.4118 | 0.6332 | 0.5383 | 0.6694 | 0.2183 | 0.481 | 0.2194 | 0.4067 | 0.1118 | 0.3754 | 0.2616 | 0.3813 | | 0.9065 | 66.0 | 7062 | 1.2758 | 0.2802 | 0.5637 | 0.2433 | 0.0902 | 0.2236 | 0.4358 | 0.2789 | 0.4549 | 0.4706 | 0.1955 | 0.4238 | 0.6349 | 0.5384 | 0.6658 | 0.2309 | 0.481 | 0.2173 | 0.4036 | 0.1419 | 0.4231 | 0.2726 | 0.3796 | | 0.897 | 67.0 | 7169 | 1.3021 | 0.2805 | 0.5637 | 0.2403 | 0.0809 | 0.2307 | 0.4264 | 0.2737 | 0.4464 | 0.4641 | 0.1876 | 0.4117 | 0.6413 | 0.5409 | 0.6626 | 0.2351 | 0.4797 | 0.2338 | 0.4201 | 0.1229 | 0.3754 | 0.2697 | 0.3827 | | 0.891 | 68.0 | 7276 | 1.2872 | 0.2814 | 0.5506 | 0.2468 | 0.0858 | 0.2227 | 0.4234 | 0.2822 | 0.4526 | 0.4707 | 0.2078 | 0.411 | 0.6428 | 0.5462 | 0.6698 | 0.2382 | 0.4759 | 0.2301 | 0.4187 | 0.1228 | 0.4123 | 0.2695 | 0.3769 | | 0.8814 | 69.0 | 7383 | 1.3457 | 0.2767 | 0.5416 | 0.2428 | 0.0826 | 0.2218 | 0.4196 | 0.2723 | 0.4518 | 0.4679 | 0.19 | 0.4114 | 0.6432 | 0.54 | 0.6671 | 0.2364 | 0.4987 | 0.2268 | 0.4009 | 0.0994 | 0.3908 | 0.281 | 0.3822 | | 0.8809 | 70.0 | 7490 | 1.2750 | 0.2746 | 0.5531 | 0.2313 | 0.0862 | 0.2193 | 0.4354 | 0.2746 | 0.454 | 0.4707 | 0.2008 | 0.4142 | 0.6397 | 0.5393 | 0.6739 | 0.2295 | 0.4962 | 0.2255 | 0.4125 | 0.1085 | 0.3831 | 0.2701 | 0.388 | | 0.8715 | 71.0 | 7597 | 1.2738 | 0.2859 | 0.5705 | 0.2399 | 0.0812 | 0.2312 | 0.4419 | 0.28 | 0.4552 | 0.4697 | 0.1821 | 0.4226 | 0.6393 | 0.5552 | 0.6829 | 0.2552 | 0.4962 | 0.2122 | 0.3848 | 0.1366 | 0.3954 | 0.2705 | 0.3893 | | 0.8582 | 72.0 | 7704 | 1.2803 | 0.2854 | 0.5632 | 0.2472 | 0.0868 | 0.2308 | 0.4345 | 0.2814 | 0.4576 | 0.471 | 0.2112 | 0.4218 | 0.639 | 0.5483 | 0.6689 | 0.2621 | 0.5 | 0.2144 | 0.3969 | 0.125 | 0.3938 | 0.2772 | 0.3956 | | 0.8798 | 73.0 | 7811 | 1.2991 | 0.2921 | 0.5724 | 0.2629 | 0.0801 | 0.2378 | 0.4484 | 0.291 | 0.4619 | 0.4757 | 0.1914 | 0.4178 | 0.6572 | 0.5481 | 0.6721 | 0.265 | 0.4937 | 0.2187 | 0.3969 | 0.1445 | 0.4231 | 0.2841 | 0.3929 | | 0.8687 | 74.0 | 7918 | 1.2795 | 0.2751 | 0.5415 | 0.2449 | 0.0743 | 0.2224 | 0.433 | 0.2813 | 0.4525 | 0.4716 | 0.1991 | 0.4103 | 0.6554 | 0.5447 | 0.6788 | 0.2197 | 0.4886 | 0.2193 | 0.4009 | 0.1251 | 0.4062 | 0.2668 | 0.3836 | | 0.8579 | 75.0 | 8025 | 1.2965 | 0.2827 | 0.5554 | 0.2457 | 0.0834 | 0.2274 | 0.439 | 0.2805 | 0.4568 | 0.4697 | 0.1736 | 0.4164 | 0.6491 | 0.5527 | 0.6739 | 0.2374 | 0.4772 | 0.2244 | 0.4022 | 0.1261 | 0.4154 | 0.2728 | 0.38 | | 0.8444 | 76.0 | 8132 | 1.2692 | 0.286 | 0.5675 | 0.2456 | 0.0845 | 0.2298 | 0.452 | 0.2844 | 0.4569 | 0.4701 | 0.18 | 0.4201 | 0.6516 | 0.5577 | 0.6716 | 0.2472 | 0.4759 | 0.2247 | 0.4085 | 0.1367 | 0.4154 | 0.2637 | 0.3791 | | 0.8655 | 77.0 | 8239 | 1.2678 | 0.2914 | 0.5743 | 0.2529 | 0.0802 | 0.2412 | 0.4548 | 0.2854 | 0.4584 | 0.4711 | 0.1862 | 0.42 | 0.6467 | 0.5584 | 0.6725 | 0.2484 | 0.4899 | 0.2155 | 0.4027 | 0.1618 | 0.4015 | 0.2731 | 0.3889 | | 0.8424 | 78.0 | 8346 | 1.2859 | 0.2871 | 0.5697 | 0.2433 | 0.0843 | 0.2281 | 0.4464 | 0.2792 | 0.4522 | 0.4682 | 0.1924 | 0.4191 | 0.6409 | 0.5575 | 0.6739 | 0.2389 | 0.4797 | 0.2161 | 0.3964 | 0.1444 | 0.4 | 0.2787 | 0.3911 | | 0.8373 | 79.0 | 8453 | 1.2665 | 0.2952 | 0.5753 | 0.2589 | 0.0917 | 0.2446 | 0.4617 | 0.2813 | 0.4646 | 0.4779 | 0.2011 | 0.4253 | 0.6561 | 0.5594 | 0.6761 | 0.2481 | 0.4962 | 0.2305 | 0.417 | 0.1652 | 0.4062 | 0.2727 | 0.3942 | | 0.841 | 80.0 | 8560 | 1.2720 | 0.2872 | 0.5588 | 0.2596 | 0.07 | 0.2247 | 0.4592 | 0.2784 | 0.4556 | 0.4691 | 0.1936 | 0.403 | 0.6516 | 0.557 | 0.6779 | 0.242 | 0.5025 | 0.2246 | 0.3929 | 0.1446 | 0.3908 | 0.268 | 0.3813 | | 0.8207 | 81.0 | 8667 | 1.2764 | 0.2914 | 0.5691 | 0.2633 | 0.0891 | 0.2287 | 0.4633 | 0.285 | 0.4633 | 0.4752 | 0.2079 | 0.4133 | 0.6549 | 0.5568 | 0.6712 | 0.2442 | 0.5266 | 0.2274 | 0.3924 | 0.1589 | 0.4092 | 0.2697 | 0.3764 | | 0.8151 | 82.0 | 8774 | 1.2726 | 0.292 | 0.5664 | 0.2575 | 0.0899 | 0.2383 | 0.4532 | 0.2838 | 0.4575 | 0.4703 | 0.2029 | 0.4171 | 0.6444 | 0.5498 | 0.6734 | 0.2589 | 0.4949 | 0.2227 | 0.3969 | 0.1539 | 0.3954 | 0.2746 | 0.3911 | | 0.8118 | 83.0 | 8881 | 1.2791 | 0.2909 | 0.5647 | 0.2645 | 0.0803 | 0.2349 | 0.4543 | 0.2866 | 0.4635 | 0.477 | 0.206 | 0.4167 | 0.659 | 0.554 | 0.673 | 0.2542 | 0.5203 | 0.2257 | 0.4045 | 0.1511 | 0.4 | 0.2695 | 0.3871 | | 0.8101 | 84.0 | 8988 | 1.2793 | 0.2971 | 0.579 | 0.2669 | 0.0869 | 0.2459 | 0.4703 | 0.2877 | 0.4546 | 0.4646 | 0.1792 | 0.4059 | 0.6583 | 0.5589 | 0.6797 | 0.2452 | 0.4696 | 0.2401 | 0.4107 | 0.1757 | 0.3862 | 0.2656 | 0.3769 | | 0.8002 | 85.0 | 9095 | 1.2649 | 0.2916 | 0.5718 | 0.2551 | 0.0885 | 0.2432 | 0.4412 | 0.2867 | 0.4527 | 0.4686 | 0.1907 | 0.4215 | 0.6414 | 0.5598 | 0.6824 | 0.2361 | 0.4823 | 0.2377 | 0.4134 | 0.1537 | 0.38 | 0.2708 | 0.3849 | | 0.8174 | 86.0 | 9202 | 1.2749 | 0.2965 | 0.5785 | 0.2577 | 0.0941 | 0.238 | 0.4623 | 0.2907 | 0.457 | 0.4704 | 0.1919 | 0.4187 | 0.6478 | 0.5581 | 0.6829 | 0.2565 | 0.4886 | 0.2404 | 0.4138 | 0.157 | 0.3815 | 0.2704 | 0.3849 | | 0.8068 | 87.0 | 9309 | 1.2789 | 0.2965 | 0.5781 | 0.2649 | 0.0934 | 0.2408 | 0.4661 | 0.2908 | 0.4632 | 0.4755 | 0.2036 | 0.4241 | 0.6541 | 0.5563 | 0.6793 | 0.252 | 0.4975 | 0.2397 | 0.4165 | 0.1639 | 0.4015 | 0.2704 | 0.3827 | | 0.8127 | 88.0 | 9416 | 1.2787 | 0.304 | 0.5921 | 0.2676 | 0.0994 | 0.2394 | 0.4855 | 0.2914 | 0.4612 | 0.4722 | 0.2184 | 0.4099 | 0.6616 | 0.5532 | 0.6716 | 0.273 | 0.4962 | 0.2379 | 0.4058 | 0.1739 | 0.3954 | 0.2821 | 0.392 | | 0.7997 | 89.0 | 9523 | 1.2658 | 0.3001 | 0.5766 | 0.2665 | 0.0946 | 0.2411 | 0.4831 | 0.288 | 0.4546 | 0.4652 | 0.1939 | 0.4102 | 0.6501 | 0.5544 | 0.6703 | 0.2613 | 0.4785 | 0.2433 | 0.4103 | 0.1727 | 0.3862 | 0.2685 | 0.3809 | | 0.8024 | 90.0 | 9630 | 1.2593 | 0.3068 | 0.5908 | 0.2714 | 0.0915 | 0.2519 | 0.4812 | 0.2898 | 0.464 | 0.4767 | 0.2179 | 0.4211 | 0.6596 | 0.5597 | 0.6784 | 0.2731 | 0.5038 | 0.2445 | 0.4143 | 0.1755 | 0.3954 | 0.2813 | 0.3916 | | 0.7874 | 91.0 | 9737 | 1.2550 | 0.3075 | 0.5939 | 0.2726 | 0.0901 | 0.256 | 0.4814 | 0.2923 | 0.4638 | 0.4769 | 0.2131 | 0.4226 | 0.6615 | 0.5592 | 0.6757 | 0.2796 | 0.5101 | 0.2407 | 0.4098 | 0.1739 | 0.3954 | 0.284 | 0.3933 | | 0.7839 | 92.0 | 9844 | 1.2722 | 0.305 | 0.5851 | 0.2756 | 0.0861 | 0.2542 | 0.4784 | 0.2901 | 0.4597 | 0.4779 | 0.1932 | 0.4302 | 0.6527 | 0.5611 | 0.6779 | 0.2631 | 0.5051 | 0.2454 | 0.408 | 0.1728 | 0.4 | 0.2828 | 0.3987 | | 0.7865 | 93.0 | 9951 | 1.2689 | 0.3044 | 0.5847 | 0.2748 | 0.0853 | 0.2531 | 0.4763 | 0.2897 | 0.4636 | 0.4764 | 0.1984 | 0.4191 | 0.6621 | 0.561 | 0.6784 | 0.2708 | 0.5 | 0.2446 | 0.4125 | 0.1603 | 0.3892 | 0.2856 | 0.4018 | | 0.7676 | 94.0 | 10058 | 1.2595 | 0.3073 | 0.5925 | 0.2782 | 0.0846 | 0.2547 | 0.4834 | 0.2948 | 0.4629 | 0.4746 | 0.1864 | 0.4242 | 0.6547 | 0.5625 | 0.6757 | 0.2772 | 0.5114 | 0.2458 | 0.4085 | 0.1709 | 0.3815 | 0.2802 | 0.396 | | 0.7873 | 95.0 | 10165 | 1.2731 | 0.3075 | 0.5954 | 0.2752 | 0.085 | 0.2526 | 0.4841 | 0.2921 | 0.4613 | 0.4736 | 0.1966 | 0.4234 | 0.6534 | 0.5582 | 0.6721 | 0.2776 | 0.5063 | 0.245 | 0.404 | 0.1738 | 0.3862 | 0.2831 | 0.3996 | | 0.7912 | 96.0 | 10272 | 1.2655 | 0.3077 | 0.5965 | 0.2658 | 0.0871 | 0.2541 | 0.4834 | 0.2928 | 0.4656 | 0.4784 | 0.2007 | 0.4261 | 0.659 | 0.5578 | 0.6703 | 0.2803 | 0.5241 | 0.2425 | 0.4116 | 0.1728 | 0.3862 | 0.2851 | 0.4 | | 0.7586 | 97.0 | 10379 | 1.2672 | 0.3099 | 0.6012 | 0.2733 | 0.0839 | 0.2545 | 0.4886 | 0.2937 | 0.4665 | 0.479 | 0.1899 | 0.429 | 0.6617 | 0.5596 | 0.677 | 0.2901 | 0.5278 | 0.2436 | 0.4098 | 0.1694 | 0.3831 | 0.2869 | 0.3973 | | 0.7833 | 98.0 | 10486 | 1.2673 | 0.3092 | 0.6021 | 0.2687 | 0.0887 | 0.2519 | 0.4851 | 0.2938 | 0.4657 | 0.4792 | 0.1963 | 0.4315 | 0.6522 | 0.5617 | 0.6775 | 0.2847 | 0.5304 | 0.2454 | 0.4125 | 0.1726 | 0.3815 | 0.2818 | 0.3942 | | 0.7676 | 99.0 | 10593 | 1.2649 | 0.3089 | 0.594 | 0.2724 | 0.0895 | 0.2514 | 0.4833 | 0.2947 | 0.4666 | 0.4791 | 0.1832 | 0.4304 | 0.6531 | 0.5616 | 0.6779 | 0.2868 | 0.5278 | 0.246 | 0.4156 | 0.1689 | 0.3785 | 0.2811 | 0.3956 | | 0.7743 | 100.0 | 10700 | 1.2634 | 0.3099 | 0.596 | 0.2729 | 0.0887 | 0.2527 | 0.4839 | 0.2938 | 0.4679 | 0.4801 | 0.1859 | 0.4322 | 0.6546 | 0.5624 | 0.6788 | 0.287 | 0.5304 | 0.2456 | 0.4116 | 0.17 | 0.3815 | 0.2843 | 0.3982 | ### Framework versions - Transformers 4.42.0.dev0 - Pytorch 2.3.0+cu118 - Datasets 2.19.2 - Tokenizers 0.19.1