--- license: apache-2.0 base_model: facebook/detr-resnet-50 tags: - object-detection - vision - generated_from_trainer model-index: - name: facebook-detr-resnet-50-finetuned-10k-cppe5-manual-pad-repro results: [] --- [Visualize in Weights & Biases](https://wandb.ai/qubvel-hf-co/transformers-detection-model-finetuning-cppe5/runs/y96s266q) # facebook-detr-resnet-50-finetuned-10k-cppe5-manual-pad-repro This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset. It achieves the following results on the evaluation set: - Loss: 1.3283 - Map: 0.2947 - Map 50: 0.5809 - Map 75: 0.2681 - Map Small: 0.1583 - Map Medium: 0.23 - Map Large: 0.4971 - Mar 1: 0.2972 - Mar 10: 0.4633 - Mar 100: 0.4771 - Mar Small: 0.2237 - Mar Medium: 0.4317 - Mar Large: 0.7008 - Map Coverall: 0.5445 - Mar 100 Coverall: 0.6829 - Map Face Shield: 0.2753 - Mar 100 Face Shield: 0.4937 - Map Gloves: 0.2028 - Mar 100 Gloves: 0.4098 - Map Goggles: 0.151 - Mar 100 Goggles: 0.3938 - Map Mask: 0.3002 - Mar 100 Mask: 0.4053 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 1337 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:| | 2.7248 | 1.0 | 107 | 2.6074 | 0.0142 | 0.0396 | 0.0076 | 0.0039 | 0.0015 | 0.0139 | 0.0281 | 0.085 | 0.1226 | 0.0401 | 0.0831 | 0.1324 | 0.0625 | 0.3068 | 0.0 | 0.0 | 0.0024 | 0.1589 | 0.0 | 0.0 | 0.0061 | 0.1476 | | 2.3311 | 2.0 | 214 | 2.3317 | 0.0296 | 0.0744 | 0.019 | 0.007 | 0.0084 | 0.0291 | 0.0548 | 0.1307 | 0.1676 | 0.0627 | 0.1019 | 0.1817 | 0.1282 | 0.4536 | 0.0 | 0.0 | 0.0076 | 0.1777 | 0.0 | 0.0 | 0.0119 | 0.2067 | | 2.1268 | 3.0 | 321 | 2.2497 | 0.0259 | 0.0601 | 0.0189 | 0.0075 | 0.0188 | 0.0236 | 0.0516 | 0.1358 | 0.183 | 0.053 | 0.1058 | 0.2174 | 0.1028 | 0.5477 | 0.0 | 0.0 | 0.0056 | 0.175 | 0.0 | 0.0 | 0.0209 | 0.1924 | | 1.9337 | 4.0 | 428 | 2.0126 | 0.0464 | 0.1088 | 0.0338 | 0.0173 | 0.0202 | 0.0392 | 0.0779 | 0.1704 | 0.2113 | 0.0536 | 0.1312 | 0.2662 | 0.166 | 0.5896 | 0.0 | 0.0 | 0.0117 | 0.2121 | 0.0 | 0.0 | 0.0543 | 0.2547 | | 1.7712 | 5.0 | 535 | 1.9681 | 0.0654 | 0.1458 | 0.0466 | 0.0205 | 0.037 | 0.0593 | 0.0942 | 0.1996 | 0.236 | 0.0773 | 0.1439 | 0.3188 | 0.2289 | 0.6279 | 0.0026 | 0.0367 | 0.0318 | 0.2286 | 0.0 | 0.0 | 0.0636 | 0.2867 | | 1.6867 | 6.0 | 642 | 1.9592 | 0.0736 | 0.1771 | 0.0487 | 0.0041 | 0.0415 | 0.1024 | 0.094 | 0.1794 | 0.2144 | 0.0524 | 0.1234 | 0.3006 | 0.2756 | 0.5964 | 0.0057 | 0.0342 | 0.0178 | 0.2353 | 0.0 | 0.0 | 0.0688 | 0.2062 | | 1.6342 | 7.0 | 749 | 1.8956 | 0.0829 | 0.172 | 0.0727 | 0.0108 | 0.0426 | 0.131 | 0.1135 | 0.2153 | 0.2315 | 0.0463 | 0.1354 | 0.3658 | 0.2921 | 0.5892 | 0.0143 | 0.0873 | 0.0306 | 0.1817 | 0.002 | 0.0077 | 0.0758 | 0.2916 | | 1.6003 | 8.0 | 856 | 1.7564 | 0.1105 | 0.2502 | 0.0854 | 0.0256 | 0.0815 | 0.1467 | 0.1344 | 0.2559 | 0.2844 | 0.074 | 0.2137 | 0.4119 | 0.3628 | 0.6252 | 0.0492 | 0.1987 | 0.036 | 0.2688 | 0.0009 | 0.0262 | 0.1035 | 0.3031 | | 1.5536 | 9.0 | 963 | 1.8190 | 0.1043 | 0.2518 | 0.0728 | 0.0168 | 0.0669 | 0.1254 | 0.1301 | 0.2492 | 0.268 | 0.0637 | 0.1812 | 0.4043 | 0.3236 | 0.5775 | 0.0381 | 0.1823 | 0.043 | 0.2424 | 0.0011 | 0.0569 | 0.1158 | 0.2809 | | 1.5082 | 10.0 | 1070 | 1.7315 | 0.1314 | 0.2986 | 0.1032 | 0.0233 | 0.0862 | 0.1886 | 0.1654 | 0.2975 | 0.3201 | 0.062 | 0.2453 | 0.4825 | 0.3749 | 0.5991 | 0.0633 | 0.2696 | 0.0546 | 0.2728 | 0.0197 | 0.1569 | 0.1446 | 0.3022 | | 1.4375 | 11.0 | 1177 | 1.6288 | 0.1535 | 0.3396 | 0.1235 | 0.0308 | 0.1048 | 0.2523 | 0.1912 | 0.3504 | 0.3762 | 0.1132 | 0.281 | 0.5931 | 0.4365 | 0.65 | 0.0788 | 0.3456 | 0.0635 | 0.2848 | 0.02 | 0.2708 | 0.1687 | 0.3298 | | 1.4056 | 12.0 | 1284 | 1.6457 | 0.1394 | 0.3148 | 0.0984 | 0.0325 | 0.0954 | 0.2416 | 0.1685 | 0.3278 | 0.3516 | 0.0839 | 0.2689 | 0.5579 | 0.3979 | 0.6477 | 0.0657 | 0.2861 | 0.0692 | 0.2688 | 0.0096 | 0.2615 | 0.1546 | 0.2938 | | 1.424 | 13.0 | 1391 | 1.6102 | 0.1626 | 0.3626 | 0.1216 | 0.0531 | 0.1099 | 0.2685 | 0.1902 | 0.3443 | 0.3722 | 0.1117 | 0.299 | 0.5444 | 0.4262 | 0.6423 | 0.0721 | 0.3519 | 0.0749 | 0.283 | 0.0412 | 0.2585 | 0.1984 | 0.3253 | | 1.3553 | 14.0 | 1498 | 1.5945 | 0.1601 | 0.3462 | 0.1318 | 0.0314 | 0.1071 | 0.278 | 0.1977 | 0.3453 | 0.3659 | 0.1093 | 0.2915 | 0.5759 | 0.4558 | 0.6329 | 0.0692 | 0.3291 | 0.0696 | 0.2937 | 0.0229 | 0.2554 | 0.183 | 0.3182 | | 1.3127 | 15.0 | 1605 | 1.6288 | 0.165 | 0.3566 | 0.1315 | 0.0444 | 0.1033 | 0.287 | 0.1937 | 0.3491 | 0.3718 | 0.0778 | 0.2843 | 0.6119 | 0.4463 | 0.6383 | 0.0903 | 0.343 | 0.0818 | 0.3049 | 0.0277 | 0.2569 | 0.1791 | 0.316 | | 1.2941 | 16.0 | 1712 | 1.5854 | 0.1643 | 0.3635 | 0.1281 | 0.0533 | 0.1198 | 0.2617 | 0.2003 | 0.3668 | 0.3896 | 0.1619 | 0.3128 | 0.5948 | 0.439 | 0.641 | 0.1011 | 0.3886 | 0.0718 | 0.2973 | 0.0277 | 0.3123 | 0.1819 | 0.3089 | | 1.271 | 17.0 | 1819 | 1.5453 | 0.1645 | 0.3585 | 0.1352 | 0.069 | 0.1089 | 0.2721 | 0.2053 | 0.3563 | 0.3835 | 0.1498 | 0.3023 | 0.5795 | 0.4413 | 0.65 | 0.0907 | 0.3405 | 0.0652 | 0.2969 | 0.0292 | 0.3092 | 0.1963 | 0.3209 | | 1.2797 | 18.0 | 1926 | 1.4980 | 0.1828 | 0.3932 | 0.1529 | 0.0898 | 0.1312 | 0.3023 | 0.2189 | 0.3885 | 0.4139 | 0.2014 | 0.3349 | 0.6208 | 0.4426 | 0.6338 | 0.1163 | 0.4 | 0.085 | 0.3286 | 0.05 | 0.3585 | 0.2203 | 0.3489 | | 1.2202 | 19.0 | 2033 | 1.5525 | 0.1768 | 0.3837 | 0.1496 | 0.0654 | 0.1163 | 0.3329 | 0.2189 | 0.3765 | 0.4027 | 0.1528 | 0.3314 | 0.6205 | 0.4413 | 0.6171 | 0.1071 | 0.3975 | 0.0922 | 0.329 | 0.0324 | 0.3277 | 0.211 | 0.3422 | | 1.2601 | 20.0 | 2140 | 1.5374 | 0.1806 | 0.3936 | 0.1454 | 0.0636 | 0.1232 | 0.2955 | 0.2168 | 0.373 | 0.401 | 0.1507 | 0.3136 | 0.6096 | 0.4367 | 0.6324 | 0.1267 | 0.4101 | 0.0865 | 0.2737 | 0.0448 | 0.3446 | 0.2084 | 0.344 | | 1.2382 | 21.0 | 2247 | 1.5249 | 0.1687 | 0.3792 | 0.1313 | 0.0512 | 0.1189 | 0.3014 | 0.2056 | 0.3703 | 0.394 | 0.1416 | 0.3245 | 0.5803 | 0.4207 | 0.6266 | 0.0906 | 0.3886 | 0.073 | 0.3022 | 0.0526 | 0.3231 | 0.2066 | 0.3293 | | 1.1701 | 22.0 | 2354 | 1.5312 | 0.1891 | 0.4048 | 0.1572 | 0.0608 | 0.1315 | 0.3261 | 0.2291 | 0.3843 | 0.4069 | 0.135 | 0.3326 | 0.6264 | 0.4435 | 0.6234 | 0.1407 | 0.3684 | 0.0997 | 0.35 | 0.0451 | 0.3492 | 0.2168 | 0.3436 | | 1.1604 | 23.0 | 2461 | 1.4588 | 0.1924 | 0.4116 | 0.1591 | 0.0521 | 0.1244 | 0.3417 | 0.2199 | 0.3947 | 0.4099 | 0.1433 | 0.3346 | 0.6199 | 0.4795 | 0.6293 | 0.1222 | 0.381 | 0.0932 | 0.3335 | 0.0501 | 0.3508 | 0.2167 | 0.3551 | | 1.1605 | 24.0 | 2568 | 1.4838 | 0.1938 | 0.4038 | 0.159 | 0.0595 | 0.1262 | 0.3412 | 0.2126 | 0.3878 | 0.4032 | 0.153 | 0.3075 | 0.6215 | 0.4689 | 0.6419 | 0.1383 | 0.3848 | 0.1099 | 0.354 | 0.0458 | 0.3092 | 0.2061 | 0.3262 | | 1.1148 | 25.0 | 2675 | 1.4525 | 0.19 | 0.3952 | 0.1518 | 0.0459 | 0.1462 | 0.3308 | 0.2158 | 0.3855 | 0.4048 | 0.1365 | 0.3526 | 0.591 | 0.4618 | 0.6446 | 0.1184 | 0.4063 | 0.0995 | 0.35 | 0.0523 | 0.2862 | 0.218 | 0.3369 | | 1.1126 | 26.0 | 2782 | 1.4628 | 0.2043 | 0.4292 | 0.1697 | 0.0581 | 0.1509 | 0.3362 | 0.234 | 0.403 | 0.4236 | 0.1471 | 0.3592 | 0.6312 | 0.4892 | 0.6635 | 0.1204 | 0.3924 | 0.1185 | 0.3442 | 0.0491 | 0.3692 | 0.2444 | 0.3489 | | 1.1128 | 27.0 | 2889 | 1.4258 | 0.2041 | 0.4284 | 0.1715 | 0.0714 | 0.1429 | 0.3312 | 0.232 | 0.4125 | 0.4299 | 0.1504 | 0.3629 | 0.6398 | 0.4813 | 0.6635 | 0.1375 | 0.4392 | 0.1243 | 0.3491 | 0.0419 | 0.3292 | 0.2358 | 0.3684 | | 1.0908 | 28.0 | 2996 | 1.4615 | 0.2072 | 0.425 | 0.1828 | 0.0839 | 0.1465 | 0.3402 | 0.2404 | 0.3906 | 0.4027 | 0.1514 | 0.3253 | 0.6275 | 0.4933 | 0.6482 | 0.1083 | 0.3886 | 0.1146 | 0.3339 | 0.0681 | 0.2908 | 0.2517 | 0.352 | | 1.0785 | 29.0 | 3103 | 1.4452 | 0.195 | 0.4186 | 0.1581 | 0.0527 | 0.1553 | 0.3474 | 0.2285 | 0.3948 | 0.4135 | 0.1668 | 0.3468 | 0.6451 | 0.4759 | 0.6572 | 0.108 | 0.4152 | 0.1055 | 0.3357 | 0.0649 | 0.32 | 0.2207 | 0.3396 | | 1.0677 | 30.0 | 3210 | 1.4368 | 0.2105 | 0.4321 | 0.187 | 0.0744 | 0.1641 | 0.3346 | 0.243 | 0.4065 | 0.4272 | 0.1789 | 0.3693 | 0.6408 | 0.4924 | 0.6662 | 0.1364 | 0.4152 | 0.1271 | 0.3388 | 0.0754 | 0.3785 | 0.2213 | 0.3373 | | 1.0448 | 31.0 | 3317 | 1.4151 | 0.2115 | 0.436 | 0.1687 | 0.063 | 0.1549 | 0.3449 | 0.2306 | 0.4104 | 0.4299 | 0.1689 | 0.3668 | 0.6302 | 0.4999 | 0.6423 | 0.1308 | 0.4304 | 0.1373 | 0.3554 | 0.0478 | 0.3615 | 0.2418 | 0.36 | | 1.0656 | 32.0 | 3424 | 1.4272 | 0.2218 | 0.449 | 0.1816 | 0.0807 | 0.1638 | 0.3717 | 0.2564 | 0.4207 | 0.4405 | 0.1786 | 0.3802 | 0.6742 | 0.4992 | 0.6563 | 0.1638 | 0.4633 | 0.1285 | 0.35 | 0.0649 | 0.3631 | 0.2528 | 0.3698 | | 1.0345 | 33.0 | 3531 | 1.4501 | 0.2144 | 0.4477 | 0.174 | 0.0843 | 0.1471 | 0.3437 | 0.242 | 0.4054 | 0.43 | 0.1869 | 0.3499 | 0.6493 | 0.5021 | 0.645 | 0.1414 | 0.438 | 0.1352 | 0.3585 | 0.0702 | 0.3585 | 0.2233 | 0.3502 | | 1.0243 | 34.0 | 3638 | 1.3969 | 0.2248 | 0.4842 | 0.1808 | 0.0848 | 0.1805 | 0.371 | 0.2491 | 0.4226 | 0.4434 | 0.1466 | 0.405 | 0.6755 | 0.4944 | 0.6721 | 0.1569 | 0.4443 | 0.1482 | 0.3634 | 0.0832 | 0.3754 | 0.2412 | 0.3618 | | 1.0221 | 35.0 | 3745 | 1.4094 | 0.2203 | 0.4537 | 0.1956 | 0.0682 | 0.1655 | 0.3699 | 0.2469 | 0.4174 | 0.4359 | 0.1675 | 0.3785 | 0.6632 | 0.5107 | 0.6613 | 0.1535 | 0.4405 | 0.1419 | 0.3705 | 0.0566 | 0.3462 | 0.239 | 0.3609 | | 0.99 | 36.0 | 3852 | 1.3827 | 0.2092 | 0.4456 | 0.1798 | 0.0706 | 0.1619 | 0.3708 | 0.2594 | 0.4185 | 0.4385 | 0.1516 | 0.39 | 0.6637 | 0.4897 | 0.6536 | 0.1332 | 0.4165 | 0.154 | 0.3674 | 0.057 | 0.4031 | 0.2119 | 0.352 | | 0.9819 | 37.0 | 3959 | 1.4144 | 0.2298 | 0.4652 | 0.1873 | 0.0827 | 0.1817 | 0.3784 | 0.2504 | 0.4264 | 0.4448 | 0.1796 | 0.3827 | 0.68 | 0.5135 | 0.6743 | 0.1888 | 0.4392 | 0.1466 | 0.3714 | 0.0676 | 0.3769 | 0.2325 | 0.3622 | | 0.9652 | 38.0 | 4066 | 1.3730 | 0.2336 | 0.487 | 0.2047 | 0.0886 | 0.1914 | 0.3765 | 0.2472 | 0.4256 | 0.4448 | 0.1851 | 0.3925 | 0.6692 | 0.5115 | 0.6743 | 0.1967 | 0.4544 | 0.1575 | 0.3759 | 0.0675 | 0.3554 | 0.235 | 0.364 | | 0.9397 | 39.0 | 4173 | 1.3323 | 0.2396 | 0.4804 | 0.215 | 0.1072 | 0.1857 | 0.4298 | 0.2672 | 0.4452 | 0.4634 | 0.1984 | 0.3967 | 0.7004 | 0.5192 | 0.6806 | 0.1547 | 0.4785 | 0.1653 | 0.3848 | 0.1059 | 0.3908 | 0.2531 | 0.3822 | | 0.9346 | 40.0 | 4280 | 1.3810 | 0.2354 | 0.488 | 0.2112 | 0.1037 | 0.1849 | 0.4009 | 0.2623 | 0.4279 | 0.4404 | 0.1807 | 0.3652 | 0.6944 | 0.51 | 0.6788 | 0.1698 | 0.4456 | 0.1541 | 0.3509 | 0.098 | 0.3569 | 0.245 | 0.3698 | | 0.9575 | 41.0 | 4387 | 1.3592 | 0.2396 | 0.4808 | 0.2072 | 0.1173 | 0.2005 | 0.373 | 0.2488 | 0.4339 | 0.4533 | 0.2073 | 0.4023 | 0.6733 | 0.5255 | 0.6878 | 0.1735 | 0.4443 | 0.1591 | 0.383 | 0.1032 | 0.3862 | 0.2368 | 0.3653 | | 0.948 | 42.0 | 4494 | 1.3716 | 0.2295 | 0.4945 | 0.1711 | 0.0793 | 0.1755 | 0.3977 | 0.2508 | 0.4201 | 0.4391 | 0.1373 | 0.3812 | 0.6851 | 0.5015 | 0.6644 | 0.1825 | 0.4443 | 0.1456 | 0.3696 | 0.094 | 0.3662 | 0.2238 | 0.3511 | | 0.9254 | 43.0 | 4601 | 1.3677 | 0.238 | 0.4902 | 0.2091 | 0.1018 | 0.1861 | 0.4061 | 0.2651 | 0.4344 | 0.4542 | 0.1866 | 0.389 | 0.6789 | 0.5221 | 0.6968 | 0.1681 | 0.4481 | 0.1749 | 0.4013 | 0.0885 | 0.3677 | 0.2363 | 0.3569 | | 0.9162 | 44.0 | 4708 | 1.4004 | 0.2363 | 0.491 | 0.2079 | 0.0949 | 0.1897 | 0.394 | 0.2511 | 0.4205 | 0.4403 | 0.1717 | 0.391 | 0.6663 | 0.5106 | 0.6919 | 0.1837 | 0.4241 | 0.1573 | 0.3732 | 0.0733 | 0.3385 | 0.2566 | 0.3738 | | 0.9186 | 45.0 | 4815 | 1.3953 | 0.2378 | 0.4922 | 0.2211 | 0.1115 | 0.1843 | 0.3661 | 0.2527 | 0.4224 | 0.4439 | 0.2003 | 0.3923 | 0.6378 | 0.4989 | 0.6761 | 0.2 | 0.4418 | 0.1678 | 0.3821 | 0.0843 | 0.3677 | 0.238 | 0.3516 | | 0.9225 | 46.0 | 4922 | 1.3936 | 0.2395 | 0.5114 | 0.1973 | 0.1111 | 0.1805 | 0.405 | 0.2557 | 0.4384 | 0.4586 | 0.2039 | 0.3929 | 0.6808 | 0.4977 | 0.6716 | 0.1804 | 0.4595 | 0.1716 | 0.3933 | 0.0927 | 0.4062 | 0.2553 | 0.3622 | | 0.9011 | 47.0 | 5029 | 1.3632 | 0.2437 | 0.4962 | 0.2148 | 0.0766 | 0.1902 | 0.4155 | 0.2687 | 0.4318 | 0.452 | 0.1849 | 0.4063 | 0.6736 | 0.528 | 0.6703 | 0.1841 | 0.4696 | 0.1692 | 0.3772 | 0.0796 | 0.3754 | 0.2579 | 0.3676 | | 0.8909 | 48.0 | 5136 | 1.3843 | 0.2513 | 0.5148 | 0.211 | 0.1097 | 0.1896 | 0.4229 | 0.2602 | 0.427 | 0.4438 | 0.1835 | 0.3919 | 0.6837 | 0.5279 | 0.6649 | 0.1892 | 0.4165 | 0.168 | 0.3862 | 0.1023 | 0.3677 | 0.2692 | 0.384 | | 0.9073 | 49.0 | 5243 | 1.3763 | 0.2411 | 0.4936 | 0.208 | 0.1217 | 0.1832 | 0.4036 | 0.2703 | 0.4364 | 0.4507 | 0.2241 | 0.3758 | 0.6765 | 0.5104 | 0.6468 | 0.18 | 0.4747 | 0.1656 | 0.379 | 0.0975 | 0.3646 | 0.2522 | 0.3884 | | 0.8877 | 50.0 | 5350 | 1.3689 | 0.251 | 0.5232 | 0.2096 | 0.1109 | 0.1933 | 0.4366 | 0.2773 | 0.4407 | 0.4563 | 0.208 | 0.3948 | 0.7056 | 0.526 | 0.6712 | 0.1895 | 0.4532 | 0.1796 | 0.392 | 0.106 | 0.3831 | 0.254 | 0.3822 | | 0.8917 | 51.0 | 5457 | 1.3656 | 0.2506 | 0.51 | 0.202 | 0.1155 | 0.1989 | 0.4294 | 0.2728 | 0.4417 | 0.4633 | 0.2124 | 0.4163 | 0.6978 | 0.524 | 0.6797 | 0.1921 | 0.4519 | 0.1789 | 0.3924 | 0.0954 | 0.3954 | 0.2627 | 0.3969 | | 0.8844 | 52.0 | 5564 | 1.3813 | 0.249 | 0.5001 | 0.2201 | 0.0869 | 0.1916 | 0.4365 | 0.253 | 0.4423 | 0.4577 | 0.2158 | 0.3852 | 0.696 | 0.5307 | 0.6829 | 0.1786 | 0.4595 | 0.1711 | 0.3607 | 0.0967 | 0.3892 | 0.2677 | 0.396 | | 0.8548 | 53.0 | 5671 | 1.3952 | 0.2509 | 0.5076 | 0.2131 | 0.0846 | 0.1989 | 0.4249 | 0.2738 | 0.4475 | 0.4634 | 0.1904 | 0.4007 | 0.708 | 0.5228 | 0.6694 | 0.2054 | 0.4785 | 0.1833 | 0.3817 | 0.0732 | 0.3908 | 0.27 | 0.3964 | | 0.8677 | 54.0 | 5778 | 1.4126 | 0.2542 | 0.5102 | 0.2243 | 0.1042 | 0.1943 | 0.4266 | 0.2703 | 0.4432 | 0.464 | 0.2001 | 0.4123 | 0.7115 | 0.5149 | 0.6689 | 0.2095 | 0.4797 | 0.1891 | 0.3973 | 0.0973 | 0.3908 | 0.2605 | 0.3831 | | 0.8411 | 55.0 | 5885 | 1.3719 | 0.2622 | 0.5302 | 0.2162 | 0.1064 | 0.1973 | 0.4546 | 0.2722 | 0.4387 | 0.4582 | 0.2055 | 0.4015 | 0.6793 | 0.5294 | 0.6721 | 0.2128 | 0.4658 | 0.1936 | 0.3853 | 0.1067 | 0.38 | 0.2684 | 0.388 | | 0.8304 | 56.0 | 5992 | 1.3720 | 0.2574 | 0.5284 | 0.2123 | 0.111 | 0.2098 | 0.4288 | 0.2714 | 0.4422 | 0.4608 | 0.2192 | 0.4254 | 0.678 | 0.513 | 0.673 | 0.2099 | 0.457 | 0.1897 | 0.3884 | 0.1077 | 0.3908 | 0.2668 | 0.3947 | | 0.8494 | 57.0 | 6099 | 1.3436 | 0.2688 | 0.5468 | 0.2296 | 0.1174 | 0.2014 | 0.487 | 0.2786 | 0.4496 | 0.4712 | 0.2191 | 0.4218 | 0.7035 | 0.5323 | 0.6797 | 0.2373 | 0.4949 | 0.1761 | 0.3746 | 0.1257 | 0.4169 | 0.2728 | 0.3898 | | 0.8505 | 58.0 | 6206 | 1.3279 | 0.2665 | 0.522 | 0.237 | 0.1173 | 0.2102 | 0.4605 | 0.2776 | 0.4479 | 0.4679 | 0.2063 | 0.4194 | 0.6983 | 0.5201 | 0.6833 | 0.2246 | 0.4772 | 0.1797 | 0.3857 | 0.1267 | 0.3954 | 0.2814 | 0.3978 | | 0.8227 | 59.0 | 6313 | 1.3279 | 0.2668 | 0.5267 | 0.2222 | 0.1304 | 0.208 | 0.4523 | 0.2823 | 0.4514 | 0.4696 | 0.223 | 0.4233 | 0.6969 | 0.5244 | 0.6757 | 0.2493 | 0.5089 | 0.1784 | 0.3982 | 0.1102 | 0.3723 | 0.2717 | 0.3929 | | 0.8129 | 60.0 | 6420 | 1.3400 | 0.2673 | 0.5348 | 0.2388 | 0.1185 | 0.2189 | 0.4501 | 0.2807 | 0.4554 | 0.4708 | 0.2163 | 0.4207 | 0.7048 | 0.5286 | 0.6761 | 0.2222 | 0.4646 | 0.1809 | 0.3969 | 0.1413 | 0.4231 | 0.2635 | 0.3933 | | 0.8054 | 61.0 | 6527 | 1.3815 | 0.2734 | 0.548 | 0.2313 | 0.1199 | 0.2321 | 0.4526 | 0.282 | 0.4534 | 0.4687 | 0.2029 | 0.427 | 0.6887 | 0.5306 | 0.6797 | 0.2432 | 0.4734 | 0.1897 | 0.3942 | 0.1207 | 0.4 | 0.2825 | 0.396 | | 0.7911 | 62.0 | 6634 | 1.3294 | 0.2704 | 0.5431 | 0.2301 | 0.1107 | 0.2143 | 0.4745 | 0.2791 | 0.4557 | 0.4704 | 0.2158 | 0.4193 | 0.7055 | 0.5363 | 0.691 | 0.2281 | 0.4532 | 0.1879 | 0.3929 | 0.1242 | 0.4138 | 0.2756 | 0.4013 | | 0.7883 | 63.0 | 6741 | 1.3769 | 0.2605 | 0.5374 | 0.2202 | 0.1197 | 0.2211 | 0.4287 | 0.2717 | 0.4422 | 0.459 | 0.2065 | 0.4214 | 0.7033 | 0.5196 | 0.6698 | 0.2206 | 0.4646 | 0.176 | 0.3696 | 0.1092 | 0.4108 | 0.2772 | 0.3804 | | 0.786 | 64.0 | 6848 | 1.3379 | 0.2666 | 0.5441 | 0.2257 | 0.1268 | 0.2197 | 0.468 | 0.2779 | 0.4595 | 0.479 | 0.2326 | 0.4344 | 0.7088 | 0.5226 | 0.6779 | 0.2319 | 0.5076 | 0.172 | 0.3933 | 0.1309 | 0.4169 | 0.2755 | 0.3991 | | 0.7776 | 65.0 | 6955 | 1.3192 | 0.2708 | 0.5498 | 0.2165 | 0.1242 | 0.2149 | 0.4638 | 0.2795 | 0.4604 | 0.4736 | 0.2291 | 0.4245 | 0.6993 | 0.5326 | 0.6761 | 0.2312 | 0.4823 | 0.194 | 0.3951 | 0.1255 | 0.4138 | 0.2704 | 0.4004 | | 0.7615 | 66.0 | 7062 | 1.3282 | 0.2745 | 0.5488 | 0.2276 | 0.1299 | 0.2271 | 0.459 | 0.2828 | 0.458 | 0.4734 | 0.2233 | 0.4263 | 0.695 | 0.5327 | 0.6725 | 0.2393 | 0.4949 | 0.1862 | 0.3946 | 0.1283 | 0.4015 | 0.2862 | 0.4036 | | 0.7625 | 67.0 | 7169 | 1.3395 | 0.2778 | 0.5506 | 0.2384 | 0.1129 | 0.2216 | 0.4549 | 0.2754 | 0.4565 | 0.4698 | 0.2099 | 0.4264 | 0.7016 | 0.5473 | 0.6829 | 0.2375 | 0.4835 | 0.1937 | 0.3866 | 0.1235 | 0.3938 | 0.2872 | 0.4022 | | 0.7495 | 68.0 | 7276 | 1.3261 | 0.2763 | 0.5487 | 0.2482 | 0.1388 | 0.2211 | 0.4822 | 0.2841 | 0.4541 | 0.4678 | 0.2334 | 0.4186 | 0.6913 | 0.5344 | 0.6752 | 0.2438 | 0.4633 | 0.1956 | 0.4027 | 0.12 | 0.3954 | 0.2876 | 0.4027 | | 0.752 | 69.0 | 7383 | 1.3089 | 0.2816 | 0.5614 | 0.2464 | 0.1287 | 0.2309 | 0.4715 | 0.2833 | 0.4535 | 0.4704 | 0.2142 | 0.4297 | 0.6813 | 0.5332 | 0.6775 | 0.2508 | 0.4785 | 0.199 | 0.4062 | 0.1332 | 0.3831 | 0.2915 | 0.4067 | | 0.7329 | 70.0 | 7490 | 1.3402 | 0.2703 | 0.5482 | 0.2299 | 0.1397 | 0.2188 | 0.459 | 0.2748 | 0.4504 | 0.4671 | 0.2478 | 0.4077 | 0.6824 | 0.5322 | 0.6788 | 0.2376 | 0.4544 | 0.181 | 0.3955 | 0.1111 | 0.3985 | 0.2895 | 0.4084 | | 0.7383 | 71.0 | 7597 | 1.3367 | 0.2789 | 0.559 | 0.2514 | 0.1478 | 0.2189 | 0.4587 | 0.2852 | 0.462 | 0.4785 | 0.2426 | 0.4202 | 0.6802 | 0.5409 | 0.6928 | 0.2435 | 0.4595 | 0.1959 | 0.4 | 0.1287 | 0.4262 | 0.2855 | 0.4142 | | 0.7223 | 72.0 | 7704 | 1.3356 | 0.2774 | 0.5589 | 0.2312 | 0.1569 | 0.2185 | 0.4519 | 0.2852 | 0.4558 | 0.4692 | 0.2374 | 0.4173 | 0.6811 | 0.5452 | 0.6883 | 0.2422 | 0.4646 | 0.1951 | 0.3888 | 0.1131 | 0.3923 | 0.2915 | 0.412 | | 0.7155 | 73.0 | 7811 | 1.3295 | 0.2745 | 0.5553 | 0.2355 | 0.1444 | 0.2142 | 0.4732 | 0.2876 | 0.4614 | 0.4763 | 0.2288 | 0.4301 | 0.6877 | 0.5413 | 0.6851 | 0.2356 | 0.4835 | 0.1922 | 0.4013 | 0.1264 | 0.4077 | 0.2768 | 0.404 | | 0.7123 | 74.0 | 7918 | 1.3261 | 0.2725 | 0.546 | 0.2292 | 0.1447 | 0.2054 | 0.464 | 0.2856 | 0.4561 | 0.4731 | 0.2266 | 0.4088 | 0.695 | 0.542 | 0.6779 | 0.2295 | 0.4696 | 0.186 | 0.4138 | 0.121 | 0.4062 | 0.2842 | 0.3978 | | 0.7044 | 75.0 | 8025 | 1.3641 | 0.274 | 0.5524 | 0.2362 | 0.1446 | 0.2029 | 0.4664 | 0.29 | 0.4518 | 0.4683 | 0.2221 | 0.416 | 0.6934 | 0.5351 | 0.6761 | 0.2387 | 0.481 | 0.1923 | 0.3933 | 0.1144 | 0.3969 | 0.2895 | 0.3942 | | 0.6946 | 76.0 | 8132 | 1.3353 | 0.2769 | 0.5585 | 0.2302 | 0.1549 | 0.2175 | 0.457 | 0.2855 | 0.4546 | 0.4677 | 0.221 | 0.4138 | 0.6847 | 0.5438 | 0.6833 | 0.2514 | 0.4709 | 0.1899 | 0.392 | 0.1209 | 0.4 | 0.2785 | 0.3924 | | 0.692 | 77.0 | 8239 | 1.3378 | 0.2818 | 0.5631 | 0.2419 | 0.1771 | 0.2198 | 0.4555 | 0.2929 | 0.4592 | 0.4761 | 0.2936 | 0.4141 | 0.6873 | 0.5437 | 0.6815 | 0.2651 | 0.4899 | 0.2011 | 0.4062 | 0.1198 | 0.4108 | 0.2795 | 0.392 | | 0.6912 | 78.0 | 8346 | 1.3104 | 0.2801 | 0.5626 | 0.2337 | 0.1692 | 0.2139 | 0.4725 | 0.2856 | 0.4588 | 0.476 | 0.2346 | 0.4302 | 0.6936 | 0.5434 | 0.6919 | 0.2599 | 0.462 | 0.1845 | 0.4071 | 0.1339 | 0.42 | 0.2787 | 0.3991 | | 0.6841 | 79.0 | 8453 | 1.3479 | 0.2835 | 0.568 | 0.2334 | 0.1536 | 0.2137 | 0.483 | 0.2937 | 0.4524 | 0.4712 | 0.2171 | 0.4099 | 0.7032 | 0.5365 | 0.6811 | 0.2659 | 0.4709 | 0.1912 | 0.4027 | 0.1389 | 0.4108 | 0.2852 | 0.3907 | | 0.6772 | 80.0 | 8560 | 1.3513 | 0.2853 | 0.5623 | 0.2438 | 0.1542 | 0.2224 | 0.4758 | 0.2944 | 0.4557 | 0.4709 | 0.2264 | 0.4131 | 0.7013 | 0.5309 | 0.6784 | 0.266 | 0.4671 | 0.1991 | 0.4103 | 0.1429 | 0.4 | 0.2877 | 0.3987 | | 0.6748 | 81.0 | 8667 | 1.3345 | 0.2853 | 0.5691 | 0.2438 | 0.1607 | 0.2242 | 0.4818 | 0.2931 | 0.4543 | 0.469 | 0.2335 | 0.421 | 0.6924 | 0.5383 | 0.6851 | 0.2584 | 0.4519 | 0.2001 | 0.4031 | 0.1403 | 0.4 | 0.2894 | 0.4049 | | 0.6601 | 82.0 | 8774 | 1.3315 | 0.291 | 0.574 | 0.2597 | 0.1627 | 0.2333 | 0.4837 | 0.2899 | 0.4605 | 0.4754 | 0.2354 | 0.4348 | 0.6868 | 0.5364 | 0.6797 | 0.2761 | 0.4797 | 0.1991 | 0.404 | 0.143 | 0.4031 | 0.3003 | 0.4102 | | 0.6598 | 83.0 | 8881 | 1.3230 | 0.2917 | 0.5794 | 0.2537 | 0.1385 | 0.2287 | 0.4916 | 0.2912 | 0.4621 | 0.477 | 0.2305 | 0.4339 | 0.6913 | 0.5473 | 0.6892 | 0.2669 | 0.4747 | 0.1975 | 0.4205 | 0.1506 | 0.3938 | 0.296 | 0.4067 | | 0.6577 | 84.0 | 8988 | 1.3283 | 0.2947 | 0.5809 | 0.2681 | 0.1583 | 0.23 | 0.4971 | 0.2972 | 0.4633 | 0.4771 | 0.2237 | 0.4317 | 0.7008 | 0.5445 | 0.6829 | 0.2753 | 0.4937 | 0.2028 | 0.4098 | 0.151 | 0.3938 | 0.3002 | 0.4053 | | 0.6657 | 85.0 | 9095 | 1.3270 | 0.292 | 0.5805 | 0.2547 | 0.1669 | 0.224 | 0.4878 | 0.2968 | 0.46 | 0.4757 | 0.2361 | 0.4245 | 0.699 | 0.5422 | 0.6865 | 0.2658 | 0.4696 | 0.2014 | 0.4107 | 0.1552 | 0.4 | 0.2954 | 0.4116 | | 0.6451 | 86.0 | 9202 | 1.3250 | 0.2898 | 0.5695 | 0.2528 | 0.1706 | 0.2256 | 0.4978 | 0.2932 | 0.4548 | 0.4709 | 0.225 | 0.4229 | 0.6988 | 0.5352 | 0.6766 | 0.2675 | 0.4797 | 0.1967 | 0.396 | 0.1485 | 0.3938 | 0.3011 | 0.4084 | | 0.6501 | 87.0 | 9309 | 1.3576 | 0.2934 | 0.5824 | 0.2498 | 0.1556 | 0.2243 | 0.4893 | 0.2938 | 0.4633 | 0.4791 | 0.2446 | 0.4291 | 0.702 | 0.5461 | 0.6847 | 0.2651 | 0.4899 | 0.2 | 0.3969 | 0.1569 | 0.4108 | 0.2989 | 0.4133 | | 0.6444 | 88.0 | 9416 | 1.3638 | 0.2911 | 0.5818 | 0.2514 | 0.1715 | 0.2217 | 0.4913 | 0.2945 | 0.4576 | 0.4745 | 0.2477 | 0.4226 | 0.6918 | 0.5451 | 0.6788 | 0.2577 | 0.4835 | 0.2045 | 0.4049 | 0.1554 | 0.3969 | 0.2929 | 0.4084 | | 0.6275 | 89.0 | 9523 | 1.3529 | 0.2908 | 0.5777 | 0.2417 | 0.1722 | 0.2221 | 0.4779 | 0.2948 | 0.4575 | 0.4722 | 0.2504 | 0.4186 | 0.6857 | 0.5422 | 0.6734 | 0.2696 | 0.481 | 0.2097 | 0.4036 | 0.1463 | 0.3938 | 0.2861 | 0.4093 | | 0.6394 | 90.0 | 9630 | 1.3503 | 0.2913 | 0.5775 | 0.2445 | 0.159 | 0.2181 | 0.4954 | 0.2935 | 0.4579 | 0.4713 | 0.2362 | 0.4156 | 0.6884 | 0.5438 | 0.6784 | 0.2697 | 0.4835 | 0.2041 | 0.4045 | 0.1519 | 0.3862 | 0.2869 | 0.404 | | 0.6301 | 91.0 | 9737 | 1.3381 | 0.2914 | 0.5775 | 0.2397 | 0.1611 | 0.2246 | 0.4956 | 0.2963 | 0.4591 | 0.4737 | 0.241 | 0.426 | 0.6906 | 0.5477 | 0.6802 | 0.262 | 0.4772 | 0.2076 | 0.408 | 0.1554 | 0.4 | 0.2843 | 0.4031 | | 0.632 | 92.0 | 9844 | 1.3426 | 0.2911 | 0.573 | 0.2416 | 0.1699 | 0.2282 | 0.4914 | 0.2991 | 0.4619 | 0.4751 | 0.2436 | 0.4282 | 0.6894 | 0.5428 | 0.6833 | 0.2679 | 0.4886 | 0.2091 | 0.3955 | 0.1519 | 0.4077 | 0.2836 | 0.4004 | | 0.6231 | 93.0 | 9951 | 1.3458 | 0.294 | 0.5787 | 0.2491 | 0.1695 | 0.2263 | 0.4898 | 0.298 | 0.4621 | 0.4764 | 0.2407 | 0.4302 | 0.6841 | 0.546 | 0.6784 | 0.2697 | 0.4797 | 0.2138 | 0.404 | 0.1485 | 0.4062 | 0.292 | 0.4138 | | 0.6162 | 94.0 | 10058 | 1.3339 | 0.2915 | 0.5819 | 0.2501 | 0.1638 | 0.2224 | 0.491 | 0.2978 | 0.4607 | 0.477 | 0.2425 | 0.4217 | 0.697 | 0.5445 | 0.6793 | 0.2713 | 0.4759 | 0.2092 | 0.404 | 0.1482 | 0.4215 | 0.2844 | 0.404 | | 0.6249 | 95.0 | 10165 | 1.3501 | 0.2905 | 0.583 | 0.2494 | 0.1697 | 0.2233 | 0.4881 | 0.2969 | 0.4602 | 0.4746 | 0.243 | 0.4209 | 0.6892 | 0.5373 | 0.6739 | 0.2717 | 0.4937 | 0.2109 | 0.4022 | 0.1501 | 0.4046 | 0.2826 | 0.3987 | | 0.6189 | 96.0 | 10272 | 1.3529 | 0.2904 | 0.5798 | 0.2422 | 0.1658 | 0.2242 | 0.4877 | 0.2938 | 0.4631 | 0.4772 | 0.2482 | 0.4268 | 0.6855 | 0.5395 | 0.6788 | 0.279 | 0.4924 | 0.2083 | 0.3973 | 0.1388 | 0.4154 | 0.2865 | 0.4022 | | 0.6135 | 97.0 | 10379 | 1.3553 | 0.2929 | 0.5853 | 0.248 | 0.167 | 0.2251 | 0.4901 | 0.2972 | 0.4593 | 0.4765 | 0.2379 | 0.4222 | 0.6929 | 0.5369 | 0.6788 | 0.2785 | 0.4861 | 0.2083 | 0.3987 | 0.1524 | 0.4138 | 0.2887 | 0.4049 | | 0.613 | 98.0 | 10486 | 1.3622 | 0.2938 | 0.5851 | 0.2432 | 0.1642 | 0.2285 | 0.4894 | 0.2958 | 0.4603 | 0.4747 | 0.2408 | 0.4212 | 0.6916 | 0.5406 | 0.6766 | 0.2774 | 0.4848 | 0.2088 | 0.3938 | 0.1525 | 0.4092 | 0.2899 | 0.4089 | | 0.6144 | 99.0 | 10593 | 1.3536 | 0.2933 | 0.5833 | 0.245 | 0.1634 | 0.2282 | 0.4935 | 0.2962 | 0.4589 | 0.4745 | 0.2419 | 0.4225 | 0.6914 | 0.5414 | 0.6793 | 0.277 | 0.4873 | 0.2061 | 0.3942 | 0.1554 | 0.4092 | 0.2869 | 0.4027 | | 0.613 | 100.0 | 10700 | 1.3550 | 0.2936 | 0.5835 | 0.2461 | 0.1635 | 0.2284 | 0.4956 | 0.2943 | 0.4587 | 0.4737 | 0.2424 | 0.4204 | 0.6907 | 0.5418 | 0.6788 | 0.2801 | 0.481 | 0.2075 | 0.3955 | 0.1534 | 0.4108 | 0.2852 | 0.4022 | ### Framework versions - Transformers 4.41.0.dev0 - Pytorch 1.13.0+cu117 - Datasets 2.18.0 - Tokenizers 0.19.0