--- license: apache-2.0 base_model: facebook/detr-resnet-50 tags: - object-detection - vision - generated_from_trainer model-index: - name: facebook-detr-resnet-50-finetuned-10k-cppe5 results: [] --- [Visualize in Weights & Biases](https://wandb.ai/qubvel-hf-co/transformers-detection-model-finetuning-cppe5/runs/z4r0avog) # facebook-detr-resnet-50-finetuned-10k-cppe5 This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset. It achieves the following results on the evaluation set: - Loss: 1.1507 - Map: 0.3346 - Map 50: 0.5981 - Map 75: 0.3283 - Map Small: 0.1903 - Map Medium: 0.2508 - Map Large: 0.4752 - Mar 1: 0.3914 - Mar 10: 0.5305 - Mar 100: 0.5425 - Mar Small: 0.2821 - Mar Medium: 0.4111 - Mar Large: 0.705 - Map Coverall: 0.5884 - Mar 100 Coverall: 0.7253 - Map Face Shield: 0.3168 - Mar 100 Face Shield: 0.5818 - Map Gloves: 0.2028 - Mar 100 Gloves: 0.3934 - Map Goggles: 0.2102 - Mar 100 Goggles: 0.558 - Map Mask: 0.3549 - Mar 100 Mask: 0.454 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 1337 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:| | 3.616 | 1.0 | 107 | 2.9380 | 0.0046 | 0.0138 | 0.0018 | 0.0012 | 0.0002 | 0.0048 | 0.0166 | 0.0632 | 0.1049 | 0.0024 | 0.0187 | 0.1312 | 0.0223 | 0.4442 | 0.0 | 0.0 | 0.0002 | 0.0361 | 0.0 | 0.0 | 0.0007 | 0.0444 | | 2.9914 | 2.0 | 214 | 2.7489 | 0.0138 | 0.0444 | 0.0055 | 0.0018 | 0.0007 | 0.0142 | 0.0292 | 0.0888 | 0.1125 | 0.0024 | 0.041 | 0.1216 | 0.0664 | 0.4253 | 0.0 | 0.0 | 0.0004 | 0.0486 | 0.0 | 0.0 | 0.002 | 0.0884 | | 2.6785 | 3.0 | 321 | 2.5782 | 0.0167 | 0.0534 | 0.0071 | 0.0016 | 0.0005 | 0.0177 | 0.0367 | 0.1002 | 0.1182 | 0.0032 | 0.0382 | 0.1326 | 0.0808 | 0.4584 | 0.0 | 0.0 | 0.0003 | 0.0475 | 0.0 | 0.0 | 0.0022 | 0.0848 | | 2.4754 | 4.0 | 428 | 2.4978 | 0.0229 | 0.0639 | 0.0099 | 0.002 | 0.0042 | 0.0221 | 0.0417 | 0.1182 | 0.1475 | 0.0155 | 0.058 | 0.1507 | 0.1019 | 0.5318 | 0.0 | 0.0 | 0.001 | 0.0776 | 0.0 | 0.0 | 0.0118 | 0.1283 | | 2.2601 | 5.0 | 535 | 2.2584 | 0.0342 | 0.0846 | 0.0251 | 0.0055 | 0.0057 | 0.038 | 0.0602 | 0.1313 | 0.1686 | 0.0127 | 0.0815 | 0.1747 | 0.1557 | 0.5558 | 0.0068 | 0.0273 | 0.0016 | 0.0995 | 0.0 | 0.0 | 0.007 | 0.1606 | | 2.1746 | 6.0 | 642 | 2.0845 | 0.0536 | 0.1098 | 0.0468 | 0.006 | 0.0156 | 0.0545 | 0.0926 | 0.1654 | 0.204 | 0.0391 | 0.1055 | 0.2434 | 0.2312 | 0.5922 | 0.0181 | 0.0964 | 0.0032 | 0.1295 | 0.0 | 0.0 | 0.0157 | 0.202 | | 2.1412 | 7.0 | 749 | 2.1784 | 0.0398 | 0.1094 | 0.0225 | 0.0064 | 0.0174 | 0.0399 | 0.0913 | 0.1778 | 0.2043 | 0.0126 | 0.126 | 0.2373 | 0.1418 | 0.5214 | 0.0394 | 0.1836 | 0.0019 | 0.1246 | 0.0 | 0.0 | 0.0161 | 0.1919 | | 2.094 | 8.0 | 856 | 2.1212 | 0.0477 | 0.1209 | 0.027 | 0.0098 | 0.0087 | 0.0474 | 0.0939 | 0.18 | 0.2051 | 0.0503 | 0.1222 | 0.1987 | 0.2067 | 0.5435 | 0.0102 | 0.1382 | 0.0043 | 0.1355 | 0.0 | 0.0 | 0.0175 | 0.2081 | | 2.0231 | 9.0 | 963 | 1.9452 | 0.0592 | 0.1348 | 0.0455 | 0.0093 | 0.015 | 0.0622 | 0.1093 | 0.2226 | 0.2572 | 0.0603 | 0.1648 | 0.2804 | 0.2438 | 0.6117 | 0.013 | 0.2182 | 0.0085 | 0.1995 | 0.0007 | 0.002 | 0.0299 | 0.2545 | | 1.9703 | 10.0 | 1070 | 1.9528 | 0.0678 | 0.1508 | 0.0521 | 0.0077 | 0.0232 | 0.075 | 0.1116 | 0.2175 | 0.2571 | 0.0347 | 0.1752 | 0.2909 | 0.2741 | 0.6013 | 0.0274 | 0.2164 | 0.0052 | 0.1798 | 0.0 | 0.0 | 0.0326 | 0.2879 | | 1.9284 | 11.0 | 1177 | 1.8626 | 0.0843 | 0.1763 | 0.0776 | 0.0263 | 0.0162 | 0.1032 | 0.1378 | 0.2587 | 0.2928 | 0.0701 | 0.1837 | 0.3684 | 0.3527 | 0.6273 | 0.0321 | 0.3509 | 0.0057 | 0.1902 | 0.0001 | 0.004 | 0.0307 | 0.2914 | | 1.85 | 12.0 | 1284 | 1.8513 | 0.1011 | 0.207 | 0.0878 | 0.0073 | 0.0384 | 0.1079 | 0.1468 | 0.2539 | 0.2795 | 0.0377 | 0.1753 | 0.332 | 0.3676 | 0.6481 | 0.0796 | 0.2818 | 0.0085 | 0.1836 | 0.0005 | 0.012 | 0.0492 | 0.2722 | | 1.7521 | 13.0 | 1391 | 1.7764 | 0.105 | 0.2085 | 0.0924 | 0.0254 | 0.0396 | 0.1046 | 0.1551 | 0.2772 | 0.3019 | 0.0707 | 0.1945 | 0.3994 | 0.3992 | 0.6416 | 0.0502 | 0.3018 | 0.0142 | 0.2306 | 0.0008 | 0.028 | 0.0606 | 0.3076 | | 1.6934 | 14.0 | 1498 | 1.7405 | 0.1262 | 0.2607 | 0.1124 | 0.0365 | 0.0736 | 0.1244 | 0.1663 | 0.2984 | 0.3249 | 0.0764 | 0.2257 | 0.4122 | 0.4113 | 0.6506 | 0.1122 | 0.3527 | 0.0099 | 0.2224 | 0.0025 | 0.044 | 0.0952 | 0.3545 | | 1.6837 | 15.0 | 1605 | 1.6992 | 0.1192 | 0.246 | 0.1049 | 0.0455 | 0.063 | 0.1248 | 0.1809 | 0.3105 | 0.3314 | 0.0763 | 0.223 | 0.4305 | 0.3945 | 0.6435 | 0.1059 | 0.3982 | 0.0159 | 0.235 | 0.0062 | 0.046 | 0.0733 | 0.3343 | | 1.6609 | 16.0 | 1712 | 1.8307 | 0.09 | 0.2062 | 0.0676 | 0.0277 | 0.0295 | 0.107 | 0.1515 | 0.2788 | 0.3128 | 0.0831 | 0.2117 | 0.3951 | 0.3372 | 0.6084 | 0.0415 | 0.3091 | 0.0089 | 0.2426 | 0.007 | 0.08 | 0.0553 | 0.3237 | | 1.646 | 17.0 | 1819 | 1.6690 | 0.1319 | 0.275 | 0.1164 | 0.051 | 0.0747 | 0.1526 | 0.1989 | 0.3525 | 0.384 | 0.123 | 0.2814 | 0.5094 | 0.4002 | 0.6247 | 0.065 | 0.4164 | 0.0259 | 0.2973 | 0.0627 | 0.216 | 0.1058 | 0.3657 | | 1.6016 | 18.0 | 1926 | 1.6489 | 0.1374 | 0.3023 | 0.1079 | 0.0649 | 0.0727 | 0.171 | 0.1936 | 0.3339 | 0.3578 | 0.1163 | 0.2523 | 0.4989 | 0.4021 | 0.5877 | 0.0671 | 0.3782 | 0.0228 | 0.2798 | 0.0493 | 0.174 | 0.1458 | 0.3692 | | 1.5686 | 19.0 | 2033 | 1.6094 | 0.1497 | 0.3101 | 0.1236 | 0.0418 | 0.0841 | 0.1755 | 0.218 | 0.3731 | 0.4009 | 0.1232 | 0.2946 | 0.5219 | 0.4527 | 0.6468 | 0.0936 | 0.4182 | 0.0263 | 0.2934 | 0.0408 | 0.266 | 0.1349 | 0.3803 | | 1.5312 | 20.0 | 2140 | 1.5237 | 0.1732 | 0.3454 | 0.1548 | 0.0729 | 0.1081 | 0.2238 | 0.2383 | 0.3908 | 0.4182 | 0.2073 | 0.2878 | 0.5665 | 0.4815 | 0.6636 | 0.1266 | 0.44 | 0.037 | 0.3115 | 0.0266 | 0.288 | 0.1941 | 0.3879 | | 1.4907 | 21.0 | 2247 | 1.5332 | 0.1792 | 0.3615 | 0.152 | 0.0759 | 0.1167 | 0.2209 | 0.2473 | 0.3973 | 0.4221 | 0.1877 | 0.2963 | 0.5843 | 0.4678 | 0.661 | 0.104 | 0.4491 | 0.0496 | 0.3071 | 0.0722 | 0.314 | 0.2023 | 0.3793 | | 1.4154 | 22.0 | 2354 | 1.5248 | 0.1742 | 0.3551 | 0.1524 | 0.0867 | 0.0917 | 0.2499 | 0.2541 | 0.3974 | 0.4196 | 0.1728 | 0.2843 | 0.5959 | 0.4828 | 0.663 | 0.0991 | 0.4455 | 0.0502 | 0.294 | 0.057 | 0.342 | 0.182 | 0.3535 | | 1.4162 | 23.0 | 2461 | 1.4762 | 0.1931 | 0.3804 | 0.1741 | 0.0783 | 0.1263 | 0.2436 | 0.2567 | 0.3938 | 0.4137 | 0.15 | 0.279 | 0.5965 | 0.4868 | 0.6935 | 0.1134 | 0.4182 | 0.0542 | 0.2863 | 0.0953 | 0.312 | 0.2156 | 0.3586 | | 1.4624 | 24.0 | 2568 | 1.4757 | 0.173 | 0.3577 | 0.1468 | 0.0352 | 0.0993 | 0.2231 | 0.2258 | 0.3952 | 0.4155 | 0.1291 | 0.2987 | 0.5419 | 0.4726 | 0.6552 | 0.0822 | 0.42 | 0.0489 | 0.3186 | 0.0408 | 0.312 | 0.2207 | 0.3717 | | 1.4275 | 25.0 | 2675 | 1.5116 | 0.1759 | 0.3586 | 0.1602 | 0.0576 | 0.13 | 0.2456 | 0.24 | 0.3856 | 0.4077 | 0.1952 | 0.2959 | 0.5276 | 0.4527 | 0.6643 | 0.1087 | 0.4218 | 0.057 | 0.3169 | 0.0409 | 0.278 | 0.2202 | 0.3576 | | 1.4002 | 26.0 | 2782 | 1.4787 | 0.1954 | 0.3737 | 0.1821 | 0.0338 | 0.1296 | 0.2585 | 0.2523 | 0.4039 | 0.4237 | 0.1232 | 0.2934 | 0.6087 | 0.4823 | 0.6701 | 0.1562 | 0.4164 | 0.0361 | 0.2973 | 0.0473 | 0.37 | 0.2552 | 0.3646 | | 1.3991 | 27.0 | 2889 | 1.5002 | 0.1946 | 0.3787 | 0.1846 | 0.0501 | 0.1434 | 0.2684 | 0.2503 | 0.4031 | 0.4282 | 0.1418 | 0.3042 | 0.5904 | 0.4605 | 0.6675 | 0.1255 | 0.4236 | 0.0438 | 0.2907 | 0.0891 | 0.382 | 0.2543 | 0.3773 | | 1.3786 | 28.0 | 2996 | 1.4114 | 0.2167 | 0.4296 | 0.2011 | 0.055 | 0.1596 | 0.2997 | 0.2711 | 0.4271 | 0.4439 | 0.1325 | 0.3265 | 0.611 | 0.5044 | 0.6929 | 0.1611 | 0.4309 | 0.0871 | 0.3322 | 0.0671 | 0.382 | 0.2639 | 0.3813 | | 1.3221 | 29.0 | 3103 | 1.4392 | 0.2103 | 0.4118 | 0.19 | 0.0658 | 0.1463 | 0.2814 | 0.2744 | 0.4262 | 0.4473 | 0.1744 | 0.3121 | 0.6248 | 0.4909 | 0.6864 | 0.1448 | 0.4491 | 0.0675 | 0.2929 | 0.0811 | 0.432 | 0.267 | 0.3763 | | 1.3073 | 30.0 | 3210 | 1.3707 | 0.2243 | 0.4368 | 0.1973 | 0.0558 | 0.1679 | 0.3023 | 0.2749 | 0.4348 | 0.456 | 0.163 | 0.3312 | 0.6184 | 0.5199 | 0.6987 | 0.1462 | 0.4545 | 0.0965 | 0.3536 | 0.0996 | 0.394 | 0.2592 | 0.3793 | | 1.2889 | 31.0 | 3317 | 1.3956 | 0.2121 | 0.4279 | 0.1948 | 0.0479 | 0.1462 | 0.2967 | 0.2589 | 0.4308 | 0.4478 | 0.1559 | 0.3281 | 0.6031 | 0.4899 | 0.6779 | 0.1249 | 0.4309 | 0.0952 | 0.3372 | 0.111 | 0.43 | 0.2395 | 0.3631 | | 1.3164 | 32.0 | 3424 | 1.4315 | 0.2094 | 0.4238 | 0.1815 | 0.0341 | 0.1474 | 0.2662 | 0.2662 | 0.4129 | 0.4247 | 0.0857 | 0.3045 | 0.5793 | 0.4874 | 0.6766 | 0.1177 | 0.3927 | 0.0835 | 0.3027 | 0.1297 | 0.396 | 0.2288 | 0.3556 | | 1.3735 | 33.0 | 3531 | 1.3750 | 0.2322 | 0.4495 | 0.223 | 0.0762 | 0.1597 | 0.297 | 0.3006 | 0.4463 | 0.4602 | 0.1737 | 0.3294 | 0.6188 | 0.5351 | 0.7006 | 0.1626 | 0.4545 | 0.0956 | 0.3251 | 0.1178 | 0.452 | 0.2498 | 0.3687 | | 1.2856 | 34.0 | 3638 | 1.4287 | 0.2257 | 0.4418 | 0.2076 | 0.0646 | 0.1505 | 0.3169 | 0.2616 | 0.4221 | 0.4429 | 0.1341 | 0.3274 | 0.5719 | 0.5082 | 0.6747 | 0.1528 | 0.4509 | 0.11 | 0.3082 | 0.0935 | 0.414 | 0.264 | 0.3667 | | 1.2558 | 35.0 | 3745 | 1.3187 | 0.2401 | 0.4657 | 0.2202 | 0.0721 | 0.1688 | 0.3091 | 0.3008 | 0.4597 | 0.4756 | 0.1618 | 0.3272 | 0.6627 | 0.5188 | 0.7032 | 0.1495 | 0.4891 | 0.1232 | 0.3415 | 0.1313 | 0.45 | 0.2776 | 0.3939 | | 1.1862 | 36.0 | 3852 | 1.2866 | 0.2588 | 0.4753 | 0.2457 | 0.0634 | 0.1939 | 0.3323 | 0.3199 | 0.4643 | 0.4754 | 0.1514 | 0.342 | 0.6447 | 0.5416 | 0.7006 | 0.213 | 0.4745 | 0.13 | 0.3432 | 0.1414 | 0.474 | 0.2682 | 0.3848 | | 1.2361 | 37.0 | 3959 | 1.3003 | 0.2531 | 0.4754 | 0.2405 | 0.0619 | 0.191 | 0.3391 | 0.3006 | 0.4612 | 0.4814 | 0.1487 | 0.3592 | 0.6214 | 0.5226 | 0.7039 | 0.2095 | 0.4873 | 0.1069 | 0.3678 | 0.1434 | 0.46 | 0.2832 | 0.3879 | | 1.1919 | 38.0 | 4066 | 1.3157 | 0.2411 | 0.4507 | 0.2127 | 0.1031 | 0.1691 | 0.3298 | 0.3007 | 0.4654 | 0.4887 | 0.1863 | 0.3628 | 0.6209 | 0.5242 | 0.713 | 0.1632 | 0.4927 | 0.1206 | 0.3699 | 0.1164 | 0.478 | 0.2812 | 0.3899 | | 1.2089 | 39.0 | 4173 | 1.3253 | 0.2378 | 0.4618 | 0.2139 | 0.06 | 0.1662 | 0.3619 | 0.2932 | 0.456 | 0.4747 | 0.1647 | 0.3502 | 0.6456 | 0.5365 | 0.687 | 0.1477 | 0.44 | 0.1341 | 0.3612 | 0.1181 | 0.512 | 0.2526 | 0.3732 | | 1.1989 | 40.0 | 4280 | 1.3079 | 0.243 | 0.4632 | 0.2212 | 0.09 | 0.1745 | 0.3635 | 0.2888 | 0.4601 | 0.4815 | 0.1716 | 0.3643 | 0.6676 | 0.5474 | 0.711 | 0.1511 | 0.5055 | 0.1275 | 0.3596 | 0.1169 | 0.46 | 0.2721 | 0.3712 | | 1.123 | 41.0 | 4387 | 1.2717 | 0.2545 | 0.4648 | 0.2389 | 0.0865 | 0.1746 | 0.3768 | 0.3137 | 0.4805 | 0.5019 | 0.2341 | 0.3727 | 0.6742 | 0.5567 | 0.7182 | 0.1537 | 0.5127 | 0.1243 | 0.3738 | 0.1443 | 0.494 | 0.2933 | 0.4106 | | 1.1247 | 42.0 | 4494 | 1.3207 | 0.2547 | 0.4802 | 0.2359 | 0.0646 | 0.1709 | 0.3638 | 0.3091 | 0.4584 | 0.4749 | 0.1666 | 0.339 | 0.6682 | 0.5703 | 0.7162 | 0.2116 | 0.5055 | 0.1441 | 0.341 | 0.1132 | 0.474 | 0.2342 | 0.3379 | | 1.127 | 43.0 | 4601 | 1.2355 | 0.2651 | 0.5025 | 0.2454 | 0.0659 | 0.2016 | 0.3784 | 0.3272 | 0.4851 | 0.5009 | 0.1616 | 0.3671 | 0.691 | 0.5439 | 0.7188 | 0.2047 | 0.5164 | 0.1539 | 0.382 | 0.1291 | 0.49 | 0.2942 | 0.3975 | | 1.1019 | 44.0 | 4708 | 1.2395 | 0.2684 | 0.4895 | 0.2566 | 0.0892 | 0.1954 | 0.3819 | 0.3367 | 0.4887 | 0.5068 | 0.183 | 0.3718 | 0.6757 | 0.5447 | 0.7195 | 0.2254 | 0.52 | 0.1424 | 0.3781 | 0.1198 | 0.506 | 0.3096 | 0.4106 | | 1.1069 | 45.0 | 4815 | 1.2494 | 0.2673 | 0.4805 | 0.2646 | 0.0882 | 0.1876 | 0.3995 | 0.3261 | 0.4852 | 0.5081 | 0.2162 | 0.3564 | 0.7021 | 0.5524 | 0.7149 | 0.2068 | 0.5255 | 0.1756 | 0.3907 | 0.1071 | 0.498 | 0.2945 | 0.4116 | | 1.0929 | 46.0 | 4922 | 1.2631 | 0.2738 | 0.5088 | 0.2541 | 0.0801 | 0.1949 | 0.375 | 0.3189 | 0.4701 | 0.4968 | 0.2285 | 0.3514 | 0.6741 | 0.5683 | 0.7136 | 0.2407 | 0.5109 | 0.184 | 0.3852 | 0.1181 | 0.49 | 0.2578 | 0.3843 | | 1.1297 | 47.0 | 5029 | 1.2737 | 0.263 | 0.4986 | 0.2373 | 0.0855 | 0.1837 | 0.3832 | 0.315 | 0.4695 | 0.4879 | 0.2051 | 0.3548 | 0.6878 | 0.564 | 0.7052 | 0.2275 | 0.5182 | 0.1486 | 0.3481 | 0.0788 | 0.462 | 0.2959 | 0.4061 | | 1.1593 | 48.0 | 5136 | 1.2690 | 0.2644 | 0.5107 | 0.2612 | 0.0745 | 0.1985 | 0.3765 | 0.312 | 0.4634 | 0.4813 | 0.1852 | 0.3491 | 0.6642 | 0.5391 | 0.7019 | 0.2197 | 0.5073 | 0.1748 | 0.3601 | 0.1367 | 0.466 | 0.2516 | 0.3712 | | 1.1372 | 49.0 | 5243 | 1.2779 | 0.2707 | 0.4987 | 0.2736 | 0.0876 | 0.1936 | 0.4004 | 0.3236 | 0.4708 | 0.489 | 0.2231 | 0.3449 | 0.6683 | 0.5527 | 0.7182 | 0.2438 | 0.5 | 0.1566 | 0.3667 | 0.1353 | 0.466 | 0.2652 | 0.3939 | | 1.0796 | 50.0 | 5350 | 1.1901 | 0.2915 | 0.5427 | 0.2927 | 0.0752 | 0.2182 | 0.428 | 0.336 | 0.4896 | 0.5065 | 0.1738 | 0.3675 | 0.6844 | 0.5609 | 0.7253 | 0.2496 | 0.5073 | 0.1813 | 0.3923 | 0.1545 | 0.496 | 0.3109 | 0.4116 | | 1.0472 | 51.0 | 5457 | 1.2350 | 0.2861 | 0.5365 | 0.2647 | 0.0842 | 0.2116 | 0.4284 | 0.3274 | 0.4874 | 0.4988 | 0.1772 | 0.3617 | 0.6809 | 0.5501 | 0.7136 | 0.247 | 0.5018 | 0.1633 | 0.3339 | 0.1554 | 0.526 | 0.315 | 0.4187 | | 1.0605 | 52.0 | 5564 | 1.1940 | 0.2927 | 0.5423 | 0.2773 | 0.1478 | 0.2135 | 0.429 | 0.3472 | 0.49 | 0.5068 | 0.2497 | 0.3565 | 0.6921 | 0.5544 | 0.7097 | 0.2547 | 0.4818 | 0.1827 | 0.3913 | 0.1602 | 0.528 | 0.3113 | 0.4232 | | 1.0506 | 53.0 | 5671 | 1.2127 | 0.2751 | 0.5239 | 0.2555 | 0.101 | 0.1945 | 0.4041 | 0.3218 | 0.4813 | 0.4952 | 0.2365 | 0.3461 | 0.6708 | 0.5685 | 0.724 | 0.2394 | 0.4873 | 0.1758 | 0.3634 | 0.1136 | 0.52 | 0.2784 | 0.3813 | | 1.053 | 54.0 | 5778 | 1.1906 | 0.2994 | 0.5424 | 0.2941 | 0.1302 | 0.213 | 0.4167 | 0.3406 | 0.5033 | 0.5241 | 0.2372 | 0.3795 | 0.6998 | 0.5648 | 0.7266 | 0.2552 | 0.5273 | 0.1795 | 0.3732 | 0.176 | 0.564 | 0.3217 | 0.4293 | | 1.0142 | 55.0 | 5885 | 1.1860 | 0.2937 | 0.5326 | 0.28 | 0.1125 | 0.2158 | 0.4177 | 0.3366 | 0.4924 | 0.5081 | 0.2158 | 0.3796 | 0.6679 | 0.567 | 0.7195 | 0.2523 | 0.5018 | 0.1687 | 0.3765 | 0.1754 | 0.534 | 0.305 | 0.4086 | | 1.0391 | 56.0 | 5992 | 1.1970 | 0.2856 | 0.5244 | 0.2672 | 0.106 | 0.2012 | 0.4148 | 0.3396 | 0.4901 | 0.5089 | 0.2218 | 0.3697 | 0.6807 | 0.561 | 0.7065 | 0.2175 | 0.4982 | 0.1701 | 0.3661 | 0.1658 | 0.548 | 0.3133 | 0.4258 | | 1.0031 | 57.0 | 6099 | 1.1818 | 0.2964 | 0.5385 | 0.2752 | 0.1798 | 0.2196 | 0.4145 | 0.3537 | 0.5142 | 0.5287 | 0.3015 | 0.3943 | 0.6906 | 0.5677 | 0.7247 | 0.2248 | 0.5382 | 0.1842 | 0.3809 | 0.17 | 0.562 | 0.3353 | 0.4379 | | 0.9794 | 58.0 | 6206 | 1.1965 | 0.2903 | 0.5258 | 0.2852 | 0.1404 | 0.2064 | 0.422 | 0.3436 | 0.4984 | 0.5121 | 0.2596 | 0.3677 | 0.6908 | 0.5615 | 0.7149 | 0.2557 | 0.5091 | 0.155 | 0.3656 | 0.1543 | 0.536 | 0.3247 | 0.4348 | | 1.0123 | 59.0 | 6313 | 1.1943 | 0.2831 | 0.5389 | 0.2672 | 0.1388 | 0.213 | 0.4055 | 0.3503 | 0.5034 | 0.5191 | 0.2761 | 0.3874 | 0.6878 | 0.5536 | 0.711 | 0.2217 | 0.52 | 0.1557 | 0.3672 | 0.1714 | 0.562 | 0.3133 | 0.4354 | | 0.9814 | 60.0 | 6420 | 1.2012 | 0.303 | 0.5553 | 0.2868 | 0.1351 | 0.2209 | 0.4293 | 0.3507 | 0.5019 | 0.5164 | 0.2826 | 0.3747 | 0.6823 | 0.5686 | 0.7104 | 0.2642 | 0.5036 | 0.1664 | 0.3732 | 0.198 | 0.56 | 0.3177 | 0.4348 | | 0.9583 | 61.0 | 6527 | 1.1838 | 0.3041 | 0.5548 | 0.305 | 0.1338 | 0.2199 | 0.4376 | 0.3457 | 0.4977 | 0.5123 | 0.2561 | 0.3739 | 0.6789 | 0.5853 | 0.724 | 0.2694 | 0.5164 | 0.193 | 0.3836 | 0.1766 | 0.522 | 0.2962 | 0.4157 | | 0.9506 | 62.0 | 6634 | 1.1634 | 0.3013 | 0.5503 | 0.2856 | 0.1514 | 0.2189 | 0.4223 | 0.3473 | 0.5123 | 0.5251 | 0.2774 | 0.3852 | 0.6884 | 0.5762 | 0.7117 | 0.2389 | 0.5345 | 0.1946 | 0.3896 | 0.1656 | 0.542 | 0.3309 | 0.4475 | | 0.9914 | 63.0 | 6741 | 1.1681 | 0.3051 | 0.5439 | 0.2905 | 0.1401 | 0.2514 | 0.4296 | 0.3476 | 0.5 | 0.5137 | 0.2761 | 0.4054 | 0.6728 | 0.5816 | 0.7143 | 0.2752 | 0.5436 | 0.1746 | 0.3656 | 0.1677 | 0.518 | 0.3264 | 0.4268 | | 0.9516 | 64.0 | 6848 | 1.1811 | 0.2933 | 0.532 | 0.2921 | 0.1145 | 0.2285 | 0.4111 | 0.3384 | 0.4869 | 0.5034 | 0.2024 | 0.38 | 0.6794 | 0.5576 | 0.7019 | 0.2721 | 0.5291 | 0.1595 | 0.3579 | 0.1524 | 0.502 | 0.3251 | 0.4263 | | 0.9232 | 65.0 | 6955 | 1.1625 | 0.304 | 0.551 | 0.2776 | 0.1706 | 0.2403 | 0.4162 | 0.3477 | 0.5064 | 0.5193 | 0.2514 | 0.3986 | 0.6958 | 0.5644 | 0.7188 | 0.2713 | 0.5327 | 0.1806 | 0.388 | 0.1681 | 0.526 | 0.3357 | 0.4308 | | 0.9479 | 66.0 | 7062 | 1.1899 | 0.3017 | 0.5539 | 0.2705 | 0.157 | 0.2135 | 0.4417 | 0.36 | 0.5122 | 0.5277 | 0.2622 | 0.3857 | 0.7181 | 0.5725 | 0.7136 | 0.2637 | 0.5636 | 0.173 | 0.3814 | 0.1876 | 0.56 | 0.3117 | 0.4197 | | 0.9041 | 67.0 | 7169 | 1.1758 | 0.3142 | 0.5585 | 0.3089 | 0.1431 | 0.2326 | 0.4294 | 0.3619 | 0.5049 | 0.5161 | 0.2519 | 0.3782 | 0.6862 | 0.5954 | 0.7266 | 0.2947 | 0.5182 | 0.1781 | 0.3617 | 0.1817 | 0.558 | 0.3213 | 0.4162 | | 0.9385 | 68.0 | 7276 | 1.1483 | 0.3169 | 0.5782 | 0.2985 | 0.1935 | 0.232 | 0.4517 | 0.3714 | 0.5241 | 0.5357 | 0.2918 | 0.3976 | 0.7021 | 0.5802 | 0.7312 | 0.2987 | 0.5636 | 0.1982 | 0.3896 | 0.1854 | 0.566 | 0.3218 | 0.4283 | | 0.9177 | 69.0 | 7383 | 1.1799 | 0.3144 | 0.5645 | 0.3005 | 0.2049 | 0.2287 | 0.456 | 0.3629 | 0.5138 | 0.5294 | 0.3176 | 0.3806 | 0.6951 | 0.5789 | 0.7227 | 0.2856 | 0.5655 | 0.1928 | 0.3852 | 0.1902 | 0.544 | 0.3246 | 0.4298 | | 0.8781 | 70.0 | 7490 | 1.1637 | 0.3114 | 0.5637 | 0.2894 | 0.1957 | 0.2345 | 0.4385 | 0.3655 | 0.5149 | 0.5293 | 0.3021 | 0.3919 | 0.6927 | 0.58 | 0.7331 | 0.2764 | 0.5473 | 0.1943 | 0.3858 | 0.191 | 0.55 | 0.3151 | 0.4303 | | 0.9337 | 71.0 | 7597 | 1.1627 | 0.3156 | 0.5643 | 0.3023 | 0.1742 | 0.229 | 0.4506 | 0.3683 | 0.517 | 0.5322 | 0.302 | 0.3825 | 0.7129 | 0.5811 | 0.7357 | 0.2999 | 0.54 | 0.1897 | 0.3831 | 0.1859 | 0.578 | 0.3212 | 0.4242 | | 0.8986 | 72.0 | 7704 | 1.1679 | 0.3119 | 0.5658 | 0.2888 | 0.1704 | 0.24 | 0.4547 | 0.3554 | 0.5196 | 0.5338 | 0.2748 | 0.3949 | 0.7075 | 0.5799 | 0.7286 | 0.3 | 0.5855 | 0.1882 | 0.3896 | 0.1744 | 0.534 | 0.317 | 0.4313 | | 0.8766 | 73.0 | 7811 | 1.1545 | 0.319 | 0.5724 | 0.2952 | 0.1869 | 0.2428 | 0.4541 | 0.3684 | 0.5239 | 0.5388 | 0.2905 | 0.4015 | 0.7063 | 0.5834 | 0.7325 | 0.2992 | 0.5782 | 0.1877 | 0.3913 | 0.2001 | 0.564 | 0.3247 | 0.4283 | | 0.8668 | 74.0 | 7918 | 1.1662 | 0.3178 | 0.5811 | 0.3096 | 0.1839 | 0.2384 | 0.4517 | 0.3609 | 0.5171 | 0.5335 | 0.2927 | 0.3982 | 0.6937 | 0.5824 | 0.7344 | 0.3004 | 0.5582 | 0.1927 | 0.3863 | 0.1833 | 0.552 | 0.3304 | 0.4364 | | 0.9248 | 75.0 | 8025 | 1.1544 | 0.3152 | 0.5751 | 0.2907 | 0.1729 | 0.2337 | 0.444 | 0.3545 | 0.5134 | 0.5281 | 0.2933 | 0.3852 | 0.705 | 0.5802 | 0.726 | 0.302 | 0.5473 | 0.1915 | 0.3891 | 0.1634 | 0.528 | 0.3389 | 0.45 | | 0.8511 | 76.0 | 8132 | 1.1887 | 0.3263 | 0.5907 | 0.3062 | 0.1854 | 0.2392 | 0.4552 | 0.3585 | 0.5155 | 0.5295 | 0.2971 | 0.3832 | 0.7044 | 0.5832 | 0.7227 | 0.3305 | 0.5691 | 0.1884 | 0.3678 | 0.1977 | 0.542 | 0.3315 | 0.446 | | 0.8675 | 77.0 | 8239 | 1.1739 | 0.3276 | 0.5954 | 0.3103 | 0.1956 | 0.2426 | 0.4537 | 0.361 | 0.5207 | 0.5333 | 0.2866 | 0.3944 | 0.6991 | 0.5889 | 0.7286 | 0.322 | 0.5655 | 0.2014 | 0.3825 | 0.1879 | 0.54 | 0.3379 | 0.45 | | 0.821 | 78.0 | 8346 | 1.1699 | 0.3277 | 0.5932 | 0.313 | 0.2021 | 0.2523 | 0.4642 | 0.3718 | 0.5263 | 0.5403 | 0.283 | 0.4125 | 0.7088 | 0.5832 | 0.7299 | 0.3294 | 0.5745 | 0.2013 | 0.4011 | 0.1897 | 0.552 | 0.3347 | 0.4439 | | 0.8467 | 79.0 | 8453 | 1.1643 | 0.332 | 0.5979 | 0.3249 | 0.2042 | 0.2473 | 0.4766 | 0.3875 | 0.5246 | 0.5332 | 0.3188 | 0.4013 | 0.6999 | 0.5873 | 0.7318 | 0.3269 | 0.5655 | 0.2038 | 0.3836 | 0.2126 | 0.544 | 0.3296 | 0.4409 | | 0.8951 | 80.0 | 8560 | 1.1533 | 0.3359 | 0.5938 | 0.3165 | 0.2187 | 0.2461 | 0.4588 | 0.3917 | 0.5416 | 0.5544 | 0.3381 | 0.4132 | 0.7085 | 0.5918 | 0.737 | 0.3356 | 0.5836 | 0.1981 | 0.3967 | 0.2108 | 0.604 | 0.3433 | 0.4505 | | 0.8303 | 81.0 | 8667 | 1.1637 | 0.3298 | 0.5901 | 0.306 | 0.1872 | 0.244 | 0.4758 | 0.3891 | 0.5293 | 0.5387 | 0.279 | 0.405 | 0.7137 | 0.5887 | 0.7312 | 0.3384 | 0.5727 | 0.1918 | 0.3776 | 0.1974 | 0.57 | 0.3327 | 0.4419 | | 0.8386 | 82.0 | 8774 | 1.1539 | 0.3293 | 0.5917 | 0.3013 | 0.1962 | 0.2435 | 0.4732 | 0.3916 | 0.5291 | 0.5404 | 0.2927 | 0.4116 | 0.7092 | 0.5858 | 0.7299 | 0.3162 | 0.5764 | 0.1995 | 0.3891 | 0.2015 | 0.556 | 0.3432 | 0.4505 | | 0.809 | 83.0 | 8881 | 1.1587 | 0.3284 | 0.5927 | 0.3001 | 0.1922 | 0.2476 | 0.4659 | 0.3861 | 0.5219 | 0.5347 | 0.2976 | 0.4068 | 0.6911 | 0.5829 | 0.726 | 0.3299 | 0.5818 | 0.1993 | 0.3918 | 0.1948 | 0.54 | 0.3351 | 0.4338 | | 0.8205 | 84.0 | 8988 | 1.1508 | 0.3333 | 0.5942 | 0.3156 | 0.2093 | 0.2456 | 0.4866 | 0.3853 | 0.5314 | 0.5429 | 0.3255 | 0.4043 | 0.7107 | 0.5863 | 0.7279 | 0.3185 | 0.5691 | 0.203 | 0.3885 | 0.2253 | 0.592 | 0.3335 | 0.4369 | | 0.8459 | 85.0 | 9095 | 1.1513 | 0.335 | 0.5963 | 0.3219 | 0.2008 | 0.2476 | 0.4894 | 0.3915 | 0.527 | 0.537 | 0.3072 | 0.3987 | 0.7064 | 0.5833 | 0.7234 | 0.3246 | 0.5709 | 0.2059 | 0.3814 | 0.2144 | 0.562 | 0.3465 | 0.4475 | | 0.8008 | 86.0 | 9202 | 1.1530 | 0.3245 | 0.5927 | 0.3062 | 0.1832 | 0.2477 | 0.4705 | 0.3825 | 0.5248 | 0.5359 | 0.2794 | 0.41 | 0.6952 | 0.5836 | 0.7299 | 0.3002 | 0.5709 | 0.1856 | 0.3749 | 0.2223 | 0.57 | 0.3308 | 0.4338 | | 0.7936 | 87.0 | 9309 | 1.1558 | 0.3266 | 0.5861 | 0.3079 | 0.1893 | 0.2374 | 0.4833 | 0.3848 | 0.5226 | 0.5357 | 0.2929 | 0.4 | 0.7015 | 0.5788 | 0.7299 | 0.3111 | 0.5745 | 0.1929 | 0.3814 | 0.2219 | 0.56 | 0.3281 | 0.4328 | | 0.7991 | 88.0 | 9416 | 1.1667 | 0.3246 | 0.5969 | 0.2974 | 0.167 | 0.2393 | 0.49 | 0.379 | 0.5165 | 0.53 | 0.2649 | 0.4023 | 0.6997 | 0.5824 | 0.726 | 0.3114 | 0.5636 | 0.1853 | 0.3721 | 0.2107 | 0.55 | 0.3335 | 0.4384 | | 0.7914 | 89.0 | 9523 | 1.1521 | 0.3281 | 0.5926 | 0.3144 | 0.1756 | 0.2404 | 0.4755 | 0.3851 | 0.5305 | 0.5402 | 0.2902 | 0.4018 | 0.7063 | 0.5845 | 0.7338 | 0.313 | 0.5636 | 0.2014 | 0.3863 | 0.2031 | 0.576 | 0.3386 | 0.4414 | | 0.7722 | 90.0 | 9630 | 1.1521 | 0.3292 | 0.5978 | 0.3104 | 0.1804 | 0.2419 | 0.4764 | 0.3893 | 0.5308 | 0.5407 | 0.2913 | 0.4016 | 0.7088 | 0.5845 | 0.7253 | 0.3133 | 0.5727 | 0.1944 | 0.382 | 0.2064 | 0.57 | 0.3475 | 0.4535 | | 0.7563 | 91.0 | 9737 | 1.1742 | 0.331 | 0.5967 | 0.3157 | 0.1783 | 0.2413 | 0.4789 | 0.393 | 0.5273 | 0.5397 | 0.302 | 0.403 | 0.7119 | 0.5886 | 0.724 | 0.3014 | 0.5673 | 0.2036 | 0.3874 | 0.2167 | 0.574 | 0.3445 | 0.446 | | 0.7714 | 92.0 | 9844 | 1.1554 | 0.3274 | 0.5924 | 0.3159 | 0.1808 | 0.2393 | 0.4769 | 0.387 | 0.5304 | 0.5426 | 0.2972 | 0.4029 | 0.712 | 0.5857 | 0.7266 | 0.3051 | 0.5855 | 0.1966 | 0.3874 | 0.2062 | 0.568 | 0.3435 | 0.4455 | | 0.7669 | 93.0 | 9951 | 1.1550 | 0.325 | 0.5913 | 0.2998 | 0.1885 | 0.2429 | 0.4674 | 0.3818 | 0.5262 | 0.5388 | 0.3039 | 0.4037 | 0.7082 | 0.5781 | 0.7227 | 0.301 | 0.5673 | 0.1997 | 0.3995 | 0.205 | 0.56 | 0.3414 | 0.4444 | | 0.7811 | 94.0 | 10058 | 1.1591 | 0.3263 | 0.5903 | 0.31 | 0.1742 | 0.2371 | 0.4802 | 0.3841 | 0.5252 | 0.5356 | 0.2761 | 0.3988 | 0.7018 | 0.5788 | 0.7234 | 0.2981 | 0.5582 | 0.1989 | 0.3885 | 0.2056 | 0.558 | 0.3498 | 0.45 | | 0.7932 | 95.0 | 10165 | 1.1517 | 0.3301 | 0.5926 | 0.3201 | 0.1803 | 0.2432 | 0.4713 | 0.3859 | 0.5256 | 0.5361 | 0.2813 | 0.402 | 0.7011 | 0.583 | 0.7292 | 0.3034 | 0.5673 | 0.2052 | 0.3918 | 0.2131 | 0.546 | 0.346 | 0.446 | | 0.77 | 96.0 | 10272 | 1.1538 | 0.3319 | 0.5967 | 0.3222 | 0.1813 | 0.2434 | 0.4755 | 0.3891 | 0.5203 | 0.5319 | 0.2707 | 0.3965 | 0.694 | 0.5833 | 0.7299 | 0.3101 | 0.56 | 0.2049 | 0.3907 | 0.223 | 0.538 | 0.3384 | 0.4409 | | 0.764 | 97.0 | 10379 | 1.1521 | 0.3323 | 0.6031 | 0.3131 | 0.1855 | 0.2427 | 0.4726 | 0.3908 | 0.5256 | 0.5369 | 0.2745 | 0.4053 | 0.6897 | 0.5893 | 0.7266 | 0.31 | 0.5764 | 0.1998 | 0.3913 | 0.2162 | 0.546 | 0.3464 | 0.4444 | | 0.7517 | 98.0 | 10486 | 1.1509 | 0.3328 | 0.601 | 0.3287 | 0.1866 | 0.2448 | 0.478 | 0.3888 | 0.5252 | 0.5395 | 0.2761 | 0.4053 | 0.7042 | 0.5868 | 0.724 | 0.3141 | 0.5782 | 0.1991 | 0.3907 | 0.2159 | 0.554 | 0.3482 | 0.4505 | | 0.7519 | 99.0 | 10593 | 1.1516 | 0.3334 | 0.597 | 0.3165 | 0.1921 | 0.2488 | 0.4761 | 0.3897 | 0.5306 | 0.5431 | 0.2851 | 0.4112 | 0.7061 | 0.5871 | 0.726 | 0.3091 | 0.58 | 0.2027 | 0.3951 | 0.2161 | 0.562 | 0.3522 | 0.4525 | | 0.7373 | 100.0 | 10700 | 1.1507 | 0.3346 | 0.5981 | 0.3283 | 0.1903 | 0.2508 | 0.4752 | 0.3914 | 0.5305 | 0.5425 | 0.2821 | 0.4111 | 0.705 | 0.5884 | 0.7253 | 0.3168 | 0.5818 | 0.2028 | 0.3934 | 0.2102 | 0.558 | 0.3549 | 0.454 | ### Framework versions - Transformers 4.41.0.dev0 - Pytorch 1.13.0+cu117 - Datasets 2.18.0 - Tokenizers 0.19.0