--- license: apache-2.0 base_model: SenseTime/deformable-detr tags: - object-detection - vision - generated_from_trainer model-index: - name: sensetime-deformable-detr-finetuned-10k-cppe5 results: [] --- # sensetime-deformable-detr-finetuned-10k-cppe5 This model is a fine-tuned version of [SenseTime/deformable-detr](https://huggingface.co/SenseTime/deformable-detr) on the cppe-5 dataset. It achieves the following results on the evaluation set: - Loss: 1.1028 - Map: 0.2808 - Map 50: 0.5257 - Map 75: 0.2589 - Map Small: 0.2879 - Map Medium: 0.1953 - Map Large: 0.4546 - Mar 1: 0.3004 - Mar 10: 0.5007 - Mar 100: 0.534 - Mar Small: 0.4339 - Mar Medium: 0.4079 - Mar Large: 0.7629 - Map Coverall: 0.5566 - Mar 100 Coverall: 0.7331 - Map Face Shield: 0.2761 - Mar 100 Face Shield: 0.549 - Map Gloves: 0.1484 - Mar 100 Gloves: 0.3943 - Map Goggles: 0.1271 - Mar 100 Goggles: 0.5085 - Map Mask: 0.2956 - Mar 100 Mask: 0.4853 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 4 - eval_batch_size: 8 - seed: 1337 - gradient_accumulation_steps: 2 - total_train_batch_size: 8 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask | |:-------------:|:-------:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:| | 9.1039 | 0.9953 | 106 | 2.6450 | 0.0073 | 0.0229 | 0.0025 | 0.0 | 0.0001 | 0.0088 | 0.0123 | 0.0311 | 0.0381 | 0.0009 | 0.0248 | 0.0329 | 0.0358 | 0.1186 | 0.0001 | 0.0204 | 0.0 | 0.0066 | 0.0002 | 0.0034 | 0.0002 | 0.0417 | | 2.3921 | 2.0 | 213 | 2.4742 | 0.0067 | 0.0207 | 0.0017 | 0.0009 | 0.0009 | 0.008 | 0.0157 | 0.0582 | 0.0923 | 0.0038 | 0.0276 | 0.1516 | 0.0296 | 0.3349 | 0.0011 | 0.0327 | 0.0 | 0.0199 | 0.0016 | 0.0203 | 0.0013 | 0.0536 | | 2.28 | 2.9953 | 319 | 2.5260 | 0.0064 | 0.0198 | 0.0024 | 0.0342 | 0.0005 | 0.0063 | 0.0124 | 0.0547 | 0.0777 | 0.1079 | 0.0291 | 0.0848 | 0.0294 | 0.2849 | 0.0009 | 0.0082 | 0.0 | 0.0057 | 0.0 | 0.0 | 0.0019 | 0.0896 | | 2.1883 | 4.0 | 426 | 2.2302 | 0.0077 | 0.0193 | 0.006 | 0.0013 | 0.001 | 0.0126 | 0.0259 | 0.0653 | 0.1098 | 0.0109 | 0.035 | 0.1264 | 0.0323 | 0.4203 | 0.0 | 0.0 | 0.0 | 0.01 | 0.0023 | 0.0119 | 0.0036 | 0.1066 | | 2.1263 | 4.9953 | 532 | 2.1512 | 0.0105 | 0.0306 | 0.0069 | 0.0021 | 0.0015 | 0.0105 | 0.0323 | 0.0757 | 0.1144 | 0.0199 | 0.0328 | 0.1168 | 0.0467 | 0.45 | 0.0001 | 0.002 | 0.0001 | 0.0175 | 0.0 | 0.0 | 0.0058 | 0.1024 | | 2.0232 | 6.0 | 639 | 2.1045 | 0.0133 | 0.0323 | 0.0103 | 0.0049 | 0.0023 | 0.0143 | 0.0357 | 0.0882 | 0.1265 | 0.0147 | 0.044 | 0.1458 | 0.0575 | 0.4773 | 0.0 | 0.0 | 0.0002 | 0.0147 | 0.0 | 0.0 | 0.0086 | 0.1403 | | 2.0103 | 6.9953 | 745 | 2.1646 | 0.0219 | 0.0466 | 0.0178 | 0.0049 | 0.0015 | 0.0232 | 0.0438 | 0.1018 | 0.1274 | 0.0085 | 0.0471 | 0.1658 | 0.1033 | 0.4698 | 0.0013 | 0.0184 | 0.0001 | 0.0251 | 0.0003 | 0.0136 | 0.0046 | 0.1104 | | 1.9723 | 8.0 | 852 | 1.9693 | 0.021 | 0.052 | 0.0165 | 0.0048 | 0.0036 | 0.0274 | 0.039 | 0.113 | 0.1558 | 0.0241 | 0.053 | 0.2211 | 0.0881 | 0.5407 | 0.0029 | 0.0286 | 0.0001 | 0.0265 | 0.0007 | 0.0119 | 0.013 | 0.1716 | | 1.9425 | 8.9953 | 958 | 1.9505 | 0.0199 | 0.0505 | 0.0148 | 0.003 | 0.0051 | 0.0195 | 0.0387 | 0.1041 | 0.1534 | 0.0233 | 0.0595 | 0.1477 | 0.0826 | 0.564 | 0.0037 | 0.0122 | 0.0001 | 0.0156 | 0.0003 | 0.0068 | 0.0126 | 0.1682 | | 1.8248 | 10.0 | 1065 | 1.9128 | 0.0237 | 0.0603 | 0.0166 | 0.0064 | 0.0079 | 0.0335 | 0.0558 | 0.137 | 0.1739 | 0.0569 | 0.089 | 0.1711 | 0.0872 | 0.5314 | 0.015 | 0.0939 | 0.0002 | 0.019 | 0.0018 | 0.0492 | 0.0143 | 0.1763 | | 1.7923 | 10.9953 | 1171 | 1.8334 | 0.0281 | 0.0628 | 0.0223 | 0.0069 | 0.0081 | 0.0302 | 0.0546 | 0.1543 | 0.204 | 0.0577 | 0.1129 | 0.2174 | 0.1088 | 0.5523 | 0.0103 | 0.0857 | 0.0002 | 0.0265 | 0.0048 | 0.1424 | 0.0163 | 0.2133 | | 1.7922 | 12.0 | 1278 | 1.8679 | 0.0405 | 0.0964 | 0.0281 | 0.0165 | 0.0126 | 0.0444 | 0.0596 | 0.1629 | 0.2031 | 0.0387 | 0.1127 | 0.2102 | 0.1462 | 0.5709 | 0.0299 | 0.1408 | 0.0002 | 0.0213 | 0.0099 | 0.0966 | 0.0163 | 0.1858 | | 1.7797 | 12.9953 | 1384 | 1.7715 | 0.036 | 0.0739 | 0.0337 | 0.0066 | 0.0089 | 0.042 | 0.0647 | 0.1644 | 0.2102 | 0.0472 | 0.1088 | 0.2326 | 0.1429 | 0.5924 | 0.014 | 0.1082 | 0.0006 | 0.0469 | 0.0016 | 0.0797 | 0.0207 | 0.2237 | | 1.6925 | 14.0 | 1491 | 1.7633 | 0.0427 | 0.0897 | 0.044 | 0.0073 | 0.0069 | 0.0564 | 0.061 | 0.163 | 0.2152 | 0.0631 | 0.1133 | 0.2339 | 0.1819 | 0.5988 | 0.0063 | 0.0429 | 0.0007 | 0.0493 | 0.0069 | 0.1695 | 0.0175 | 0.2156 | | 1.6927 | 14.9953 | 1597 | 1.7455 | 0.0429 | 0.0973 | 0.0311 | 0.0081 | 0.0139 | 0.0464 | 0.0718 | 0.196 | 0.243 | 0.059 | 0.1603 | 0.2494 | 0.1594 | 0.5959 | 0.0283 | 0.1592 | 0.0008 | 0.0559 | 0.0069 | 0.1627 | 0.0191 | 0.2412 | | 1.6409 | 16.0 | 1704 | 1.6922 | 0.0414 | 0.1001 | 0.0295 | 0.0186 | 0.0152 | 0.0447 | 0.0612 | 0.203 | 0.2566 | 0.0805 | 0.1605 | 0.3192 | 0.1449 | 0.5965 | 0.0235 | 0.151 | 0.0012 | 0.073 | 0.0108 | 0.2254 | 0.0264 | 0.237 | | 1.6535 | 16.9953 | 1810 | 1.6837 | 0.0508 | 0.0973 | 0.0468 | 0.011 | 0.021 | 0.0457 | 0.088 | 0.2063 | 0.2565 | 0.0518 | 0.1584 | 0.2943 | 0.1717 | 0.6256 | 0.0426 | 0.1694 | 0.0007 | 0.0507 | 0.0081 | 0.1712 | 0.0307 | 0.2654 | | 1.5853 | 18.0 | 1917 | 1.6565 | 0.0424 | 0.0842 | 0.0379 | 0.0103 | 0.0177 | 0.0497 | 0.0954 | 0.2317 | 0.2809 | 0.0502 | 0.1839 | 0.3685 | 0.1457 | 0.639 | 0.0169 | 0.1673 | 0.002 | 0.0986 | 0.0155 | 0.2339 | 0.0318 | 0.2659 | | 1.5743 | 18.9953 | 2023 | 1.6498 | 0.0409 | 0.0877 | 0.0367 | 0.0989 | 0.0149 | 0.0487 | 0.1 | 0.2277 | 0.2841 | 0.2421 | 0.1812 | 0.3256 | 0.1417 | 0.6535 | 0.0225 | 0.2286 | 0.0025 | 0.1052 | 0.0073 | 0.1407 | 0.0306 | 0.2924 | | 1.5241 | 20.0 | 2130 | 1.6974 | 0.0496 | 0.1014 | 0.0484 | 0.0401 | 0.0168 | 0.0579 | 0.099 | 0.2179 | 0.2668 | 0.0939 | 0.1701 | 0.3058 | 0.179 | 0.632 | 0.0278 | 0.2531 | 0.003 | 0.0825 | 0.0096 | 0.1525 | 0.0283 | 0.2137 | | 1.5431 | 20.9953 | 2236 | 1.5908 | 0.0584 | 0.1168 | 0.0529 | 0.098 | 0.0376 | 0.0581 | 0.1182 | 0.2721 | 0.3191 | 0.15 | 0.2129 | 0.3986 | 0.1837 | 0.6558 | 0.0505 | 0.3224 | 0.0039 | 0.1005 | 0.0151 | 0.2508 | 0.0388 | 0.2659 | | 1.5106 | 22.0 | 2343 | 1.6095 | 0.0593 | 0.1366 | 0.0445 | 0.0125 | 0.0284 | 0.0639 | 0.1034 | 0.2407 | 0.2845 | 0.063 | 0.1819 | 0.3299 | 0.1892 | 0.6238 | 0.0521 | 0.2327 | 0.006 | 0.1118 | 0.0147 | 0.1864 | 0.0345 | 0.2678 | | 1.5372 | 22.9953 | 2449 | 1.5951 | 0.0636 | 0.1316 | 0.0576 | 0.0282 | 0.0416 | 0.0537 | 0.1163 | 0.266 | 0.312 | 0.0853 | 0.2239 | 0.3533 | 0.1781 | 0.6052 | 0.0692 | 0.3286 | 0.008 | 0.1393 | 0.0153 | 0.1983 | 0.0475 | 0.2886 | | 1.4386 | 24.0 | 2556 | 1.5187 | 0.0622 | 0.123 | 0.0587 | 0.0185 | 0.0405 | 0.0661 | 0.1229 | 0.2786 | 0.3385 | 0.0898 | 0.2326 | 0.4092 | 0.1881 | 0.6599 | 0.0659 | 0.351 | 0.0061 | 0.1332 | 0.0147 | 0.2407 | 0.0362 | 0.3076 | | 1.4267 | 24.9953 | 2662 | 1.5143 | 0.0664 | 0.1359 | 0.0569 | 0.0405 | 0.0475 | 0.0664 | 0.1284 | 0.2935 | 0.3396 | 0.0994 | 0.2523 | 0.3919 | 0.1845 | 0.6512 | 0.0576 | 0.3204 | 0.0088 | 0.1393 | 0.0233 | 0.2508 | 0.0576 | 0.3365 | | 1.397 | 26.0 | 2769 | 1.5084 | 0.0689 | 0.1464 | 0.0617 | 0.0567 | 0.047 | 0.0686 | 0.1508 | 0.3158 | 0.363 | 0.1653 | 0.2526 | 0.453 | 0.1731 | 0.6605 | 0.0708 | 0.3796 | 0.009 | 0.1569 | 0.0347 | 0.2932 | 0.057 | 0.3246 | | 1.3846 | 26.9953 | 2875 | 1.4379 | 0.077 | 0.1554 | 0.0671 | 0.052 | 0.0457 | 0.0747 | 0.1576 | 0.3191 | 0.3686 | 0.2459 | 0.2615 | 0.4191 | 0.2061 | 0.6762 | 0.0678 | 0.3939 | 0.0154 | 0.19 | 0.027 | 0.2136 | 0.069 | 0.3692 | | 1.3763 | 28.0 | 2982 | 1.4605 | 0.0727 | 0.1483 | 0.0675 | 0.0761 | 0.037 | 0.0817 | 0.1428 | 0.3136 | 0.3706 | 0.1434 | 0.2537 | 0.4855 | 0.2099 | 0.6663 | 0.0653 | 0.398 | 0.0116 | 0.1801 | 0.0247 | 0.2678 | 0.052 | 0.3408 | | 1.3449 | 28.9953 | 3088 | 1.4449 | 0.0808 | 0.1637 | 0.0757 | 0.1455 | 0.0567 | 0.0952 | 0.1746 | 0.3383 | 0.3933 | 0.3418 | 0.2831 | 0.5146 | 0.2091 | 0.6779 | 0.0717 | 0.4449 | 0.0119 | 0.1635 | 0.032 | 0.3085 | 0.0794 | 0.3716 | | 1.3355 | 30.0 | 3195 | 1.4498 | 0.0727 | 0.1544 | 0.0677 | 0.0271 | 0.0509 | 0.0832 | 0.1562 | 0.3189 | 0.3589 | 0.2176 | 0.2815 | 0.4364 | 0.2056 | 0.6715 | 0.0554 | 0.3245 | 0.0152 | 0.1773 | 0.0149 | 0.2458 | 0.0723 | 0.3754 | | 1.3218 | 30.9953 | 3301 | 1.4156 | 0.0784 | 0.1641 | 0.0656 | 0.0608 | 0.0528 | 0.0978 | 0.1575 | 0.3344 | 0.3867 | 0.1655 | 0.2825 | 0.5141 | 0.2088 | 0.686 | 0.0624 | 0.398 | 0.0211 | 0.21 | 0.0238 | 0.2661 | 0.0761 | 0.3735 | | 1.2773 | 32.0 | 3408 | 1.3722 | 0.0823 | 0.1682 | 0.0764 | 0.0641 | 0.056 | 0.1128 | 0.1602 | 0.3656 | 0.4143 | 0.1975 | 0.308 | 0.5599 | 0.2192 | 0.6913 | 0.0704 | 0.449 | 0.0199 | 0.2213 | 0.0216 | 0.3153 | 0.0803 | 0.3948 | | 1.2839 | 32.9953 | 3514 | 1.3795 | 0.09 | 0.186 | 0.0785 | 0.0733 | 0.0697 | 0.14 | 0.1867 | 0.3742 | 0.416 | 0.2753 | 0.2984 | 0.5739 | 0.2294 | 0.693 | 0.0819 | 0.4673 | 0.0212 | 0.2218 | 0.0293 | 0.3119 | 0.0883 | 0.3858 | | 1.2384 | 34.0 | 3621 | 1.3960 | 0.1002 | 0.2061 | 0.0858 | 0.0783 | 0.0594 | 0.1223 | 0.175 | 0.36 | 0.4115 | 0.2457 | 0.2905 | 0.5741 | 0.2479 | 0.6895 | 0.0775 | 0.402 | 0.0246 | 0.2479 | 0.0371 | 0.3136 | 0.114 | 0.4047 | | 1.2495 | 34.9953 | 3727 | 1.3261 | 0.1007 | 0.2102 | 0.087 | 0.0847 | 0.0659 | 0.1473 | 0.1918 | 0.3789 | 0.4263 | 0.2146 | 0.3201 | 0.5737 | 0.246 | 0.7035 | 0.0753 | 0.4204 | 0.0362 | 0.2588 | 0.0315 | 0.3593 | 0.1145 | 0.3896 | | 1.2032 | 36.0 | 3834 | 1.3012 | 0.1024 | 0.2052 | 0.0886 | 0.105 | 0.0723 | 0.157 | 0.1899 | 0.394 | 0.4376 | 0.2237 | 0.3284 | 0.5945 | 0.2543 | 0.6907 | 0.0731 | 0.4673 | 0.0369 | 0.272 | 0.0294 | 0.3542 | 0.1184 | 0.4038 | | 1.2024 | 36.9953 | 3940 | 1.2989 | 0.107 | 0.2271 | 0.0844 | 0.2679 | 0.0987 | 0.1728 | 0.1961 | 0.4048 | 0.4467 | 0.3934 | 0.348 | 0.5898 | 0.2451 | 0.7035 | 0.0819 | 0.449 | 0.0419 | 0.2773 | 0.0373 | 0.3814 | 0.1288 | 0.4223 | | 1.1714 | 38.0 | 4047 | 1.3187 | 0.1186 | 0.2361 | 0.1052 | 0.0464 | 0.0813 | 0.16 | 0.1932 | 0.3883 | 0.4304 | 0.2583 | 0.321 | 0.6007 | 0.3029 | 0.7058 | 0.0951 | 0.4143 | 0.0472 | 0.2739 | 0.0372 | 0.3373 | 0.1108 | 0.4209 | | 1.1702 | 38.9953 | 4153 | 1.3017 | 0.1158 | 0.2338 | 0.1025 | 0.1431 | 0.0923 | 0.1729 | 0.1998 | 0.4178 | 0.4544 | 0.2428 | 0.3371 | 0.6742 | 0.2624 | 0.7134 | 0.0981 | 0.4694 | 0.0458 | 0.2981 | 0.0427 | 0.3559 | 0.1299 | 0.4351 | | 1.1745 | 40.0 | 4260 | 1.2802 | 0.1167 | 0.2351 | 0.1035 | 0.0578 | 0.095 | 0.1591 | 0.2099 | 0.4126 | 0.4571 | 0.3426 | 0.3457 | 0.6024 | 0.2627 | 0.7174 | 0.1144 | 0.4939 | 0.0403 | 0.29 | 0.0334 | 0.3407 | 0.1328 | 0.4436 | | 1.1502 | 40.9953 | 4366 | 1.2797 | 0.1283 | 0.2538 | 0.1168 | 0.082 | 0.0831 | 0.1653 | 0.2048 | 0.4136 | 0.4552 | 0.322 | 0.3349 | 0.6206 | 0.301 | 0.7169 | 0.1078 | 0.449 | 0.0513 | 0.3085 | 0.043 | 0.3627 | 0.1382 | 0.4389 | | 1.1149 | 42.0 | 4473 | 1.2880 | 0.134 | 0.2744 | 0.1197 | 0.1218 | 0.1095 | 0.2147 | 0.2133 | 0.4295 | 0.4717 | 0.2168 | 0.3639 | 0.7173 | 0.3046 | 0.7238 | 0.1305 | 0.5286 | 0.0479 | 0.3005 | 0.0425 | 0.3746 | 0.1445 | 0.4313 | | 1.1224 | 42.9953 | 4579 | 1.2321 | 0.1477 | 0.2839 | 0.1314 | 0.1361 | 0.1143 | 0.2275 | 0.22 | 0.4406 | 0.4751 | 0.3523 | 0.3623 | 0.6821 | 0.3288 | 0.7326 | 0.1463 | 0.4918 | 0.0582 | 0.3242 | 0.0434 | 0.3915 | 0.1616 | 0.4355 | | 1.0958 | 44.0 | 4686 | 1.2293 | 0.1416 | 0.2833 | 0.1279 | 0.1761 | 0.1067 | 0.2186 | 0.2211 | 0.4368 | 0.4815 | 0.3122 | 0.3702 | 0.6796 | 0.3046 | 0.732 | 0.1434 | 0.4959 | 0.054 | 0.3171 | 0.0355 | 0.3915 | 0.1702 | 0.4711 | | 1.081 | 44.9953 | 4792 | 1.2400 | 0.1403 | 0.2807 | 0.1243 | 0.1979 | 0.1054 | 0.24 | 0.2378 | 0.4331 | 0.4761 | 0.3035 | 0.3484 | 0.7158 | 0.297 | 0.7291 | 0.1405 | 0.4959 | 0.0624 | 0.328 | 0.0345 | 0.3814 | 0.167 | 0.446 | | 1.0659 | 46.0 | 4899 | 1.2180 | 0.1518 | 0.2984 | 0.1404 | 0.0926 | 0.1198 | 0.2352 | 0.2261 | 0.4455 | 0.4907 | 0.3604 | 0.3798 | 0.6992 | 0.3282 | 0.7262 | 0.1433 | 0.5102 | 0.0668 | 0.3502 | 0.0452 | 0.4085 | 0.1757 | 0.4583 | | 1.0741 | 46.9953 | 5005 | 1.2355 | 0.1501 | 0.3066 | 0.1381 | 0.2278 | 0.1125 | 0.2314 | 0.2259 | 0.4356 | 0.4874 | 0.3453 | 0.3694 | 0.6911 | 0.3114 | 0.7134 | 0.1447 | 0.5367 | 0.0688 | 0.336 | 0.0354 | 0.3763 | 0.1904 | 0.4744 | | 1.074 | 48.0 | 5112 | 1.2082 | 0.1495 | 0.2917 | 0.1343 | 0.0927 | 0.1293 | 0.2343 | 0.2247 | 0.4535 | 0.4956 | 0.346 | 0.396 | 0.712 | 0.3327 | 0.732 | 0.1477 | 0.5122 | 0.056 | 0.3498 | 0.0308 | 0.4237 | 0.1805 | 0.4602 | | 1.067 | 48.9953 | 5218 | 1.2123 | 0.165 | 0.3104 | 0.1467 | 0.0957 | 0.1188 | 0.2524 | 0.2522 | 0.4578 | 0.5 | 0.3661 | 0.3737 | 0.7116 | 0.3553 | 0.7291 | 0.1624 | 0.5286 | 0.0706 | 0.3417 | 0.0463 | 0.422 | 0.1902 | 0.4787 | | 1.0404 | 50.0 | 5325 | 1.2088 | 0.1569 | 0.3099 | 0.1328 | 0.1295 | 0.1105 | 0.2661 | 0.235 | 0.4425 | 0.4879 | 0.3104 | 0.3708 | 0.7181 | 0.3615 | 0.7273 | 0.1395 | 0.4796 | 0.0763 | 0.3597 | 0.0414 | 0.439 | 0.1658 | 0.4336 | | 1.052 | 50.9953 | 5431 | 1.1966 | 0.1676 | 0.3345 | 0.1453 | 0.1543 | 0.1219 | 0.2477 | 0.2439 | 0.4492 | 0.493 | 0.2986 | 0.387 | 0.72 | 0.3652 | 0.725 | 0.1442 | 0.502 | 0.0701 | 0.3578 | 0.0622 | 0.4119 | 0.1963 | 0.4682 | | 1.0249 | 52.0 | 5538 | 1.2046 | 0.1601 | 0.324 | 0.1455 | 0.0884 | 0.1159 | 0.2423 | 0.2383 | 0.4475 | 0.4907 | 0.3318 | 0.3694 | 0.7025 | 0.3368 | 0.7186 | 0.1664 | 0.4959 | 0.072 | 0.3758 | 0.0313 | 0.3915 | 0.1941 | 0.4716 | | 1.0286 | 52.9953 | 5644 | 1.2160 | 0.1732 | 0.3482 | 0.1486 | 0.0809 | 0.124 | 0.2539 | 0.2465 | 0.4497 | 0.4899 | 0.2724 | 0.3755 | 0.6934 | 0.3827 | 0.7192 | 0.1516 | 0.5061 | 0.0716 | 0.337 | 0.0494 | 0.4322 | 0.2107 | 0.455 | | 1.0085 | 54.0 | 5751 | 1.2242 | 0.169 | 0.3425 | 0.1446 | 0.0889 | 0.1154 | 0.2541 | 0.2335 | 0.4485 | 0.4852 | 0.3407 | 0.3658 | 0.6959 | 0.3834 | 0.718 | 0.1546 | 0.4959 | 0.0797 | 0.3365 | 0.0465 | 0.4373 | 0.1805 | 0.4384 | | 1.0105 | 54.9953 | 5857 | 1.1761 | 0.1885 | 0.3678 | 0.1675 | 0.1149 | 0.1313 | 0.2775 | 0.2653 | 0.4731 | 0.5102 | 0.3635 | 0.3872 | 0.724 | 0.4022 | 0.736 | 0.1799 | 0.5429 | 0.0971 | 0.3739 | 0.0536 | 0.4288 | 0.2098 | 0.4692 | | 0.9725 | 56.0 | 5964 | 1.2053 | 0.1867 | 0.3609 | 0.1665 | 0.2528 | 0.1335 | 0.2908 | 0.2491 | 0.4626 | 0.5064 | 0.3851 | 0.3879 | 0.7348 | 0.4134 | 0.7372 | 0.1765 | 0.5367 | 0.0808 | 0.3398 | 0.0615 | 0.4644 | 0.2013 | 0.454 | | 0.9825 | 56.9953 | 6070 | 1.1839 | 0.1857 | 0.361 | 0.1718 | 0.1396 | 0.1366 | 0.2957 | 0.2667 | 0.4622 | 0.5012 | 0.3591 | 0.3848 | 0.715 | 0.4079 | 0.7395 | 0.2112 | 0.5245 | 0.0823 | 0.3664 | 0.0412 | 0.4237 | 0.1858 | 0.4517 | | 0.9768 | 58.0 | 6177 | 1.1782 | 0.1909 | 0.3696 | 0.1677 | 0.1695 | 0.1316 | 0.3046 | 0.2637 | 0.4752 | 0.5143 | 0.3641 | 0.3965 | 0.7246 | 0.4094 | 0.7285 | 0.1889 | 0.5367 | 0.0866 | 0.3758 | 0.0526 | 0.4559 | 0.2171 | 0.4744 | | 0.9646 | 58.9953 | 6283 | 1.2234 | 0.1752 | 0.3522 | 0.1485 | 0.0982 | 0.1131 | 0.2967 | 0.2342 | 0.4388 | 0.4825 | 0.3028 | 0.3743 | 0.6903 | 0.4095 | 0.711 | 0.1621 | 0.4939 | 0.0666 | 0.3308 | 0.0441 | 0.4322 | 0.1937 | 0.4445 | | 0.9433 | 60.0 | 6390 | 1.1778 | 0.2039 | 0.3913 | 0.1795 | 0.1085 | 0.1387 | 0.3213 | 0.2627 | 0.4721 | 0.5035 | 0.3112 | 0.3827 | 0.7032 | 0.4448 | 0.7448 | 0.2013 | 0.5245 | 0.0995 | 0.3678 | 0.0554 | 0.422 | 0.2184 | 0.4583 | | 0.9539 | 60.9953 | 6496 | 1.1710 | 0.2142 | 0.3998 | 0.1909 | 0.0873 | 0.1439 | 0.3343 | 0.258 | 0.4688 | 0.5159 | 0.3227 | 0.3985 | 0.71 | 0.4632 | 0.7448 | 0.2376 | 0.5286 | 0.0976 | 0.3645 | 0.0512 | 0.4661 | 0.2214 | 0.4758 | | 0.9323 | 62.0 | 6603 | 1.1525 | 0.2241 | 0.4084 | 0.2017 | 0.1758 | 0.1621 | 0.3357 | 0.2827 | 0.4755 | 0.5187 | 0.3303 | 0.3996 | 0.7289 | 0.4692 | 0.7413 | 0.2387 | 0.5367 | 0.1032 | 0.3635 | 0.0586 | 0.4542 | 0.2508 | 0.4976 | | 0.9312 | 62.9953 | 6709 | 1.1400 | 0.2201 | 0.4184 | 0.1825 | 0.2621 | 0.1752 | 0.3242 | 0.2887 | 0.4916 | 0.531 | 0.4282 | 0.4101 | 0.7258 | 0.4556 | 0.7413 | 0.2209 | 0.5469 | 0.0957 | 0.3716 | 0.0663 | 0.4898 | 0.2622 | 0.5052 | | 0.9131 | 64.0 | 6816 | 1.1468 | 0.2239 | 0.4165 | 0.2042 | 0.2835 | 0.1687 | 0.3288 | 0.2852 | 0.4906 | 0.5291 | 0.4339 | 0.4064 | 0.7331 | 0.4363 | 0.7302 | 0.2399 | 0.5612 | 0.1086 | 0.3754 | 0.0774 | 0.4847 | 0.2575 | 0.4938 | | 0.924 | 64.9953 | 6922 | 1.1554 | 0.2301 | 0.4351 | 0.2124 | 0.239 | 0.1666 | 0.357 | 0.2763 | 0.4864 | 0.5214 | 0.3761 | 0.398 | 0.7455 | 0.4637 | 0.725 | 0.2383 | 0.5327 | 0.1101 | 0.3545 | 0.09 | 0.5017 | 0.2487 | 0.4934 | | 0.9114 | 66.0 | 7029 | 1.1486 | 0.2231 | 0.4351 | 0.2016 | 0.2949 | 0.1585 | 0.3553 | 0.2745 | 0.4848 | 0.5247 | 0.426 | 0.4126 | 0.7391 | 0.4658 | 0.7366 | 0.2095 | 0.5347 | 0.1104 | 0.3768 | 0.0835 | 0.4932 | 0.2465 | 0.482 | | 0.9218 | 66.9953 | 7135 | 1.1245 | 0.2343 | 0.4329 | 0.2067 | 0.2009 | 0.1752 | 0.3804 | 0.2929 | 0.4957 | 0.5349 | 0.3876 | 0.4202 | 0.7486 | 0.4825 | 0.7494 | 0.2458 | 0.549 | 0.1214 | 0.3915 | 0.0671 | 0.4831 | 0.2549 | 0.5014 | | 0.8886 | 68.0 | 7242 | 1.1260 | 0.236 | 0.4351 | 0.2162 | 0.2133 | 0.1619 | 0.3728 | 0.2844 | 0.4972 | 0.5283 | 0.3972 | 0.3923 | 0.7581 | 0.4756 | 0.7273 | 0.2387 | 0.549 | 0.1187 | 0.391 | 0.0872 | 0.4678 | 0.2601 | 0.5062 | | 0.898 | 68.9953 | 7348 | 1.1272 | 0.2419 | 0.4601 | 0.2178 | 0.2485 | 0.1736 | 0.3688 | 0.2919 | 0.4958 | 0.5333 | 0.3847 | 0.41 | 0.7582 | 0.4948 | 0.7314 | 0.2347 | 0.5388 | 0.1286 | 0.3938 | 0.0871 | 0.5 | 0.264 | 0.5024 | | 0.88 | 70.0 | 7455 | 1.1621 | 0.2398 | 0.4532 | 0.2123 | 0.2639 | 0.1676 | 0.3743 | 0.2785 | 0.4865 | 0.5151 | 0.3999 | 0.3942 | 0.7292 | 0.4905 | 0.7215 | 0.256 | 0.5408 | 0.1072 | 0.3526 | 0.0876 | 0.4746 | 0.2574 | 0.4858 | | 0.8868 | 70.9953 | 7561 | 1.1089 | 0.2574 | 0.4713 | 0.2332 | 0.2675 | 0.1874 | 0.392 | 0.2957 | 0.5025 | 0.5356 | 0.4084 | 0.4319 | 0.7417 | 0.5181 | 0.7413 | 0.2715 | 0.5571 | 0.13 | 0.3844 | 0.1029 | 0.5017 | 0.2642 | 0.4934 | | 0.876 | 72.0 | 7668 | 1.1296 | 0.2469 | 0.4705 | 0.2256 | 0.2927 | 0.1699 | 0.3973 | 0.2881 | 0.4892 | 0.5235 | 0.4206 | 0.4026 | 0.7447 | 0.5116 | 0.7314 | 0.2526 | 0.5653 | 0.1131 | 0.3739 | 0.1002 | 0.4542 | 0.257 | 0.4924 | | 0.8786 | 72.9953 | 7774 | 1.1189 | 0.2503 | 0.4775 | 0.2262 | 0.2579 | 0.1729 | 0.4036 | 0.2811 | 0.4968 | 0.5319 | 0.4364 | 0.4133 | 0.7461 | 0.5128 | 0.7308 | 0.2551 | 0.549 | 0.1207 | 0.3915 | 0.0923 | 0.4915 | 0.2707 | 0.4967 | | 0.8646 | 74.0 | 7881 | 1.1545 | 0.2503 | 0.4782 | 0.2289 | 0.2576 | 0.1648 | 0.4083 | 0.2792 | 0.4817 | 0.5187 | 0.4232 | 0.3924 | 0.7514 | 0.5224 | 0.7198 | 0.2514 | 0.5224 | 0.1166 | 0.3635 | 0.1066 | 0.5051 | 0.2547 | 0.4825 | | 0.8624 | 74.9953 | 7987 | 1.1148 | 0.2612 | 0.4931 | 0.2276 | 0.2794 | 0.1776 | 0.4119 | 0.2917 | 0.4974 | 0.5361 | 0.4242 | 0.4151 | 0.7662 | 0.5376 | 0.7401 | 0.2444 | 0.5633 | 0.1307 | 0.3848 | 0.1186 | 0.5119 | 0.275 | 0.4806 | | 0.838 | 76.0 | 8094 | 1.0995 | 0.2687 | 0.493 | 0.2477 | 0.2754 | 0.1831 | 0.4188 | 0.303 | 0.497 | 0.5302 | 0.3972 | 0.406 | 0.7602 | 0.5425 | 0.7349 | 0.2761 | 0.5367 | 0.1306 | 0.3991 | 0.1082 | 0.4915 | 0.2861 | 0.4886 | | 0.8483 | 76.9953 | 8200 | 1.1110 | 0.2698 | 0.4914 | 0.2511 | 0.1734 | 0.1845 | 0.4311 | 0.2965 | 0.4996 | 0.532 | 0.405 | 0.4092 | 0.7608 | 0.5616 | 0.7477 | 0.2642 | 0.5367 | 0.135 | 0.3924 | 0.1092 | 0.4966 | 0.2791 | 0.4867 | | 0.8413 | 78.0 | 8307 | 1.1064 | 0.2644 | 0.4912 | 0.2444 | 0.1873 | 0.1831 | 0.4319 | 0.2896 | 0.4983 | 0.5336 | 0.3939 | 0.4117 | 0.7562 | 0.5319 | 0.7343 | 0.2637 | 0.5265 | 0.1325 | 0.4095 | 0.1126 | 0.5 | 0.2812 | 0.4976 | | 0.8424 | 78.9953 | 8413 | 1.1112 | 0.2682 | 0.496 | 0.2498 | 0.1394 | 0.184 | 0.4279 | 0.2966 | 0.4985 | 0.5272 | 0.358 | 0.4079 | 0.7394 | 0.552 | 0.7395 | 0.2704 | 0.5429 | 0.1313 | 0.3815 | 0.1094 | 0.5 | 0.2779 | 0.472 | | 0.8277 | 80.0 | 8520 | 1.1451 | 0.2504 | 0.4758 | 0.2206 | 0.2244 | 0.1643 | 0.4229 | 0.2734 | 0.4878 | 0.517 | 0.3697 | 0.3882 | 0.7498 | 0.5308 | 0.7308 | 0.2379 | 0.5347 | 0.1187 | 0.373 | 0.0919 | 0.4678 | 0.2725 | 0.4787 | | 0.8269 | 80.9953 | 8626 | 1.1064 | 0.2697 | 0.5029 | 0.2497 | 0.2324 | 0.1932 | 0.4296 | 0.2832 | 0.5024 | 0.5379 | 0.3857 | 0.4293 | 0.7615 | 0.5475 | 0.7424 | 0.2713 | 0.5673 | 0.1481 | 0.3953 | 0.1 | 0.4898 | 0.2818 | 0.4948 | | 0.8159 | 82.0 | 8733 | 1.1055 | 0.2668 | 0.5022 | 0.2361 | 0.3082 | 0.1789 | 0.4284 | 0.2955 | 0.4975 | 0.5315 | 0.4478 | 0.4038 | 0.7377 | 0.5396 | 0.7267 | 0.2607 | 0.5429 | 0.1491 | 0.4024 | 0.1042 | 0.5051 | 0.2805 | 0.4806 | | 0.8195 | 82.9953 | 8839 | 1.1321 | 0.2674 | 0.505 | 0.2418 | 0.3007 | 0.1856 | 0.4311 | 0.289 | 0.4912 | 0.528 | 0.4278 | 0.4039 | 0.7507 | 0.5368 | 0.7267 | 0.2728 | 0.5633 | 0.1336 | 0.3863 | 0.1169 | 0.4898 | 0.2772 | 0.4739 | | 0.8138 | 84.0 | 8946 | 1.1110 | 0.2731 | 0.5061 | 0.2498 | 0.2881 | 0.192 | 0.44 | 0.2935 | 0.503 | 0.5382 | 0.4484 | 0.4141 | 0.7625 | 0.5537 | 0.7407 | 0.272 | 0.5796 | 0.1368 | 0.3863 | 0.1223 | 0.5 | 0.2808 | 0.4844 | | 0.8113 | 84.9953 | 9052 | 1.1105 | 0.2722 | 0.5054 | 0.255 | 0.2724 | 0.1862 | 0.4388 | 0.2906 | 0.4969 | 0.536 | 0.4272 | 0.412 | 0.7586 | 0.5428 | 0.7314 | 0.2666 | 0.5592 | 0.1484 | 0.4033 | 0.125 | 0.5051 | 0.2784 | 0.481 | | 0.808 | 86.0 | 9159 | 1.1130 | 0.2733 | 0.5056 | 0.253 | 0.2557 | 0.1873 | 0.4403 | 0.2926 | 0.502 | 0.5359 | 0.4107 | 0.4037 | 0.7613 | 0.5414 | 0.7384 | 0.2814 | 0.5612 | 0.1421 | 0.3948 | 0.1221 | 0.5085 | 0.2798 | 0.4768 | | 0.8052 | 86.9953 | 9265 | 1.1015 | 0.2786 | 0.5087 | 0.2612 | 0.2996 | 0.192 | 0.4411 | 0.2995 | 0.5082 | 0.5401 | 0.4446 | 0.4152 | 0.7531 | 0.555 | 0.7326 | 0.2882 | 0.5653 | 0.1422 | 0.4076 | 0.1207 | 0.5119 | 0.2867 | 0.4834 | | 0.7967 | 88.0 | 9372 | 1.1301 | 0.2689 | 0.5019 | 0.2442 | 0.3262 | 0.1843 | 0.4353 | 0.2939 | 0.4921 | 0.5253 | 0.452 | 0.3952 | 0.7619 | 0.5423 | 0.7279 | 0.2769 | 0.5612 | 0.1295 | 0.3668 | 0.1215 | 0.4983 | 0.2745 | 0.472 | | 0.7837 | 88.9953 | 9478 | 1.1018 | 0.276 | 0.5116 | 0.2489 | 0.2803 | 0.1919 | 0.4484 | 0.304 | 0.5015 | 0.5301 | 0.401 | 0.4065 | 0.7623 | 0.5529 | 0.7308 | 0.2728 | 0.549 | 0.153 | 0.4014 | 0.1207 | 0.4898 | 0.2806 | 0.4796 | | 0.7865 | 90.0 | 9585 | 1.1292 | 0.2712 | 0.5082 | 0.2462 | 0.2705 | 0.1855 | 0.4462 | 0.2898 | 0.494 | 0.524 | 0.3992 | 0.3985 | 0.7521 | 0.5493 | 0.7267 | 0.2821 | 0.5429 | 0.127 | 0.3673 | 0.1233 | 0.5085 | 0.2742 | 0.4744 | | 0.7882 | 90.9953 | 9691 | 1.1164 | 0.2766 | 0.5191 | 0.2477 | 0.3024 | 0.1952 | 0.4425 | 0.296 | 0.5001 | 0.529 | 0.4275 | 0.4097 | 0.751 | 0.5528 | 0.7308 | 0.2731 | 0.5347 | 0.1424 | 0.3848 | 0.1298 | 0.5119 | 0.2849 | 0.4829 | | 0.7887 | 92.0 | 9798 | 1.1070 | 0.2776 | 0.5169 | 0.2512 | 0.2553 | 0.1923 | 0.4504 | 0.2999 | 0.5033 | 0.5333 | 0.4005 | 0.4078 | 0.7665 | 0.5547 | 0.7343 | 0.2719 | 0.5449 | 0.1517 | 0.3962 | 0.1237 | 0.5068 | 0.2861 | 0.4844 | | 0.7905 | 92.9953 | 9904 | 1.0951 | 0.2753 | 0.5169 | 0.2526 | 0.2849 | 0.1916 | 0.4366 | 0.2928 | 0.504 | 0.54 | 0.4511 | 0.411 | 0.7577 | 0.5602 | 0.7337 | 0.2639 | 0.549 | 0.1435 | 0.4019 | 0.1204 | 0.5339 | 0.2884 | 0.4815 | | 0.7743 | 94.0 | 10011 | 1.0933 | 0.2819 | 0.521 | 0.2597 | 0.2878 | 0.1949 | 0.4462 | 0.2988 | 0.5049 | 0.541 | 0.4443 | 0.4101 | 0.772 | 0.572 | 0.7378 | 0.2717 | 0.551 | 0.1474 | 0.4043 | 0.1252 | 0.5254 | 0.2933 | 0.4867 | | 0.7762 | 94.9953 | 10117 | 1.1082 | 0.2785 | 0.5219 | 0.2596 | 0.2847 | 0.1917 | 0.4507 | 0.2935 | 0.4993 | 0.5339 | 0.4327 | 0.4051 | 0.7669 | 0.5695 | 0.7355 | 0.2691 | 0.5531 | 0.1402 | 0.3834 | 0.1218 | 0.5169 | 0.2921 | 0.4806 | | 0.7618 | 96.0 | 10224 | 1.1062 | 0.2774 | 0.5204 | 0.2555 | 0.287 | 0.1876 | 0.4483 | 0.2982 | 0.5005 | 0.532 | 0.436 | 0.4003 | 0.7614 | 0.5632 | 0.7326 | 0.2667 | 0.5408 | 0.1435 | 0.3938 | 0.1251 | 0.5153 | 0.2886 | 0.4777 | | 0.783 | 96.9953 | 10330 | 1.1082 | 0.279 | 0.523 | 0.2572 | 0.284 | 0.1949 | 0.4486 | 0.302 | 0.4993 | 0.5334 | 0.4331 | 0.4071 | 0.7629 | 0.5593 | 0.7308 | 0.2744 | 0.5531 | 0.1447 | 0.3915 | 0.1238 | 0.5085 | 0.293 | 0.4834 | | 0.7681 | 98.0 | 10437 | 1.0984 | 0.2819 | 0.5263 | 0.257 | 0.288 | 0.1948 | 0.4534 | 0.304 | 0.503 | 0.5368 | 0.4351 | 0.413 | 0.7653 | 0.5622 | 0.7326 | 0.277 | 0.549 | 0.1479 | 0.3957 | 0.129 | 0.5169 | 0.2933 | 0.4896 | | 0.7742 | 98.9953 | 10543 | 1.1026 | 0.2806 | 0.5263 | 0.2569 | 0.2889 | 0.1948 | 0.4543 | 0.3014 | 0.5012 | 0.5341 | 0.4352 | 0.4077 | 0.7639 | 0.5568 | 0.732 | 0.2749 | 0.549 | 0.1484 | 0.3948 | 0.1271 | 0.5102 | 0.2957 | 0.4848 | | 0.7654 | 99.5305 | 10600 | 1.1028 | 0.2808 | 0.5257 | 0.2589 | 0.2879 | 0.1953 | 0.4546 | 0.3004 | 0.5007 | 0.534 | 0.4339 | 0.4079 | 0.7629 | 0.5566 | 0.7331 | 0.2761 | 0.549 | 0.1484 | 0.3943 | 0.1271 | 0.5085 | 0.2956 | 0.4853 | ### Framework versions - Transformers 4.40.0.dev0 - Pytorch 1.13.0+cu117 - Datasets 2.18.0 - Tokenizers 0.19.0