File size: 37,210 Bytes
e62a092 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 |
---
license: apache-2.0
base_model: SenseTime/deformable-detr
tags:
- generated_from_trainer
model-index:
- name: sensetime-deformable-detr-finetuned-10k-cppe5-more-augs
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/qubvel-hf-co/tuning-sota-cppe5/runs/2jpwvl0x)
# sensetime-deformable-detr-finetuned-10k-cppe5-more-augs
This model is a fine-tuned version of [SenseTime/deformable-detr](https://huggingface.co/SenseTime/deformable-detr) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.9911
- Map: 0.3714
- Map 50: 0.6742
- Map 75: 0.3545
- Map Small: 0.226
- Map Medium: 0.2836
- Map Large: 0.5849
- Mar 1: 0.3191
- Mar 10: 0.502
- Mar 100: 0.5266
- Mar Small: 0.3445
- Mar Medium: 0.4443
- Mar Large: 0.7237
- Map Coverall: 0.5834
- Mar 100 Coverall: 0.6797
- Map Face Shield: 0.3648
- Mar 100 Face Shield: 0.5241
- Map Gloves: 0.3122
- Mar 100 Gloves: 0.5071
- Map Goggles: 0.2315
- Mar 100 Goggles: 0.4338
- Map Mask: 0.3649
- Mar 100 Mask: 0.4884
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 8
- seed: 1337
- gradient_accumulation_steps: 2
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-------:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 8.5293 | 0.9953 | 106 | 1.7296 | 0.0265 | 0.0666 | 0.0164 | 0.0103 | 0.0138 | 0.0516 | 0.0559 | 0.1869 | 0.2518 | 0.0592 | 0.2249 | 0.3316 | 0.0774 | 0.514 | 0.0017 | 0.1671 | 0.0136 | 0.2487 | 0.0006 | 0.0815 | 0.0392 | 0.2476 |
| 1.5394 | 2.0 | 213 | 1.5095 | 0.0359 | 0.0836 | 0.0262 | 0.0293 | 0.0264 | 0.0769 | 0.0626 | 0.2334 | 0.2933 | 0.1525 | 0.2717 | 0.3217 | 0.0785 | 0.555 | 0.0028 | 0.1886 | 0.0201 | 0.2732 | 0.0011 | 0.0908 | 0.0769 | 0.3591 |
| 1.3761 | 2.9953 | 319 | 1.5410 | 0.0604 | 0.123 | 0.0555 | 0.0256 | 0.036 | 0.0604 | 0.0966 | 0.2526 | 0.2998 | 0.0803 | 0.258 | 0.4789 | 0.1865 | 0.5874 | 0.0016 | 0.1177 | 0.0185 | 0.2812 | 0.0026 | 0.1569 | 0.0928 | 0.3556 |
| 1.2615 | 4.0 | 426 | 1.3671 | 0.0888 | 0.1756 | 0.0873 | 0.043 | 0.058 | 0.1298 | 0.1317 | 0.3164 | 0.3635 | 0.1763 | 0.3076 | 0.5184 | 0.2402 | 0.6176 | 0.0094 | 0.2759 | 0.0577 | 0.3406 | 0.0097 | 0.2031 | 0.1273 | 0.3804 |
| 1.2042 | 4.9953 | 532 | 1.2824 | 0.1069 | 0.2127 | 0.101 | 0.0374 | 0.075 | 0.1509 | 0.1626 | 0.3623 | 0.4001 | 0.1967 | 0.3445 | 0.5716 | 0.2957 | 0.6477 | 0.0247 | 0.3342 | 0.0617 | 0.3442 | 0.0194 | 0.2477 | 0.1331 | 0.4267 |
| 1.1568 | 6.0 | 639 | 1.2616 | 0.124 | 0.2451 | 0.117 | 0.0346 | 0.098 | 0.2056 | 0.1652 | 0.3623 | 0.3997 | 0.2053 | 0.3386 | 0.5458 | 0.3583 | 0.6477 | 0.0184 | 0.2823 | 0.0803 | 0.3799 | 0.0102 | 0.2369 | 0.1528 | 0.4516 |
| 1.1207 | 6.9953 | 745 | 1.2273 | 0.1506 | 0.291 | 0.1409 | 0.0686 | 0.1205 | 0.224 | 0.1843 | 0.3925 | 0.4294 | 0.252 | 0.385 | 0.5833 | 0.4045 | 0.6541 | 0.0588 | 0.3506 | 0.086 | 0.404 | 0.014 | 0.2738 | 0.1897 | 0.4644 |
| 1.0994 | 8.0 | 852 | 1.1945 | 0.1725 | 0.3216 | 0.1674 | 0.076 | 0.1565 | 0.242 | 0.2047 | 0.4149 | 0.4486 | 0.2657 | 0.3955 | 0.6151 | 0.4191 | 0.6739 | 0.0764 | 0.3848 | 0.0904 | 0.3902 | 0.0539 | 0.3338 | 0.2226 | 0.4604 |
| 1.0347 | 8.9953 | 958 | 1.1692 | 0.1923 | 0.3626 | 0.1728 | 0.0719 | 0.1544 | 0.2953 | 0.2277 | 0.4381 | 0.4654 | 0.2678 | 0.3933 | 0.6539 | 0.4415 | 0.6595 | 0.0846 | 0.4278 | 0.1251 | 0.4179 | 0.0711 | 0.3492 | 0.2391 | 0.4724 |
| 1.0089 | 10.0 | 1065 | 1.1513 | 0.2033 | 0.3793 | 0.1906 | 0.0771 | 0.1521 | 0.317 | 0.2301 | 0.4234 | 0.4558 | 0.2662 | 0.3725 | 0.6609 | 0.451 | 0.6441 | 0.1041 | 0.3987 | 0.1202 | 0.4237 | 0.0738 | 0.3231 | 0.2676 | 0.4893 |
| 1.0118 | 10.9953 | 1171 | 1.1533 | 0.2141 | 0.408 | 0.1966 | 0.0794 | 0.1793 | 0.3118 | 0.2235 | 0.4187 | 0.458 | 0.2509 | 0.3958 | 0.6438 | 0.4976 | 0.6775 | 0.0865 | 0.4494 | 0.1302 | 0.4045 | 0.0835 | 0.2969 | 0.2726 | 0.4618 |
| 0.995 | 12.0 | 1278 | 1.1530 | 0.2198 | 0.4281 | 0.2038 | 0.1102 | 0.168 | 0.3425 | 0.2464 | 0.4322 | 0.4683 | 0.2781 | 0.3951 | 0.6383 | 0.4638 | 0.6595 | 0.1443 | 0.4544 | 0.1525 | 0.4473 | 0.0843 | 0.3123 | 0.2539 | 0.468 |
| 0.9732 | 12.9953 | 1384 | 1.1279 | 0.232 | 0.4426 | 0.2192 | 0.0938 | 0.1726 | 0.3843 | 0.25 | 0.448 | 0.4811 | 0.2912 | 0.4102 | 0.6636 | 0.4878 | 0.655 | 0.1329 | 0.4785 | 0.1618 | 0.4272 | 0.09 | 0.3538 | 0.2876 | 0.4911 |
| 0.9398 | 14.0 | 1491 | 1.1457 | 0.2351 | 0.4554 | 0.2215 | 0.1128 | 0.174 | 0.4144 | 0.2565 | 0.4372 | 0.4627 | 0.2462 | 0.3896 | 0.688 | 0.5015 | 0.6554 | 0.1352 | 0.5203 | 0.1645 | 0.4165 | 0.1219 | 0.3031 | 0.2522 | 0.4182 |
| 0.9281 | 14.9953 | 1597 | 1.1128 | 0.2545 | 0.4835 | 0.2451 | 0.1241 | 0.2078 | 0.3884 | 0.2638 | 0.4494 | 0.4776 | 0.2831 | 0.4274 | 0.6403 | 0.4969 | 0.6563 | 0.1496 | 0.4734 | 0.195 | 0.4353 | 0.1352 | 0.3554 | 0.2958 | 0.4676 |
| 0.9162 | 16.0 | 1704 | 1.1145 | 0.2482 | 0.4755 | 0.2398 | 0.1053 | 0.2017 | 0.4362 | 0.2749 | 0.4637 | 0.4867 | 0.2986 | 0.4219 | 0.6875 | 0.4836 | 0.6743 | 0.1557 | 0.4848 | 0.1714 | 0.433 | 0.1453 | 0.3554 | 0.2851 | 0.4858 |
| 0.9038 | 16.9953 | 1810 | 1.0968 | 0.2746 | 0.5143 | 0.2687 | 0.167 | 0.2122 | 0.4583 | 0.2825 | 0.4576 | 0.4827 | 0.2696 | 0.4182 | 0.6881 | 0.5159 | 0.6509 | 0.1481 | 0.457 | 0.2179 | 0.4509 | 0.1544 | 0.3631 | 0.3367 | 0.4916 |
| 0.8973 | 18.0 | 1917 | 1.0895 | 0.2688 | 0.5085 | 0.2595 | 0.1549 | 0.2178 | 0.4381 | 0.2743 | 0.4561 | 0.481 | 0.2921 | 0.4282 | 0.6551 | 0.5211 | 0.6617 | 0.1517 | 0.4481 | 0.1978 | 0.4384 | 0.1679 | 0.3892 | 0.3053 | 0.4676 |
| 0.892 | 18.9953 | 2023 | 1.0987 | 0.2736 | 0.5209 | 0.2565 | 0.1568 | 0.2152 | 0.4343 | 0.2802 | 0.4541 | 0.482 | 0.2782 | 0.4233 | 0.6792 | 0.5088 | 0.6518 | 0.187 | 0.5025 | 0.1949 | 0.4187 | 0.1581 | 0.3692 | 0.3194 | 0.4676 |
| 0.8851 | 20.0 | 2130 | 1.0649 | 0.2813 | 0.5321 | 0.2756 | 0.1914 | 0.2223 | 0.4563 | 0.2901 | 0.4698 | 0.4932 | 0.3123 | 0.4281 | 0.6792 | 0.5127 | 0.6532 | 0.17 | 0.4924 | 0.223 | 0.4576 | 0.1749 | 0.3846 | 0.3261 | 0.4782 |
| 0.8862 | 20.9953 | 2236 | 1.0438 | 0.2999 | 0.5575 | 0.2865 | 0.1862 | 0.2439 | 0.4748 | 0.2862 | 0.4739 | 0.4955 | 0.2754 | 0.4518 | 0.6711 | 0.558 | 0.6874 | 0.1831 | 0.5 | 0.2399 | 0.4504 | 0.1933 | 0.3723 | 0.3251 | 0.4671 |
| 0.8636 | 22.0 | 2343 | 1.0833 | 0.2853 | 0.5355 | 0.2675 | 0.192 | 0.2404 | 0.4267 | 0.271 | 0.4606 | 0.4886 | 0.3272 | 0.4255 | 0.637 | 0.5164 | 0.6748 | 0.204 | 0.4823 | 0.2425 | 0.4688 | 0.1493 | 0.3631 | 0.3145 | 0.4542 |
| 0.8638 | 22.9953 | 2449 | 1.0502 | 0.296 | 0.5487 | 0.2823 | 0.1887 | 0.2344 | 0.475 | 0.2926 | 0.4802 | 0.5039 | 0.3273 | 0.4325 | 0.6911 | 0.5345 | 0.6752 | 0.2049 | 0.4949 | 0.2274 | 0.4589 | 0.1935 | 0.4108 | 0.32 | 0.4796 |
| 0.8337 | 24.0 | 2556 | 1.0479 | 0.2998 | 0.5571 | 0.2814 | 0.152 | 0.2356 | 0.4876 | 0.2856 | 0.4771 | 0.4998 | 0.2975 | 0.4335 | 0.704 | 0.5409 | 0.6707 | 0.2135 | 0.4633 | 0.2491 | 0.4518 | 0.1759 | 0.4246 | 0.3197 | 0.4884 |
| 0.8504 | 24.9953 | 2662 | 1.0265 | 0.3073 | 0.5537 | 0.3079 | 0.1999 | 0.2561 | 0.4489 | 0.2932 | 0.4857 | 0.5159 | 0.3003 | 0.4643 | 0.6932 | 0.5294 | 0.6991 | 0.2215 | 0.5076 | 0.2618 | 0.4674 | 0.1766 | 0.4123 | 0.3472 | 0.4929 |
| 0.8299 | 26.0 | 2769 | 1.0412 | 0.308 | 0.5736 | 0.299 | 0.2122 | 0.2355 | 0.4804 | 0.2938 | 0.4854 | 0.5069 | 0.3271 | 0.4385 | 0.6925 | 0.5397 | 0.6712 | 0.2425 | 0.5139 | 0.2551 | 0.4598 | 0.1792 | 0.4046 | 0.3235 | 0.4849 |
| 0.8284 | 26.9953 | 2875 | 1.0276 | 0.3105 | 0.5678 | 0.2962 | 0.2051 | 0.2464 | 0.469 | 0.2956 | 0.4851 | 0.513 | 0.3045 | 0.4736 | 0.6767 | 0.5523 | 0.6833 | 0.2282 | 0.5139 | 0.2525 | 0.4679 | 0.185 | 0.3969 | 0.3346 | 0.5031 |
| 0.8092 | 28.0 | 2982 | 1.0400 | 0.309 | 0.573 | 0.2986 | 0.1643 | 0.2486 | 0.479 | 0.2934 | 0.4887 | 0.5072 | 0.2957 | 0.4481 | 0.6842 | 0.5404 | 0.6743 | 0.2025 | 0.5063 | 0.2585 | 0.4554 | 0.1976 | 0.4092 | 0.346 | 0.4907 |
| 0.8156 | 28.9953 | 3088 | 1.0271 | 0.3208 | 0.5894 | 0.305 | 0.2031 | 0.2619 | 0.4853 | 0.3051 | 0.5006 | 0.5193 | 0.3246 | 0.4605 | 0.7046 | 0.5503 | 0.6833 | 0.2421 | 0.5076 | 0.2555 | 0.467 | 0.2047 | 0.4323 | 0.3513 | 0.5062 |
| 0.8037 | 30.0 | 3195 | 1.0355 | 0.3162 | 0.5986 | 0.295 | 0.1994 | 0.2532 | 0.4821 | 0.2986 | 0.4877 | 0.5097 | 0.286 | 0.4508 | 0.6977 | 0.5315 | 0.6595 | 0.2647 | 0.4924 | 0.2635 | 0.4647 | 0.188 | 0.4508 | 0.3335 | 0.4809 |
| 0.797 | 30.9953 | 3301 | 1.0333 | 0.3091 | 0.5947 | 0.2852 | 0.1864 | 0.2525 | 0.4721 | 0.2971 | 0.4774 | 0.5051 | 0.2963 | 0.4411 | 0.6837 | 0.5442 | 0.6788 | 0.2436 | 0.4975 | 0.2568 | 0.4714 | 0.1677 | 0.4092 | 0.3331 | 0.4684 |
| 0.7778 | 32.0 | 3408 | 1.0285 | 0.3325 | 0.6019 | 0.3123 | 0.2079 | 0.262 | 0.5106 | 0.304 | 0.4879 | 0.5138 | 0.3375 | 0.4535 | 0.7007 | 0.5546 | 0.6784 | 0.3003 | 0.5342 | 0.2837 | 0.4719 | 0.2064 | 0.4092 | 0.3176 | 0.4756 |
| 0.7839 | 32.9953 | 3514 | 1.0155 | 0.3302 | 0.6038 | 0.3114 | 0.2003 | 0.2756 | 0.4914 | 0.3 | 0.4923 | 0.5099 | 0.3212 | 0.4624 | 0.6844 | 0.5733 | 0.6955 | 0.2739 | 0.4987 | 0.2816 | 0.4808 | 0.1803 | 0.3969 | 0.342 | 0.4778 |
| 0.7687 | 34.0 | 3621 | 1.0158 | 0.3284 | 0.6116 | 0.2986 | 0.2103 | 0.2695 | 0.4791 | 0.2998 | 0.4992 | 0.5258 | 0.3411 | 0.4725 | 0.7092 | 0.5692 | 0.6959 | 0.2751 | 0.5304 | 0.2654 | 0.4746 | 0.1916 | 0.4462 | 0.3409 | 0.4818 |
| 0.7798 | 34.9953 | 3727 | 1.0094 | 0.3286 | 0.5951 | 0.3134 | 0.1983 | 0.2685 | 0.5138 | 0.301 | 0.4942 | 0.5227 | 0.3001 | 0.4738 | 0.7313 | 0.5752 | 0.7009 | 0.2566 | 0.5367 | 0.2753 | 0.4902 | 0.203 | 0.4108 | 0.3327 | 0.4751 |
| 0.7476 | 36.0 | 3834 | 1.0584 | 0.3212 | 0.5923 | 0.291 | 0.1856 | 0.2576 | 0.5242 | 0.3008 | 0.4828 | 0.5067 | 0.3268 | 0.4238 | 0.7241 | 0.5335 | 0.6509 | 0.2728 | 0.4987 | 0.2713 | 0.479 | 0.1889 | 0.4292 | 0.3393 | 0.4756 |
| 0.758 | 36.9953 | 3940 | 1.0163 | 0.3381 | 0.6177 | 0.3258 | 0.2113 | 0.2655 | 0.5359 | 0.3041 | 0.4926 | 0.5221 | 0.3397 | 0.4575 | 0.7092 | 0.5643 | 0.6802 | 0.2738 | 0.5139 | 0.2752 | 0.496 | 0.2291 | 0.4277 | 0.3483 | 0.4929 |
| 0.7328 | 38.0 | 4047 | 1.0104 | 0.3349 | 0.6295 | 0.3152 | 0.2034 | 0.2794 | 0.5199 | 0.2966 | 0.5007 | 0.5226 | 0.314 | 0.4783 | 0.6913 | 0.5632 | 0.6856 | 0.2802 | 0.5228 | 0.2773 | 0.4942 | 0.2194 | 0.4262 | 0.3344 | 0.4844 |
| 0.7374 | 38.9953 | 4153 | 1.0134 | 0.3422 | 0.6331 | 0.3235 | 0.204 | 0.2763 | 0.5299 | 0.3076 | 0.4982 | 0.5229 | 0.3264 | 0.4727 | 0.7249 | 0.5615 | 0.6757 | 0.3006 | 0.5215 | 0.2717 | 0.4844 | 0.2348 | 0.4446 | 0.3427 | 0.4884 |
| 0.7173 | 40.0 | 4260 | 1.0198 | 0.334 | 0.6183 | 0.3207 | 0.1992 | 0.2761 | 0.5124 | 0.305 | 0.4893 | 0.5111 | 0.3233 | 0.4566 | 0.697 | 0.5651 | 0.6802 | 0.2821 | 0.5253 | 0.261 | 0.4621 | 0.2182 | 0.4046 | 0.3437 | 0.4831 |
| 0.7148 | 40.9953 | 4366 | 0.9978 | 0.3482 | 0.6318 | 0.342 | 0.2046 | 0.2859 | 0.5363 | 0.3085 | 0.5022 | 0.5245 | 0.3357 | 0.4768 | 0.7011 | 0.574 | 0.6955 | 0.3025 | 0.5304 | 0.284 | 0.4938 | 0.229 | 0.42 | 0.3517 | 0.4831 |
| 0.7127 | 42.0 | 4473 | 1.0042 | 0.3485 | 0.6345 | 0.3259 | 0.2234 | 0.2791 | 0.5416 | 0.3111 | 0.4972 | 0.5216 | 0.3453 | 0.4666 | 0.7047 | 0.5772 | 0.6856 | 0.3145 | 0.538 | 0.2813 | 0.479 | 0.2297 | 0.4369 | 0.3399 | 0.4684 |
| 0.7189 | 42.9953 | 4579 | 0.9994 | 0.3444 | 0.6235 | 0.3368 | 0.2151 | 0.2735 | 0.5286 | 0.3104 | 0.5028 | 0.5274 | 0.3398 | 0.4767 | 0.6915 | 0.5846 | 0.6923 | 0.3048 | 0.5241 | 0.2814 | 0.4871 | 0.2047 | 0.44 | 0.3467 | 0.4933 |
| 0.7085 | 44.0 | 4686 | 1.0234 | 0.3415 | 0.6232 | 0.3203 | 0.2001 | 0.271 | 0.5241 | 0.3101 | 0.4907 | 0.5137 | 0.3153 | 0.4478 | 0.6936 | 0.5731 | 0.6811 | 0.3072 | 0.5152 | 0.2762 | 0.4799 | 0.2148 | 0.4185 | 0.3363 | 0.4738 |
| 0.6929 | 44.9953 | 4792 | 1.0076 | 0.3564 | 0.6437 | 0.3355 | 0.2144 | 0.2869 | 0.538 | 0.3097 | 0.4962 | 0.5197 | 0.3187 | 0.4774 | 0.7046 | 0.5891 | 0.7 | 0.3213 | 0.5139 | 0.2797 | 0.4746 | 0.2404 | 0.4246 | 0.3516 | 0.4853 |
| 0.6949 | 46.0 | 4899 | 1.0051 | 0.3548 | 0.6513 | 0.3319 | 0.2273 | 0.2876 | 0.5374 | 0.3102 | 0.5104 | 0.5319 | 0.3603 | 0.4717 | 0.7153 | 0.5864 | 0.6995 | 0.3127 | 0.5241 | 0.2817 | 0.4982 | 0.2386 | 0.4385 | 0.3546 | 0.4991 |
| 0.6895 | 46.9953 | 5005 | 1.0220 | 0.3454 | 0.6389 | 0.3235 | 0.2023 | 0.2764 | 0.5265 | 0.3074 | 0.49 | 0.5133 | 0.3227 | 0.4464 | 0.7115 | 0.5772 | 0.6887 | 0.3159 | 0.5127 | 0.2738 | 0.4839 | 0.2054 | 0.3938 | 0.3547 | 0.4876 |
| 0.6709 | 48.0 | 5112 | 1.0272 | 0.3473 | 0.6374 | 0.3205 | 0.2262 | 0.2689 | 0.527 | 0.3029 | 0.4893 | 0.5139 | 0.3524 | 0.431 | 0.7094 | 0.5839 | 0.6793 | 0.3089 | 0.4949 | 0.2779 | 0.4879 | 0.2197 | 0.4338 | 0.3461 | 0.4733 |
| 0.7002 | 48.9953 | 5218 | 1.0188 | 0.349 | 0.645 | 0.3255 | 0.2188 | 0.2713 | 0.5228 | 0.3034 | 0.4888 | 0.5107 | 0.3435 | 0.4357 | 0.6984 | 0.5732 | 0.6788 | 0.316 | 0.4873 | 0.2867 | 0.4938 | 0.2202 | 0.4185 | 0.3488 | 0.4751 |
| 0.6732 | 50.0 | 5325 | 1.0171 | 0.35 | 0.6378 | 0.3213 | 0.2193 | 0.2835 | 0.5176 | 0.3053 | 0.4928 | 0.5157 | 0.3323 | 0.4532 | 0.7 | 0.5792 | 0.682 | 0.3271 | 0.4937 | 0.2805 | 0.4897 | 0.2054 | 0.4231 | 0.3579 | 0.4902 |
| 0.6866 | 50.9953 | 5431 | 1.0090 | 0.3538 | 0.6428 | 0.3434 | 0.2264 | 0.2822 | 0.5369 | 0.3131 | 0.5026 | 0.5245 | 0.3388 | 0.4515 | 0.7113 | 0.5798 | 0.6883 | 0.3469 | 0.5203 | 0.2896 | 0.5009 | 0.2072 | 0.4462 | 0.3458 | 0.4667 |
| 0.6538 | 52.0 | 5538 | 1.0059 | 0.3516 | 0.6406 | 0.3322 | 0.2332 | 0.2843 | 0.5078 | 0.314 | 0.5022 | 0.5281 | 0.3696 | 0.4706 | 0.6918 | 0.5761 | 0.6793 | 0.3438 | 0.5203 | 0.2854 | 0.5058 | 0.2064 | 0.4554 | 0.3465 | 0.4796 |
| 0.6531 | 52.9953 | 5644 | 1.0035 | 0.3628 | 0.6559 | 0.3368 | 0.2265 | 0.293 | 0.5513 | 0.3135 | 0.501 | 0.5225 | 0.3514 | 0.4637 | 0.715 | 0.5788 | 0.6901 | 0.3587 | 0.5228 | 0.2939 | 0.4906 | 0.2326 | 0.4323 | 0.3498 | 0.4764 |
| 0.6406 | 54.0 | 5751 | 0.9991 | 0.3588 | 0.6417 | 0.3544 | 0.2267 | 0.2905 | 0.5306 | 0.3222 | 0.5071 | 0.5287 | 0.351 | 0.4625 | 0.7189 | 0.5678 | 0.6784 | 0.3426 | 0.5038 | 0.2858 | 0.4933 | 0.2254 | 0.4662 | 0.3725 | 0.5018 |
| 0.657 | 54.9953 | 5857 | 1.0076 | 0.3542 | 0.6512 | 0.339 | 0.2209 | 0.2857 | 0.538 | 0.3069 | 0.5015 | 0.5231 | 0.3524 | 0.4679 | 0.7062 | 0.5718 | 0.6784 | 0.3414 | 0.5177 | 0.2952 | 0.4996 | 0.2124 | 0.4385 | 0.3501 | 0.4813 |
| 0.6402 | 56.0 | 5964 | 0.9918 | 0.3605 | 0.652 | 0.3421 | 0.2311 | 0.2913 | 0.5183 | 0.3186 | 0.5075 | 0.5283 | 0.3531 | 0.4621 | 0.7194 | 0.5814 | 0.6919 | 0.339 | 0.5203 | 0.2968 | 0.4996 | 0.2286 | 0.4369 | 0.357 | 0.4929 |
| 0.6484 | 56.9953 | 6070 | 0.9921 | 0.3573 | 0.649 | 0.3516 | 0.2157 | 0.2891 | 0.5269 | 0.3079 | 0.4988 | 0.5203 | 0.3319 | 0.4464 | 0.7003 | 0.5739 | 0.686 | 0.3577 | 0.5228 | 0.2922 | 0.4964 | 0.2123 | 0.4169 | 0.3501 | 0.4791 |
| 0.6532 | 58.0 | 6177 | 1.0018 | 0.358 | 0.6383 | 0.3572 | 0.2156 | 0.2825 | 0.5278 | 0.3075 | 0.4984 | 0.5223 | 0.331 | 0.4471 | 0.6955 | 0.5757 | 0.6838 | 0.3443 | 0.5127 | 0.2947 | 0.5009 | 0.2097 | 0.4277 | 0.3656 | 0.4867 |
| 0.6334 | 58.9953 | 6283 | 1.0088 | 0.3543 | 0.6515 | 0.3324 | 0.2214 | 0.2868 | 0.5213 | 0.3055 | 0.4962 | 0.5197 | 0.3428 | 0.4442 | 0.7049 | 0.571 | 0.6802 | 0.3352 | 0.5076 | 0.2883 | 0.4862 | 0.2197 | 0.4431 | 0.3572 | 0.4813 |
| 0.6236 | 60.0 | 6390 | 0.9933 | 0.3612 | 0.6485 | 0.3449 | 0.2121 | 0.2941 | 0.523 | 0.3161 | 0.5046 | 0.5262 | 0.3305 | 0.4712 | 0.7022 | 0.5812 | 0.6905 | 0.345 | 0.519 | 0.2932 | 0.4978 | 0.2336 | 0.4477 | 0.3528 | 0.476 |
| 0.6294 | 60.9953 | 6496 | 0.9987 | 0.3579 | 0.652 | 0.3353 | 0.2127 | 0.2929 | 0.5445 | 0.3108 | 0.4964 | 0.5231 | 0.3383 | 0.4649 | 0.7097 | 0.5713 | 0.6815 | 0.3413 | 0.5127 | 0.3004 | 0.4955 | 0.2301 | 0.4538 | 0.3466 | 0.472 |
| 0.6214 | 62.0 | 6603 | 1.0151 | 0.3581 | 0.6551 | 0.3316 | 0.2173 | 0.2886 | 0.549 | 0.3136 | 0.4965 | 0.513 | 0.3241 | 0.4447 | 0.7 | 0.5721 | 0.6707 | 0.3341 | 0.4911 | 0.2976 | 0.4938 | 0.2294 | 0.4246 | 0.3571 | 0.4849 |
| 0.6336 | 62.9953 | 6709 | 1.0027 | 0.3592 | 0.658 | 0.3345 | 0.2247 | 0.2869 | 0.5429 | 0.3145 | 0.4986 | 0.5246 | 0.334 | 0.4603 | 0.7119 | 0.5739 | 0.682 | 0.3459 | 0.5342 | 0.2995 | 0.4996 | 0.2242 | 0.4262 | 0.3524 | 0.4813 |
| 0.621 | 64.0 | 6816 | 1.0044 | 0.3609 | 0.6589 | 0.3461 | 0.2236 | 0.2818 | 0.5455 | 0.3162 | 0.4982 | 0.5221 | 0.3418 | 0.462 | 0.7027 | 0.5796 | 0.6865 | 0.3514 | 0.5228 | 0.2969 | 0.5013 | 0.2149 | 0.4108 | 0.3615 | 0.4889 |
| 0.6101 | 64.9953 | 6922 | 1.0033 | 0.3676 | 0.668 | 0.3447 | 0.2296 | 0.2977 | 0.5585 | 0.3226 | 0.4976 | 0.5239 | 0.3524 | 0.4703 | 0.7025 | 0.5679 | 0.6842 | 0.3594 | 0.5152 | 0.3062 | 0.4942 | 0.2428 | 0.4338 | 0.3615 | 0.492 |
| 0.6076 | 66.0 | 7029 | 0.9941 | 0.3689 | 0.6645 | 0.3522 | 0.2319 | 0.2985 | 0.5601 | 0.3186 | 0.5003 | 0.5252 | 0.3508 | 0.4711 | 0.6945 | 0.5753 | 0.6905 | 0.3515 | 0.5101 | 0.3076 | 0.5058 | 0.2471 | 0.4338 | 0.3631 | 0.4858 |
| 0.6004 | 66.9953 | 7135 | 0.9888 | 0.3638 | 0.6631 | 0.3417 | 0.2283 | 0.3053 | 0.5454 | 0.31 | 0.499 | 0.5247 | 0.3405 | 0.4752 | 0.6956 | 0.5704 | 0.6847 | 0.3435 | 0.5089 | 0.3084 | 0.5045 | 0.2381 | 0.4462 | 0.3585 | 0.4791 |
| 0.5985 | 68.0 | 7242 | 0.9908 | 0.3642 | 0.6615 | 0.34 | 0.227 | 0.2876 | 0.541 | 0.3139 | 0.4954 | 0.5252 | 0.3562 | 0.4679 | 0.694 | 0.5786 | 0.6919 | 0.3348 | 0.4987 | 0.3017 | 0.4924 | 0.232 | 0.4431 | 0.3737 | 0.5 |
| 0.5962 | 68.9953 | 7348 | 0.9841 | 0.3689 | 0.6699 | 0.3442 | 0.2293 | 0.2957 | 0.5557 | 0.3212 | 0.5088 | 0.5314 | 0.3522 | 0.4687 | 0.7093 | 0.5826 | 0.6865 | 0.363 | 0.5215 | 0.3027 | 0.5018 | 0.2322 | 0.4585 | 0.364 | 0.4889 |
| 0.5967 | 70.0 | 7455 | 1.0001 | 0.3636 | 0.6702 | 0.3307 | 0.2242 | 0.29 | 0.5608 | 0.3134 | 0.4967 | 0.5249 | 0.3454 | 0.4636 | 0.7088 | 0.5712 | 0.686 | 0.3459 | 0.5177 | 0.3085 | 0.5089 | 0.2384 | 0.4354 | 0.3539 | 0.4764 |
| 0.5867 | 70.9953 | 7561 | 0.9964 | 0.3622 | 0.6648 | 0.3244 | 0.2245 | 0.2915 | 0.5393 | 0.3143 | 0.4964 | 0.5191 | 0.3377 | 0.4607 | 0.6897 | 0.5824 | 0.6865 | 0.3328 | 0.5101 | 0.3052 | 0.5004 | 0.2342 | 0.4308 | 0.3566 | 0.4676 |
| 0.5868 | 72.0 | 7668 | 0.9980 | 0.3643 | 0.665 | 0.3393 | 0.2257 | 0.2947 | 0.5463 | 0.3163 | 0.5009 | 0.5215 | 0.3281 | 0.4579 | 0.6978 | 0.586 | 0.6869 | 0.3453 | 0.5089 | 0.3085 | 0.5013 | 0.2219 | 0.4246 | 0.3597 | 0.4858 |
| 0.5774 | 72.9953 | 7774 | 0.9955 | 0.3707 | 0.6702 | 0.3441 | 0.2287 | 0.303 | 0.551 | 0.3221 | 0.5013 | 0.5222 | 0.3255 | 0.4583 | 0.7021 | 0.5911 | 0.691 | 0.3537 | 0.5089 | 0.3071 | 0.4982 | 0.2425 | 0.4354 | 0.3593 | 0.4773 |
| 0.5671 | 74.0 | 7881 | 0.9984 | 0.3679 | 0.6699 | 0.3348 | 0.221 | 0.3006 | 0.5606 | 0.3158 | 0.497 | 0.5228 | 0.3193 | 0.4645 | 0.7144 | 0.585 | 0.6892 | 0.3592 | 0.5316 | 0.2977 | 0.4884 | 0.2421 | 0.4246 | 0.3556 | 0.48 |
| 0.5757 | 74.9953 | 7987 | 0.9951 | 0.3698 | 0.6791 | 0.3427 | 0.2276 | 0.2908 | 0.5622 | 0.3161 | 0.5019 | 0.5273 | 0.3439 | 0.4567 | 0.7122 | 0.5872 | 0.6892 | 0.3566 | 0.5291 | 0.304 | 0.5027 | 0.2395 | 0.4262 | 0.3615 | 0.4893 |
| 0.5622 | 76.0 | 8094 | 1.0045 | 0.366 | 0.6724 | 0.3297 | 0.2095 | 0.2988 | 0.5485 | 0.3126 | 0.4983 | 0.5187 | 0.3127 | 0.4549 | 0.6987 | 0.5883 | 0.6896 | 0.3453 | 0.5152 | 0.3063 | 0.4951 | 0.2414 | 0.4231 | 0.3489 | 0.4707 |
| 0.5692 | 76.9953 | 8200 | 0.9920 | 0.372 | 0.6785 | 0.3435 | 0.229 | 0.2999 | 0.5517 | 0.3169 | 0.5042 | 0.5272 | 0.3422 | 0.4511 | 0.7139 | 0.5897 | 0.6892 | 0.3452 | 0.5089 | 0.3025 | 0.5018 | 0.2578 | 0.4431 | 0.3646 | 0.4929 |
| 0.5633 | 78.0 | 8307 | 0.9977 | 0.3663 | 0.6788 | 0.3341 | 0.2171 | 0.2959 | 0.5507 | 0.3143 | 0.4984 | 0.5189 | 0.3155 | 0.4583 | 0.6929 | 0.5866 | 0.691 | 0.3494 | 0.5038 | 0.3 | 0.4893 | 0.2388 | 0.4369 | 0.3569 | 0.4733 |
| 0.5671 | 78.9953 | 8413 | 0.9957 | 0.3649 | 0.6697 | 0.3343 | 0.2222 | 0.2848 | 0.5576 | 0.3146 | 0.5011 | 0.5227 | 0.3147 | 0.4604 | 0.7049 | 0.5839 | 0.6901 | 0.3487 | 0.5114 | 0.3043 | 0.496 | 0.234 | 0.4431 | 0.3538 | 0.4729 |
| 0.5496 | 80.0 | 8520 | 0.9874 | 0.3671 | 0.667 | 0.3476 | 0.2313 | 0.2869 | 0.5656 | 0.3153 | 0.503 | 0.5282 | 0.3407 | 0.4584 | 0.7089 | 0.5876 | 0.6964 | 0.3491 | 0.5089 | 0.3027 | 0.504 | 0.2307 | 0.4338 | 0.3655 | 0.4978 |
| 0.5628 | 80.9953 | 8626 | 0.9996 | 0.3664 | 0.6683 | 0.3343 | 0.2148 | 0.288 | 0.5608 | 0.3162 | 0.4997 | 0.5215 | 0.3092 | 0.4619 | 0.6996 | 0.5885 | 0.6896 | 0.3541 | 0.5203 | 0.3081 | 0.4951 | 0.2333 | 0.4277 | 0.3478 | 0.4747 |
| 0.5609 | 82.0 | 8733 | 0.9844 | 0.3712 | 0.6712 | 0.3547 | 0.2264 | 0.2906 | 0.5841 | 0.3206 | 0.5043 | 0.5334 | 0.361 | 0.4736 | 0.7136 | 0.5874 | 0.6982 | 0.3723 | 0.5443 | 0.3037 | 0.5031 | 0.2299 | 0.4338 | 0.3626 | 0.4876 |
| 0.5581 | 82.9953 | 8839 | 0.9873 | 0.3699 | 0.6706 | 0.3568 | 0.2302 | 0.2896 | 0.5803 | 0.3224 | 0.5115 | 0.5333 | 0.3533 | 0.4764 | 0.7146 | 0.5853 | 0.6905 | 0.3735 | 0.5481 | 0.3054 | 0.5036 | 0.2339 | 0.44 | 0.3517 | 0.4844 |
| 0.5539 | 84.0 | 8946 | 0.9930 | 0.3686 | 0.6638 | 0.354 | 0.2285 | 0.2868 | 0.565 | 0.3166 | 0.5006 | 0.5228 | 0.3556 | 0.4537 | 0.6896 | 0.5846 | 0.6784 | 0.3534 | 0.5127 | 0.3075 | 0.4929 | 0.2357 | 0.4323 | 0.362 | 0.4978 |
| 0.5481 | 84.9953 | 9052 | 0.9930 | 0.3714 | 0.6746 | 0.3588 | 0.221 | 0.2916 | 0.5803 | 0.3177 | 0.4979 | 0.5222 | 0.3152 | 0.4599 | 0.711 | 0.5915 | 0.6883 | 0.355 | 0.5038 | 0.3077 | 0.5013 | 0.2504 | 0.4338 | 0.3525 | 0.4836 |
| 0.5405 | 86.0 | 9159 | 0.9839 | 0.3808 | 0.6833 | 0.3759 | 0.236 | 0.2986 | 0.595 | 0.3208 | 0.5112 | 0.5343 | 0.3523 | 0.4722 | 0.7192 | 0.5949 | 0.6937 | 0.3826 | 0.538 | 0.3108 | 0.504 | 0.2475 | 0.4385 | 0.3685 | 0.4973 |
| 0.5532 | 86.9953 | 9265 | 0.9859 | 0.3782 | 0.677 | 0.3672 | 0.2331 | 0.3023 | 0.5736 | 0.322 | 0.5076 | 0.5317 | 0.348 | 0.471 | 0.7091 | 0.5907 | 0.6865 | 0.3714 | 0.5228 | 0.315 | 0.5112 | 0.2551 | 0.4492 | 0.3588 | 0.4889 |
| 0.5478 | 88.0 | 9372 | 0.9918 | 0.3702 | 0.6746 | 0.3544 | 0.2255 | 0.2911 | 0.5666 | 0.3203 | 0.5101 | 0.5326 | 0.3492 | 0.4616 | 0.7194 | 0.589 | 0.6923 | 0.3545 | 0.5354 | 0.3092 | 0.5018 | 0.2419 | 0.4369 | 0.3566 | 0.4964 |
| 0.5532 | 88.9953 | 9478 | 0.9928 | 0.3715 | 0.6745 | 0.3518 | 0.2266 | 0.2887 | 0.5828 | 0.3232 | 0.5087 | 0.5288 | 0.3494 | 0.4602 | 0.7206 | 0.5857 | 0.6874 | 0.365 | 0.5228 | 0.3092 | 0.5031 | 0.2387 | 0.4369 | 0.359 | 0.4938 |
| 0.5285 | 90.0 | 9585 | 0.9974 | 0.3706 | 0.6768 | 0.3474 | 0.2167 | 0.2854 | 0.5773 | 0.3197 | 0.5014 | 0.5226 | 0.333 | 0.4542 | 0.7111 | 0.5885 | 0.6869 | 0.362 | 0.5152 | 0.3083 | 0.4924 | 0.2354 | 0.4369 | 0.3588 | 0.4818 |
| 0.5262 | 90.9953 | 9691 | 0.9878 | 0.3712 | 0.6715 | 0.3515 | 0.2274 | 0.2869 | 0.5817 | 0.319 | 0.5012 | 0.522 | 0.3362 | 0.4556 | 0.7103 | 0.5862 | 0.6833 | 0.364 | 0.5165 | 0.3136 | 0.5004 | 0.235 | 0.4277 | 0.3573 | 0.4822 |
| 0.5282 | 92.0 | 9798 | 0.9987 | 0.3678 | 0.6722 | 0.3388 | 0.2241 | 0.2803 | 0.5825 | 0.3168 | 0.4989 | 0.5214 | 0.3418 | 0.4403 | 0.7094 | 0.5843 | 0.6793 | 0.3555 | 0.5089 | 0.3106 | 0.5063 | 0.2378 | 0.4323 | 0.351 | 0.4804 |
| 0.5294 | 92.9953 | 9904 | 0.9893 | 0.3692 | 0.6677 | 0.3468 | 0.2254 | 0.2829 | 0.5824 | 0.3175 | 0.5027 | 0.5261 | 0.3528 | 0.4565 | 0.7133 | 0.5836 | 0.6833 | 0.3524 | 0.5076 | 0.3107 | 0.5067 | 0.238 | 0.4415 | 0.3611 | 0.4911 |
| 0.5122 | 94.0 | 10011 | 0.9880 | 0.3716 | 0.6687 | 0.3577 | 0.2239 | 0.2891 | 0.5818 | 0.3172 | 0.5027 | 0.5285 | 0.3487 | 0.4577 | 0.7144 | 0.5848 | 0.6869 | 0.3595 | 0.5127 | 0.3123 | 0.5094 | 0.2382 | 0.44 | 0.3634 | 0.4933 |
| 0.5358 | 94.9953 | 10117 | 0.9913 | 0.3717 | 0.6662 | 0.3481 | 0.2242 | 0.2874 | 0.5813 | 0.3208 | 0.5052 | 0.5301 | 0.3474 | 0.4647 | 0.7192 | 0.587 | 0.6905 | 0.3641 | 0.5177 | 0.3139 | 0.508 | 0.2337 | 0.4415 | 0.3599 | 0.4929 |
| 0.5233 | 96.0 | 10224 | 0.9908 | 0.3704 | 0.6692 | 0.3508 | 0.2253 | 0.2858 | 0.5802 | 0.318 | 0.5023 | 0.5274 | 0.3491 | 0.4604 | 0.7148 | 0.5802 | 0.682 | 0.3639 | 0.5215 | 0.3112 | 0.5063 | 0.2356 | 0.4415 | 0.3612 | 0.4858 |
| 0.5136 | 96.9953 | 10330 | 0.9903 | 0.3724 | 0.6732 | 0.3511 | 0.2265 | 0.2847 | 0.5814 | 0.3191 | 0.5027 | 0.5268 | 0.3445 | 0.4537 | 0.7195 | 0.5812 | 0.6824 | 0.3691 | 0.5304 | 0.3142 | 0.5067 | 0.2354 | 0.4308 | 0.3619 | 0.4836 |
| 0.5204 | 98.0 | 10437 | 0.9903 | 0.3722 | 0.674 | 0.352 | 0.2277 | 0.2851 | 0.5843 | 0.3197 | 0.5036 | 0.5272 | 0.3448 | 0.4543 | 0.7207 | 0.5841 | 0.6824 | 0.3658 | 0.5228 | 0.3146 | 0.508 | 0.2303 | 0.4308 | 0.3661 | 0.492 |
| 0.5237 | 98.9953 | 10543 | 0.9917 | 0.3721 | 0.6715 | 0.3545 | 0.2264 | 0.2841 | 0.5841 | 0.3197 | 0.5021 | 0.527 | 0.3454 | 0.4453 | 0.7226 | 0.5826 | 0.6797 | 0.3684 | 0.5241 | 0.3111 | 0.5063 | 0.2332 | 0.4369 | 0.3648 | 0.488 |
| 0.4776 | 99.5305 | 10600 | 0.9911 | 0.3714 | 0.6742 | 0.3545 | 0.226 | 0.2836 | 0.5849 | 0.3191 | 0.502 | 0.5266 | 0.3445 | 0.4443 | 0.7237 | 0.5834 | 0.6797 | 0.3648 | 0.5241 | 0.3122 | 0.5071 | 0.2315 | 0.4338 | 0.3649 | 0.4884 |
### Framework versions
- Transformers 4.41.0.dev0
- Pytorch 1.13.0+cu117
- Datasets 2.18.0
- Tokenizers 0.19.0
|