File size: 45,125 Bytes
1c93e00 daad507 1c93e00 daad507 1c93e00 daad507 1c93e00 daad507 1c93e00 daad507 1c93e00 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 |
---
license: other
base_model: nvidia/mit-b0
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: segformer-b0-winter_2
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# segformer-b0-winter_2
This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the johanhag/winter dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0665
- Mean Iou: 0.7168
- Mean Accuracy: 0.7840
- Overall Accuracy: 0.9775
- Accuracy Unlabeled: nan
- Accuracy Road: 0.9559
- Accuracy Side walk: 0.7693
- Accuracy Car: 0.8882
- Accuracy Pedestrian: 0.8345
- Accuracy Sign: 0.2653
- Accuracy Other: 0.9907
- Iou Unlabeled: nan
- Iou Road: 0.9088
- Iou Side walk: 0.6583
- Iou Car: 0.7943
- Iou Pedestrian: 0.7201
- Iou Sign: 0.2393
- Iou Other: 0.9799
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 50
### Training results
| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Road | Accuracy Side walk | Accuracy Car | Accuracy Pedestrian | Accuracy Sign | Accuracy Other | Iou Unlabeled | Iou Road | Iou Side walk | Iou Car | Iou Pedestrian | Iou Sign | Iou Other |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:-------------:|:------------------:|:------------:|:-------------------:|:-------------:|:--------------:|:-------------:|:--------:|:-------------:|:-------:|:--------------:|:--------:|:---------:|
| 1.2678 | 0.37 | 20 | 1.4585 | 0.2824 | 0.4123 | 0.8374 | nan | 0.9932 | 0.0 | 0.6072 | 0.0205 | 0.0 | 0.8528 | nan | 0.4383 | 0.0 | 0.3876 | 0.0204 | 0.0 | 0.8480 |
| 0.9377 | 0.74 | 40 | 0.9219 | 0.3461 | 0.4345 | 0.9161 | nan | 0.9666 | 0.0013 | 0.6904 | 0.0 | 0.0 | 0.9490 | nan | 0.6449 | 0.0013 | 0.5036 | 0.0 | 0.0 | 0.9265 |
| 0.7819 | 1.11 | 60 | 0.7375 | 0.3622 | 0.4469 | 0.9248 | nan | 0.9687 | 0.0098 | 0.7451 | 0.0 | 0.0 | 0.9576 | nan | 0.6748 | 0.0095 | 0.5520 | 0.0 | 0.0 | 0.9367 |
| 0.687 | 1.48 | 80 | 0.6354 | 0.3674 | 0.4573 | 0.9286 | nan | 0.9687 | 0.0131 | 0.8014 | 0.0 | 0.0 | 0.9608 | nan | 0.6873 | 0.0130 | 0.5626 | 0.0 | 0.0 | 0.9417 |
| 0.552 | 1.85 | 100 | 0.5199 | 0.3753 | 0.4700 | 0.9360 | nan | 0.9564 | 0.0246 | 0.8691 | 0.0 | 0.0 | 0.9697 | nan | 0.7283 | 0.0246 | 0.5492 | 0.0 | 0.0 | 0.9497 |
| 0.521 | 2.22 | 120 | 0.4620 | 0.3897 | 0.4651 | 0.9419 | nan | 0.9413 | 0.0622 | 0.8083 | 0.0 | 0.0 | 0.9791 | nan | 0.7606 | 0.0615 | 0.5631 | 0.0 | 0.0 | 0.9531 |
| 0.3901 | 2.59 | 140 | 0.4255 | 0.4088 | 0.5067 | 0.9398 | nan | 0.9671 | 0.1414 | 0.8939 | 0.0695 | 0.0 | 0.9684 | nan | 0.7369 | 0.1358 | 0.5570 | 0.0694 | 0.0 | 0.9540 |
| 0.4172 | 2.96 | 160 | 0.3836 | 0.4307 | 0.5198 | 0.9436 | nan | 0.9591 | 0.2494 | 0.8904 | 0.0485 | 0.0 | 0.9714 | nan | 0.7552 | 0.2212 | 0.6043 | 0.0485 | 0.0 | 0.9552 |
| 0.2995 | 3.33 | 180 | 0.3209 | 0.4755 | 0.5497 | 0.9483 | nan | 0.9631 | 0.1625 | 0.8542 | 0.3417 | 0.0 | 0.9768 | nan | 0.7656 | 0.1585 | 0.6356 | 0.3340 | 0.0 | 0.9592 |
| 1.6503 | 3.7 | 200 | 0.2891 | 0.4914 | 0.5539 | 0.9529 | nan | 0.9505 | 0.4372 | 0.7938 | 0.1621 | 0.0 | 0.9797 | nan | 0.8021 | 0.3827 | 0.6457 | 0.1592 | 0.0 | 0.9585 |
| 0.2506 | 4.07 | 220 | 0.2502 | 0.4813 | 0.5573 | 0.9537 | nan | 0.9412 | 0.3606 | 0.8825 | 0.1774 | 0.0 | 0.9820 | nan | 0.8068 | 0.3260 | 0.6168 | 0.1758 | 0.0 | 0.9625 |
| 0.2336 | 4.44 | 240 | 0.2367 | 0.5543 | 0.6178 | 0.9610 | nan | 0.9211 | 0.4445 | 0.8401 | 0.5124 | 0.0 | 0.9889 | nan | 0.8354 | 0.4044 | 0.6477 | 0.4713 | 0.0 | 0.9670 |
| 0.1932 | 4.81 | 260 | 0.2088 | 0.5436 | 0.5960 | 0.9613 | nan | 0.9283 | 0.4497 | 0.8144 | 0.3935 | 0.0 | 0.9898 | nan | 0.8360 | 0.4188 | 0.6606 | 0.3794 | 0.0 | 0.9667 |
| 1.8362 | 5.19 | 280 | 0.1866 | 0.5727 | 0.6422 | 0.9628 | nan | 0.9358 | 0.4776 | 0.8185 | 0.6339 | 0.0 | 0.9876 | nan | 0.8474 | 0.4320 | 0.6612 | 0.5279 | 0.0 | 0.9679 |
| 0.2085 | 5.56 | 300 | 0.1677 | 0.5749 | 0.6321 | 0.9646 | nan | 0.9571 | 0.4811 | 0.7743 | 0.5920 | 0.0 | 0.9881 | nan | 0.8488 | 0.4438 | 0.6761 | 0.5099 | 0.0 | 0.9706 |
| 0.1389 | 5.93 | 320 | 0.1566 | 0.5761 | 0.6368 | 0.9641 | nan | 0.9566 | 0.5138 | 0.8141 | 0.5499 | 0.0 | 0.9862 | nan | 0.8483 | 0.4661 | 0.6803 | 0.4929 | 0.0 | 0.9693 |
| 0.1799 | 6.3 | 340 | 0.1620 | 0.5836 | 0.6678 | 0.9625 | nan | 0.9604 | 0.5769 | 0.8649 | 0.6244 | 0.0 | 0.9802 | nan | 0.8437 | 0.4753 | 0.6798 | 0.5350 | 0.0 | 0.9679 |
| 0.1291 | 6.67 | 360 | 0.1400 | 0.5926 | 0.6680 | 0.9649 | nan | 0.9637 | 0.5702 | 0.8362 | 0.6548 | 0.0 | 0.9831 | nan | 0.8505 | 0.4971 | 0.6900 | 0.5478 | 0.0 | 0.9701 |
| 0.1275 | 7.04 | 380 | 0.1505 | 0.5710 | 0.6346 | 0.9625 | nan | 0.9682 | 0.4619 | 0.7713 | 0.6220 | 0.0 | 0.9843 | nan | 0.8387 | 0.4057 | 0.6858 | 0.5268 | 0.0 | 0.9691 |
| 0.0968 | 7.41 | 400 | 0.1368 | 0.5774 | 0.6363 | 0.9644 | nan | 0.9666 | 0.4759 | 0.8145 | 0.5753 | 0.0 | 0.9859 | nan | 0.8407 | 0.4348 | 0.6960 | 0.5216 | 0.0 | 0.9714 |
| 0.1279 | 7.78 | 420 | 0.1317 | 0.5911 | 0.6616 | 0.9665 | nan | 0.9405 | 0.5449 | 0.9055 | 0.5909 | 0.0 | 0.9880 | nan | 0.8677 | 0.4742 | 0.7002 | 0.5328 | 0.0 | 0.9714 |
| 0.0917 | 8.15 | 440 | 0.1217 | 0.6187 | 0.7110 | 0.9684 | nan | 0.9505 | 0.7295 | 0.8745 | 0.7278 | 0.0 | 0.9834 | nan | 0.8802 | 0.5694 | 0.7065 | 0.5843 | 0.0 | 0.9719 |
| 0.0896 | 8.52 | 460 | 0.1164 | 0.6055 | 0.6809 | 0.9678 | nan | 0.9333 | 0.7235 | 0.8257 | 0.6158 | 0.0 | 0.9873 | nan | 0.8787 | 0.5338 | 0.7053 | 0.5428 | 0.0 | 0.9722 |
| 0.0903 | 8.89 | 480 | 0.1186 | 0.6195 | 0.6956 | 0.9683 | nan | 0.9632 | 0.6929 | 0.8345 | 0.6995 | 0.0 | 0.9836 | nan | 0.8645 | 0.5528 | 0.7308 | 0.5960 | 0.0 | 0.9730 |
| 0.0943 | 9.26 | 500 | 0.1183 | 0.6205 | 0.7187 | 0.9672 | nan | 0.9539 | 0.7619 | 0.8675 | 0.7483 | 0.0 | 0.9805 | nan | 0.8773 | 0.5444 | 0.7161 | 0.6142 | 0.0 | 0.9709 |
| 0.0886 | 9.63 | 520 | 0.1080 | 0.6233 | 0.7010 | 0.9687 | nan | 0.9665 | 0.6540 | 0.8584 | 0.7434 | 0.0 | 0.9838 | nan | 0.8689 | 0.5572 | 0.7272 | 0.6140 | 0.0 | 0.9726 |
| 0.1024 | 10.0 | 540 | 0.1047 | 0.6224 | 0.6872 | 0.9706 | nan | 0.9419 | 0.6739 | 0.8470 | 0.6710 | 0.0 | 0.9898 | nan | 0.8803 | 0.5702 | 0.7278 | 0.5818 | 0.0 | 0.9744 |
| 0.0779 | 10.37 | 560 | 0.1116 | 0.6168 | 0.6841 | 0.9683 | nan | 0.9726 | 0.5517 | 0.8334 | 0.7614 | 0.0 | 0.9856 | nan | 0.8627 | 0.5211 | 0.7301 | 0.6145 | 0.0 | 0.9724 |
| 0.1082 | 10.74 | 580 | 0.1044 | 0.6277 | 0.7012 | 0.9695 | nan | 0.9656 | 0.6787 | 0.8693 | 0.7096 | 0.0 | 0.9843 | nan | 0.8712 | 0.5607 | 0.7441 | 0.6166 | 0.0 | 0.9736 |
| 0.0797 | 11.11 | 600 | 0.1004 | 0.6356 | 0.7205 | 0.9703 | nan | 0.9625 | 0.7506 | 0.8580 | 0.7686 | 0.0 | 0.9834 | nan | 0.8826 | 0.5894 | 0.7393 | 0.6292 | 0.0 | 0.9734 |
| 0.0766 | 11.48 | 620 | 0.0957 | 0.6377 | 0.7250 | 0.9714 | nan | 0.9507 | 0.7480 | 0.8487 | 0.8162 | 0.0 | 0.9862 | nan | 0.8869 | 0.6181 | 0.7356 | 0.6112 | 0.0 | 0.9743 |
| 0.1557 | 11.85 | 640 | 0.0951 | 0.6367 | 0.7029 | 0.9719 | nan | 0.9529 | 0.7316 | 0.8288 | 0.7157 | 0.0 | 0.9883 | nan | 0.8896 | 0.6117 | 0.7317 | 0.6125 | 0.0 | 0.9745 |
| 0.0623 | 12.22 | 660 | 0.0939 | 0.6462 | 0.7283 | 0.9726 | nan | 0.9467 | 0.7844 | 0.8493 | 0.8022 | 0.0 | 0.9873 | nan | 0.8923 | 0.6157 | 0.7518 | 0.6416 | 0.0 | 0.9756 |
| 0.0619 | 12.59 | 680 | 0.0976 | 0.6349 | 0.7030 | 0.9710 | nan | 0.9603 | 0.7091 | 0.8715 | 0.6907 | 0.0 | 0.9861 | nan | 0.8802 | 0.5868 | 0.7498 | 0.6182 | 0.0 | 0.9745 |
| 0.0617 | 12.96 | 700 | 0.0919 | 0.6354 | 0.7228 | 0.9719 | nan | 0.9470 | 0.7145 | 0.8873 | 0.8003 | 0.0 | 0.9874 | nan | 0.8887 | 0.5929 | 0.7426 | 0.6128 | 0.0 | 0.9756 |
| 0.0544 | 13.33 | 720 | 0.0870 | 0.6517 | 0.7173 | 0.9741 | nan | 0.9465 | 0.7433 | 0.8302 | 0.7930 | 0.0 | 0.9907 | nan | 0.9005 | 0.6367 | 0.7452 | 0.6518 | 0.0 | 0.9760 |
| 0.1027 | 13.7 | 740 | 0.0894 | 0.6446 | 0.7207 | 0.9728 | nan | 0.9207 | 0.7490 | 0.8655 | 0.7973 | 0.0 | 0.9917 | nan | 0.8926 | 0.6210 | 0.7383 | 0.6398 | 0.0 | 0.9755 |
| 0.0568 | 14.07 | 760 | 0.0897 | 0.6434 | 0.7118 | 0.9729 | nan | 0.9570 | 0.7121 | 0.8779 | 0.7342 | 0.0016 | 0.9882 | nan | 0.8947 | 0.6098 | 0.7497 | 0.6292 | 0.0016 | 0.9753 |
| 0.0612 | 14.44 | 780 | 0.0851 | 0.6517 | 0.7181 | 0.9740 | nan | 0.9599 | 0.7121 | 0.8589 | 0.7874 | 0.0012 | 0.9890 | nan | 0.8967 | 0.6182 | 0.7590 | 0.6582 | 0.0012 | 0.9766 |
| 0.076 | 14.81 | 800 | 0.0859 | 0.6485 | 0.7126 | 0.9735 | nan | 0.9589 | 0.6878 | 0.8535 | 0.7830 | 0.0033 | 0.9894 | nan | 0.8925 | 0.6028 | 0.7595 | 0.6563 | 0.0033 | 0.9765 |
| 0.0489 | 15.19 | 820 | 0.0815 | 0.6528 | 0.7188 | 0.9744 | nan | 0.9484 | 0.7477 | 0.8180 | 0.7988 | 0.0090 | 0.9909 | nan | 0.9011 | 0.6294 | 0.7421 | 0.6584 | 0.0090 | 0.9771 |
| 0.0859 | 15.56 | 840 | 0.0828 | 0.6555 | 0.7296 | 0.9738 | nan | 0.9508 | 0.7726 | 0.8563 | 0.7974 | 0.0118 | 0.9884 | nan | 0.8961 | 0.6231 | 0.7577 | 0.6674 | 0.0118 | 0.9768 |
| 0.0661 | 15.93 | 860 | 0.0840 | 0.6555 | 0.7190 | 0.9741 | nan | 0.9603 | 0.7187 | 0.8370 | 0.7849 | 0.0234 | 0.9894 | nan | 0.8993 | 0.6216 | 0.7473 | 0.6652 | 0.0234 | 0.9766 |
| 0.0654 | 16.3 | 880 | 0.0840 | 0.6584 | 0.7227 | 0.9742 | nan | 0.9564 | 0.7158 | 0.8614 | 0.7876 | 0.0257 | 0.9895 | nan | 0.8970 | 0.6175 | 0.7638 | 0.6699 | 0.0257 | 0.9767 |
| 0.0607 | 16.67 | 900 | 0.0822 | 0.6559 | 0.7390 | 0.9732 | nan | 0.9545 | 0.7766 | 0.8700 | 0.8213 | 0.0253 | 0.9865 | nan | 0.8920 | 0.6220 | 0.7645 | 0.6554 | 0.0253 | 0.9763 |
| 0.0497 | 17.04 | 920 | 0.0817 | 0.6673 | 0.7313 | 0.9748 | nan | 0.9606 | 0.6869 | 0.8915 | 0.7878 | 0.0713 | 0.9897 | nan | 0.8995 | 0.6138 | 0.7722 | 0.6698 | 0.0711 | 0.9773 |
| 0.0497 | 17.41 | 940 | 0.0841 | 0.6523 | 0.7202 | 0.9731 | nan | 0.9672 | 0.6538 | 0.8894 | 0.7861 | 0.0371 | 0.9878 | nan | 0.8868 | 0.5868 | 0.7649 | 0.6617 | 0.0371 | 0.9766 |
| 0.055 | 17.78 | 960 | 0.0832 | 0.6568 | 0.7440 | 0.9730 | nan | 0.9510 | 0.8045 | 0.8484 | 0.8358 | 0.0383 | 0.9863 | nan | 0.8946 | 0.6165 | 0.7569 | 0.6587 | 0.0383 | 0.9762 |
| 0.0967 | 18.15 | 980 | 0.0854 | 0.6650 | 0.7524 | 0.9726 | nan | 0.9647 | 0.7887 | 0.8950 | 0.7981 | 0.0846 | 0.9836 | nan | 0.8918 | 0.6210 | 0.7621 | 0.6561 | 0.0839 | 0.9752 |
| 0.0436 | 18.52 | 1000 | 0.0814 | 0.6623 | 0.7454 | 0.9739 | nan | 0.9593 | 0.7287 | 0.8957 | 0.8436 | 0.0579 | 0.9871 | nan | 0.8986 | 0.6138 | 0.7595 | 0.6672 | 0.0577 | 0.9767 |
| 0.0465 | 18.89 | 1020 | 0.0773 | 0.6646 | 0.7224 | 0.9754 | nan | 0.9473 | 0.7419 | 0.8615 | 0.7462 | 0.0456 | 0.9919 | nan | 0.9050 | 0.6357 | 0.7607 | 0.6632 | 0.0456 | 0.9777 |
| 0.0672 | 19.26 | 1040 | 0.0778 | 0.6713 | 0.7454 | 0.9751 | nan | 0.9464 | 0.7716 | 0.8746 | 0.8165 | 0.0736 | 0.9898 | nan | 0.9037 | 0.6316 | 0.7748 | 0.6671 | 0.0730 | 0.9776 |
| 0.0592 | 19.63 | 1060 | 0.0799 | 0.6616 | 0.7223 | 0.9747 | nan | 0.9596 | 0.6442 | 0.8656 | 0.8116 | 0.0613 | 0.9912 | nan | 0.8997 | 0.5864 | 0.7681 | 0.6765 | 0.0612 | 0.9776 |
| 0.0876 | 20.0 | 1080 | 0.0794 | 0.6712 | 0.7386 | 0.9745 | nan | 0.9608 | 0.7370 | 0.8057 | 0.8434 | 0.0954 | 0.9893 | nan | 0.8993 | 0.6468 | 0.7364 | 0.6735 | 0.0943 | 0.9767 |
| 0.0483 | 20.37 | 1100 | 0.0742 | 0.6783 | 0.7469 | 0.9760 | nan | 0.9576 | 0.7331 | 0.8860 | 0.8272 | 0.0872 | 0.9901 | nan | 0.9066 | 0.6469 | 0.7731 | 0.6784 | 0.0866 | 0.9782 |
| 0.0837 | 20.74 | 1120 | 0.0746 | 0.6756 | 0.7378 | 0.9762 | nan | 0.9491 | 0.7350 | 0.8654 | 0.8146 | 0.0709 | 0.9920 | nan | 0.9067 | 0.6411 | 0.7718 | 0.6849 | 0.0705 | 0.9785 |
| 0.0685 | 21.11 | 1140 | 0.0743 | 0.6787 | 0.7383 | 0.9759 | nan | 0.9475 | 0.7316 | 0.8709 | 0.7859 | 0.1015 | 0.9921 | nan | 0.9070 | 0.6387 | 0.7661 | 0.6817 | 0.1004 | 0.9781 |
| 0.0596 | 21.48 | 1160 | 0.0751 | 0.6762 | 0.7418 | 0.9753 | nan | 0.9499 | 0.7516 | 0.8336 | 0.8182 | 0.1066 | 0.9909 | nan | 0.9056 | 0.6307 | 0.7558 | 0.6827 | 0.1051 | 0.9776 |
| 0.0608 | 21.85 | 1180 | 0.0728 | 0.6833 | 0.7549 | 0.9763 | nan | 0.9428 | 0.7846 | 0.8823 | 0.8219 | 0.1066 | 0.9911 | nan | 0.9070 | 0.6479 | 0.7742 | 0.6862 | 0.1055 | 0.9789 |
| 0.0918 | 22.22 | 1200 | 0.0731 | 0.6846 | 0.7457 | 0.9763 | nan | 0.9597 | 0.7567 | 0.8516 | 0.7984 | 0.1174 | 0.9904 | nan | 0.9049 | 0.6518 | 0.7691 | 0.6875 | 0.1153 | 0.9787 |
| 0.0539 | 22.59 | 1220 | 0.0743 | 0.6785 | 0.7431 | 0.9756 | nan | 0.9563 | 0.7037 | 0.8680 | 0.8308 | 0.1086 | 0.9909 | nan | 0.9011 | 0.6200 | 0.7720 | 0.6918 | 0.1075 | 0.9786 |
| 0.112 | 22.96 | 1240 | 0.0732 | 0.6786 | 0.7429 | 0.9759 | nan | 0.9550 | 0.7656 | 0.8544 | 0.8060 | 0.0862 | 0.9902 | nan | 0.9026 | 0.6444 | 0.7701 | 0.6902 | 0.0856 | 0.9786 |
| 0.0719 | 23.33 | 1260 | 0.0752 | 0.6812 | 0.7419 | 0.9752 | nan | 0.9556 | 0.7059 | 0.8454 | 0.8174 | 0.1363 | 0.9910 | nan | 0.8975 | 0.6136 | 0.7681 | 0.6947 | 0.1347 | 0.9784 |
| 0.0669 | 23.7 | 1280 | 0.0769 | 0.6881 | 0.7787 | 0.9740 | nan | 0.9620 | 0.7954 | 0.9020 | 0.8524 | 0.1760 | 0.9846 | nan | 0.8958 | 0.6387 | 0.7668 | 0.6829 | 0.1678 | 0.9766 |
| 0.0493 | 24.07 | 1300 | 0.0759 | 0.6778 | 0.7518 | 0.9748 | nan | 0.9568 | 0.7398 | 0.8994 | 0.7977 | 0.1284 | 0.9885 | nan | 0.8995 | 0.6076 | 0.7751 | 0.6805 | 0.1260 | 0.9783 |
| 0.11 | 24.44 | 1320 | 0.0752 | 0.6879 | 0.7625 | 0.9751 | nan | 0.9636 | 0.7402 | 0.8775 | 0.8339 | 0.1720 | 0.9879 | nan | 0.9000 | 0.6242 | 0.7765 | 0.6846 | 0.1644 | 0.9779 |
| 0.0631 | 24.81 | 1340 | 0.0720 | 0.6898 | 0.7530 | 0.9763 | nan | 0.9664 | 0.7223 | 0.8807 | 0.8130 | 0.1459 | 0.9896 | nan | 0.9044 | 0.6431 | 0.7812 | 0.6906 | 0.1411 | 0.9786 |
| 0.038 | 25.19 | 1360 | 0.0719 | 0.6909 | 0.7599 | 0.9761 | nan | 0.9491 | 0.7646 | 0.8841 | 0.8190 | 0.1522 | 0.9904 | nan | 0.9034 | 0.6346 | 0.7828 | 0.6976 | 0.1480 | 0.9790 |
| 0.0431 | 25.56 | 1380 | 0.0721 | 0.6925 | 0.7596 | 0.9760 | nan | 0.9651 | 0.7530 | 0.8864 | 0.8031 | 0.1614 | 0.9886 | nan | 0.9033 | 0.6418 | 0.7848 | 0.6910 | 0.1558 | 0.9785 |
| 0.0289 | 25.93 | 1400 | 0.0711 | 0.6914 | 0.7587 | 0.9762 | nan | 0.9381 | 0.7752 | 0.8909 | 0.7947 | 0.1614 | 0.9919 | nan | 0.9045 | 0.6471 | 0.7738 | 0.6893 | 0.1549 | 0.9789 |
| 0.0426 | 26.3 | 1420 | 0.0706 | 0.6950 | 0.7523 | 0.9768 | nan | 0.9640 | 0.7361 | 0.8359 | 0.8120 | 0.1746 | 0.9911 | nan | 0.9078 | 0.6530 | 0.7639 | 0.6987 | 0.1673 | 0.9791 |
| 0.0467 | 26.67 | 1440 | 0.0707 | 0.6961 | 0.7609 | 0.9765 | nan | 0.9479 | 0.7615 | 0.9029 | 0.7805 | 0.1813 | 0.9911 | nan | 0.9072 | 0.6454 | 0.7790 | 0.6928 | 0.1734 | 0.9790 |
| 0.0408 | 27.04 | 1460 | 0.0709 | 0.6920 | 0.7549 | 0.9765 | nan | 0.9492 | 0.7672 | 0.8323 | 0.8389 | 0.1500 | 0.9918 | nan | 0.9080 | 0.6569 | 0.7628 | 0.7006 | 0.1450 | 0.9786 |
| 0.0615 | 27.41 | 1480 | 0.0703 | 0.6963 | 0.7537 | 0.9768 | nan | 0.9581 | 0.7484 | 0.8667 | 0.7992 | 0.1587 | 0.9911 | nan | 0.9084 | 0.6610 | 0.7770 | 0.7002 | 0.1525 | 0.9786 |
| 0.0533 | 27.78 | 1500 | 0.0706 | 0.6946 | 0.7582 | 0.9764 | nan | 0.9456 | 0.7452 | 0.8519 | 0.8340 | 0.1799 | 0.9924 | nan | 0.9061 | 0.6408 | 0.7720 | 0.6988 | 0.1708 | 0.9789 |
| 0.0711 | 28.15 | 1520 | 0.0706 | 0.6920 | 0.7510 | 0.9763 | nan | 0.9534 | 0.7701 | 0.8629 | 0.7678 | 0.1608 | 0.9909 | nan | 0.9047 | 0.6450 | 0.7784 | 0.6898 | 0.1554 | 0.9789 |
| 0.0393 | 28.52 | 1540 | 0.0682 | 0.6969 | 0.7657 | 0.9768 | nan | 0.9478 | 0.7615 | 0.8731 | 0.8445 | 0.1756 | 0.9915 | nan | 0.9068 | 0.6512 | 0.7821 | 0.6940 | 0.1677 | 0.9795 |
| 0.0554 | 28.89 | 1560 | 0.0692 | 0.6964 | 0.7709 | 0.9760 | nan | 0.9589 | 0.7844 | 0.8853 | 0.8399 | 0.1685 | 0.9882 | nan | 0.9025 | 0.6465 | 0.7864 | 0.7042 | 0.1603 | 0.9786 |
| 0.0434 | 29.26 | 1580 | 0.0701 | 0.7004 | 0.7726 | 0.9764 | nan | 0.9626 | 0.7718 | 0.9017 | 0.8279 | 0.1836 | 0.9883 | nan | 0.9042 | 0.6550 | 0.7841 | 0.7068 | 0.1736 | 0.9789 |
| 0.0291 | 29.63 | 1600 | 0.0697 | 0.6993 | 0.7828 | 0.9764 | nan | 0.9514 | 0.7878 | 0.9098 | 0.8654 | 0.1934 | 0.9889 | nan | 0.9074 | 0.6529 | 0.7792 | 0.6950 | 0.1820 | 0.9791 |
| 2.6544 | 30.0 | 1620 | 0.0684 | 0.6924 | 0.7548 | 0.9766 | nan | 0.9521 | 0.7645 | 0.8669 | 0.8127 | 0.1414 | 0.9912 | nan | 0.9047 | 0.6439 | 0.7817 | 0.7072 | 0.1378 | 0.9794 |
| 0.0575 | 30.37 | 1640 | 0.0695 | 0.7022 | 0.7716 | 0.9766 | nan | 0.9572 | 0.7694 | 0.8932 | 0.8291 | 0.1913 | 0.9895 | nan | 0.9055 | 0.6478 | 0.7868 | 0.7134 | 0.1807 | 0.9792 |
| 0.0445 | 30.74 | 1660 | 0.0695 | 0.6967 | 0.7644 | 0.9766 | nan | 0.9469 | 0.7587 | 0.8831 | 0.8402 | 0.1661 | 0.9914 | nan | 0.9087 | 0.6416 | 0.7843 | 0.7072 | 0.1596 | 0.9789 |
| 0.0487 | 31.11 | 1680 | 0.0700 | 0.7022 | 0.7674 | 0.9768 | nan | 0.9598 | 0.7276 | 0.8745 | 0.8351 | 0.2170 | 0.9907 | nan | 0.9066 | 0.6404 | 0.7870 | 0.7006 | 0.1996 | 0.9792 |
| 0.0539 | 31.48 | 1700 | 0.0700 | 0.6978 | 0.7634 | 0.9764 | nan | 0.9489 | 0.7680 | 0.8586 | 0.8232 | 0.1903 | 0.9912 | nan | 0.9054 | 0.6365 | 0.7813 | 0.7053 | 0.1791 | 0.9792 |
| 0.0617 | 31.85 | 1720 | 0.0717 | 0.7077 | 0.7777 | 0.9765 | nan | 0.9562 | 0.7683 | 0.8947 | 0.8146 | 0.2433 | 0.9895 | nan | 0.9038 | 0.6415 | 0.7921 | 0.7096 | 0.2201 | 0.9791 |
| 0.0391 | 32.22 | 1740 | 0.0690 | 0.7007 | 0.7676 | 0.9766 | nan | 0.9557 | 0.7667 | 0.8654 | 0.8402 | 0.1874 | 0.9902 | nan | 0.9044 | 0.6447 | 0.7851 | 0.7129 | 0.1775 | 0.9793 |
| 0.0834 | 32.59 | 1760 | 0.0688 | 0.7015 | 0.7699 | 0.9768 | nan | 0.9519 | 0.7571 | 0.8926 | 0.8319 | 0.1954 | 0.9907 | nan | 0.9048 | 0.6459 | 0.7860 | 0.7089 | 0.1840 | 0.9795 |
| 0.0412 | 32.96 | 1780 | 0.0694 | 0.7080 | 0.7786 | 0.9768 | nan | 0.9560 | 0.7600 | 0.8859 | 0.8386 | 0.2410 | 0.9901 | nan | 0.9077 | 0.6464 | 0.7894 | 0.7049 | 0.2203 | 0.9791 |
| 0.0476 | 33.33 | 1800 | 0.0698 | 0.7045 | 0.7689 | 0.9766 | nan | 0.9582 | 0.7688 | 0.8677 | 0.8225 | 0.2062 | 0.9900 | nan | 0.9055 | 0.6537 | 0.7854 | 0.7090 | 0.1948 | 0.9788 |
| 0.0407 | 33.7 | 1820 | 0.0684 | 0.7103 | 0.7824 | 0.9770 | nan | 0.9535 | 0.7700 | 0.8809 | 0.8575 | 0.2423 | 0.9904 | nan | 0.9077 | 0.6555 | 0.7885 | 0.7073 | 0.2233 | 0.9794 |
| 0.0307 | 34.07 | 1840 | 0.0717 | 0.7072 | 0.7902 | 0.9755 | nan | 0.9608 | 0.7869 | 0.8959 | 0.8623 | 0.2484 | 0.9867 | nan | 0.9000 | 0.6421 | 0.7882 | 0.7089 | 0.2258 | 0.9781 |
| 0.0236 | 34.44 | 1860 | 0.0700 | 0.7104 | 0.7889 | 0.9765 | nan | 0.9502 | 0.7737 | 0.8754 | 0.8807 | 0.2639 | 0.9900 | nan | 0.9041 | 0.6532 | 0.7850 | 0.7041 | 0.2370 | 0.9791 |
| 0.0752 | 34.81 | 1880 | 0.0689 | 0.7068 | 0.7716 | 0.9766 | nan | 0.9564 | 0.7689 | 0.8845 | 0.8157 | 0.2139 | 0.9899 | nan | 0.9032 | 0.6542 | 0.7915 | 0.7115 | 0.2012 | 0.9790 |
| 0.0301 | 35.19 | 1900 | 0.0701 | 0.7021 | 0.7862 | 0.9761 | nan | 0.9427 | 0.8005 | 0.8935 | 0.8702 | 0.2209 | 0.9896 | nan | 0.9046 | 0.6342 | 0.7870 | 0.7013 | 0.2064 | 0.9793 |
| 0.0457 | 35.56 | 1920 | 0.0694 | 0.7053 | 0.7683 | 0.9769 | nan | 0.9525 | 0.7313 | 0.8720 | 0.8319 | 0.2302 | 0.9918 | nan | 0.9053 | 0.6363 | 0.7872 | 0.7100 | 0.2136 | 0.9796 |
| 0.033 | 35.93 | 1940 | 0.0695 | 0.7078 | 0.7745 | 0.9766 | nan | 0.9618 | 0.7552 | 0.8873 | 0.8138 | 0.2392 | 0.9894 | nan | 0.9037 | 0.6423 | 0.7926 | 0.7104 | 0.2183 | 0.9793 |
| 0.0231 | 36.3 | 1960 | 0.0687 | 0.7060 | 0.7741 | 0.9769 | nan | 0.9493 | 0.7574 | 0.8883 | 0.8302 | 0.2284 | 0.9912 | nan | 0.9052 | 0.6403 | 0.7898 | 0.7092 | 0.2118 | 0.9798 |
| 0.038 | 36.67 | 1980 | 0.0685 | 0.7082 | 0.7775 | 0.9767 | nan | 0.9640 | 0.7617 | 0.8762 | 0.8311 | 0.2431 | 0.9891 | nan | 0.9042 | 0.6457 | 0.7927 | 0.7064 | 0.2206 | 0.9795 |
| 0.0421 | 37.04 | 2000 | 0.0684 | 0.7083 | 0.7806 | 0.9767 | nan | 0.9523 | 0.7679 | 0.8937 | 0.8367 | 0.2427 | 0.9902 | nan | 0.9048 | 0.6430 | 0.7934 | 0.7069 | 0.2222 | 0.9796 |
| 0.0431 | 37.41 | 2020 | 0.0700 | 0.7097 | 0.7792 | 0.9763 | nan | 0.9580 | 0.7520 | 0.8796 | 0.8316 | 0.2641 | 0.9896 | nan | 0.9019 | 0.6332 | 0.7909 | 0.7144 | 0.2385 | 0.9793 |
| 0.0384 | 37.78 | 2040 | 0.0671 | 0.7123 | 0.7770 | 0.9774 | nan | 0.9580 | 0.7566 | 0.8859 | 0.8268 | 0.2441 | 0.9908 | nan | 0.9085 | 0.6542 | 0.7907 | 0.7163 | 0.2242 | 0.9799 |
| 0.0405 | 38.15 | 2060 | 0.0672 | 0.7141 | 0.7884 | 0.9772 | nan | 0.9559 | 0.7886 | 0.8953 | 0.8413 | 0.2596 | 0.9895 | nan | 0.9092 | 0.6515 | 0.7949 | 0.7149 | 0.2345 | 0.9797 |
| 0.0474 | 38.52 | 2080 | 0.0677 | 0.7122 | 0.7779 | 0.9773 | nan | 0.9611 | 0.7538 | 0.8965 | 0.8228 | 0.2431 | 0.9901 | nan | 0.9072 | 0.6535 | 0.7946 | 0.7159 | 0.2224 | 0.9798 |
| 0.0862 | 38.89 | 2100 | 0.0682 | 0.7115 | 0.7787 | 0.9772 | nan | 0.9539 | 0.7524 | 0.8878 | 0.8352 | 0.2516 | 0.9910 | nan | 0.9073 | 0.6464 | 0.7929 | 0.7136 | 0.2290 | 0.9798 |
| 0.0354 | 39.26 | 2120 | 0.0677 | 0.7085 | 0.7713 | 0.9772 | nan | 0.9562 | 0.7498 | 0.8778 | 0.8236 | 0.2290 | 0.9912 | nan | 0.9084 | 0.6464 | 0.7894 | 0.7146 | 0.2127 | 0.9796 |
| 0.0549 | 39.63 | 2140 | 0.0686 | 0.7079 | 0.7702 | 0.9768 | nan | 0.9573 | 0.7483 | 0.8772 | 0.8090 | 0.2386 | 0.9907 | nan | 0.9060 | 0.6389 | 0.7896 | 0.7132 | 0.2204 | 0.9794 |
| 0.0355 | 40.0 | 2160 | 0.0688 | 0.7131 | 0.7845 | 0.9768 | nan | 0.9595 | 0.7532 | 0.8882 | 0.8417 | 0.2747 | 0.9896 | nan | 0.9049 | 0.6461 | 0.7936 | 0.7110 | 0.2441 | 0.9793 |
| 2.1231 | 40.37 | 2180 | 0.0676 | 0.7069 | 0.7721 | 0.9769 | nan | 0.9521 | 0.7665 | 0.8752 | 0.8309 | 0.2170 | 0.9910 | nan | 0.9060 | 0.6463 | 0.7894 | 0.7156 | 0.2044 | 0.9796 |
| 0.0577 | 40.74 | 2200 | 0.0669 | 0.7129 | 0.7797 | 0.9774 | nan | 0.9582 | 0.7679 | 0.8834 | 0.8338 | 0.2445 | 0.9904 | nan | 0.9097 | 0.6600 | 0.7920 | 0.7108 | 0.2256 | 0.9796 |
| 0.0318 | 41.11 | 2220 | 0.0676 | 0.7131 | 0.7817 | 0.9771 | nan | 0.9615 | 0.7636 | 0.8916 | 0.8335 | 0.2504 | 0.9895 | nan | 0.9067 | 0.6543 | 0.7943 | 0.7147 | 0.2292 | 0.9795 |
| 0.0356 | 41.48 | 2240 | 0.0674 | 0.7167 | 0.7861 | 0.9773 | nan | 0.9582 | 0.7643 | 0.8956 | 0.8287 | 0.2800 | 0.9900 | nan | 0.9076 | 0.6530 | 0.7965 | 0.7154 | 0.2479 | 0.9797 |
| 0.0816 | 41.85 | 2260 | 0.0676 | 0.7126 | 0.7728 | 0.9774 | nan | 0.9568 | 0.7636 | 0.8714 | 0.8100 | 0.2439 | 0.9912 | nan | 0.9090 | 0.6544 | 0.7924 | 0.7146 | 0.2254 | 0.9797 |
| 0.0561 | 42.22 | 2280 | 0.0666 | 0.7130 | 0.7759 | 0.9775 | nan | 0.9537 | 0.7694 | 0.8763 | 0.8244 | 0.2400 | 0.9914 | nan | 0.9092 | 0.6624 | 0.7912 | 0.7133 | 0.2222 | 0.9797 |
| 0.0336 | 42.59 | 2300 | 0.0669 | 0.7173 | 0.7858 | 0.9776 | nan | 0.9553 | 0.7755 | 0.8866 | 0.8381 | 0.2685 | 0.9907 | nan | 0.9095 | 0.6654 | 0.7936 | 0.7138 | 0.2419 | 0.9798 |
| 0.0313 | 42.96 | 2320 | 0.0669 | 0.7119 | 0.7773 | 0.9775 | nan | 0.9560 | 0.7609 | 0.8968 | 0.8289 | 0.2304 | 0.9907 | nan | 0.9084 | 0.6581 | 0.7945 | 0.7150 | 0.2154 | 0.9798 |
| 0.0611 | 43.33 | 2340 | 0.0670 | 0.7090 | 0.7756 | 0.9772 | nan | 0.9547 | 0.7711 | 0.8810 | 0.8347 | 0.2215 | 0.9907 | nan | 0.9071 | 0.6520 | 0.7914 | 0.7153 | 0.2082 | 0.9798 |
| 0.0329 | 43.7 | 2360 | 0.0669 | 0.7146 | 0.7803 | 0.9775 | nan | 0.9577 | 0.7647 | 0.8782 | 0.8346 | 0.2555 | 0.9908 | nan | 0.9091 | 0.6560 | 0.7926 | 0.7162 | 0.2337 | 0.9800 |
| 0.0528 | 44.07 | 2380 | 0.0668 | 0.7131 | 0.7721 | 0.9776 | nan | 0.9594 | 0.7513 | 0.8762 | 0.8097 | 0.2449 | 0.9913 | nan | 0.9087 | 0.6565 | 0.7923 | 0.7147 | 0.2262 | 0.9799 |
| 0.0729 | 44.44 | 2400 | 0.0671 | 0.7131 | 0.7748 | 0.9775 | nan | 0.9578 | 0.7573 | 0.8777 | 0.8187 | 0.2461 | 0.9911 | nan | 0.9085 | 0.6566 | 0.7912 | 0.7152 | 0.2272 | 0.9798 |
| 0.0383 | 44.81 | 2420 | 0.0675 | 0.7108 | 0.7809 | 0.9771 | nan | 0.9506 | 0.7742 | 0.8796 | 0.8459 | 0.2443 | 0.9909 | nan | 0.9072 | 0.6499 | 0.7903 | 0.7116 | 0.2262 | 0.9798 |
| 0.0565 | 45.19 | 2440 | 0.0674 | 0.7154 | 0.7821 | 0.9774 | nan | 0.9590 | 0.7609 | 0.8808 | 0.8296 | 0.2720 | 0.9905 | nan | 0.9086 | 0.6546 | 0.7931 | 0.7129 | 0.2436 | 0.9797 |
| 0.0417 | 45.56 | 2460 | 0.0671 | 0.7149 | 0.7809 | 0.9776 | nan | 0.9563 | 0.7631 | 0.8843 | 0.8383 | 0.2524 | 0.9909 | nan | 0.9095 | 0.6570 | 0.7939 | 0.7174 | 0.2314 | 0.9799 |
| 0.024 | 45.93 | 2480 | 0.0678 | 0.7159 | 0.7872 | 0.9772 | nan | 0.9564 | 0.7709 | 0.8828 | 0.8458 | 0.2769 | 0.9902 | nan | 0.9074 | 0.6549 | 0.7927 | 0.7148 | 0.2458 | 0.9797 |
| 0.0496 | 46.3 | 2500 | 0.0668 | 0.7148 | 0.7836 | 0.9775 | nan | 0.9554 | 0.7648 | 0.8905 | 0.8390 | 0.2614 | 0.9907 | nan | 0.9092 | 0.6567 | 0.7931 | 0.7131 | 0.2368 | 0.9799 |
| 0.0428 | 46.67 | 2520 | 0.0668 | 0.7150 | 0.7857 | 0.9773 | nan | 0.9571 | 0.7641 | 0.8969 | 0.8438 | 0.2624 | 0.9902 | nan | 0.9083 | 0.6559 | 0.7941 | 0.7144 | 0.2372 | 0.9798 |
| 0.0458 | 47.04 | 2540 | 0.0665 | 0.7141 | 0.7811 | 0.9775 | nan | 0.9540 | 0.7665 | 0.8957 | 0.8351 | 0.2443 | 0.9908 | nan | 0.9088 | 0.6565 | 0.7946 | 0.7192 | 0.2257 | 0.9799 |
| 0.0429 | 47.41 | 2560 | 0.0673 | 0.7131 | 0.7791 | 0.9773 | nan | 0.9604 | 0.7621 | 0.8836 | 0.8325 | 0.2457 | 0.9901 | nan | 0.9073 | 0.6536 | 0.7936 | 0.7180 | 0.2266 | 0.9797 |
| 0.0449 | 47.78 | 2580 | 0.0666 | 0.7144 | 0.7786 | 0.9775 | nan | 0.9571 | 0.7630 | 0.8873 | 0.8248 | 0.2484 | 0.9908 | nan | 0.9089 | 0.6565 | 0.7944 | 0.7188 | 0.2281 | 0.9799 |
| 0.0302 | 48.15 | 2600 | 0.0665 | 0.7155 | 0.7800 | 0.9776 | nan | 0.9552 | 0.7637 | 0.8904 | 0.8251 | 0.2545 | 0.9911 | nan | 0.9094 | 0.6580 | 0.7936 | 0.7196 | 0.2326 | 0.9799 |
| 0.029 | 48.52 | 2620 | 0.0675 | 0.7176 | 0.7877 | 0.9774 | nan | 0.9588 | 0.7640 | 0.8947 | 0.8445 | 0.2744 | 0.9901 | nan | 0.9081 | 0.6575 | 0.7948 | 0.7204 | 0.2447 | 0.9798 |
| 1.9447 | 48.89 | 2640 | 0.0662 | 0.7130 | 0.7803 | 0.9774 | nan | 0.9529 | 0.7688 | 0.8720 | 0.8497 | 0.2471 | 0.9912 | nan | 0.9085 | 0.6550 | 0.7904 | 0.7170 | 0.2272 | 0.9799 |
| 0.0247 | 49.26 | 2660 | 0.0674 | 0.7163 | 0.7870 | 0.9773 | nan | 0.9593 | 0.7720 | 0.8815 | 0.8486 | 0.2704 | 0.9899 | nan | 0.9077 | 0.6575 | 0.7928 | 0.7181 | 0.2422 | 0.9797 |
| 0.0369 | 49.63 | 2680 | 0.0662 | 0.7154 | 0.7839 | 0.9775 | nan | 0.9547 | 0.7711 | 0.8850 | 0.8430 | 0.2588 | 0.9907 | nan | 0.9087 | 0.6571 | 0.7934 | 0.7181 | 0.2354 | 0.9799 |
| 0.0317 | 50.0 | 2700 | 0.0665 | 0.7168 | 0.7840 | 0.9775 | nan | 0.9559 | 0.7693 | 0.8882 | 0.8345 | 0.2653 | 0.9907 | nan | 0.9088 | 0.6583 | 0.7943 | 0.7201 | 0.2393 | 0.9799 |
### Framework versions
- Transformers 4.36.2
- Pytorch 2.1.2+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
|