--- license: other tags: - vision - image-segmentation - generated_from_trainer model-index: - name: safety-utcustom-train-SF-RGB-b5 results: [] --- # safety-utcustom-train-SF-RGB-b5 This model is a fine-tuned version of [nvidia/mit-b5](https://huggingface.co/nvidia/mit-b5) on the sam1120/safety-utcustom-TRAIN dataset. It achieves the following results on the evaluation set: - Loss: 0.2236 - Mean Iou: 0.5051 - Mean Accuracy: 0.8441 - Overall Accuracy: 0.9820 - Accuracy Unlabeled: nan - Accuracy Safe: 0.6977 - Accuracy Unsafe: 0.9906 - Iou Unlabeled: 0.0 - Iou Safe: 0.5337 - Iou Unsafe: 0.9816 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 3e-06 - train_batch_size: 15 - eval_batch_size: 15 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_ratio: 0.05 - num_epochs: 130 ### Training results | Training Loss | Epoch | Step | Accuracy Safe | Accuracy Unlabeled | Accuracy Unsafe | Iou Safe | Iou Unlabeled | Iou Unsafe | Validation Loss | Mean Accuracy | Mean Iou | Overall Accuracy | |:-------------:|:------:|:----:|:-------------:|:------------------:|:---------------:|:--------:|:-------------:|:----------:|:---------------:|:-------------:|:--------:|:----------------:| | 1.2239 | 0.91 | 10 | 0.3992 | nan | 0.2951 | 0.0314 | 0.0 | 0.2939 | 1.1103 | 0.3472 | 0.1084 | 0.2982 | | 1.1948 | 1.82 | 20 | 0.5219 | nan | 0.3705 | 0.0440 | 0.0 | 0.3689 | 1.0963 | 0.4462 | 0.1376 | 0.3750 | | 1.1661 | 2.73 | 30 | 0.5863 | nan | 0.4988 | 0.0647 | 0.0 | 0.4961 | 1.0516 | 0.5426 | 0.1870 | 0.5014 | | 1.1112 | 3.64 | 40 | 0.5459 | nan | 0.5794 | 0.0900 | 0.0 | 0.5754 | 1.0048 | 0.5626 | 0.2218 | 0.5784 | | 1.0907 | 4.55 | 50 | 0.5993 | nan | 0.6367 | 0.1094 | 0.0 | 0.6321 | 0.9690 | 0.6180 | 0.2472 | 0.6356 | | 1.047 | 5.45 | 60 | 0.6692 | nan | 0.6699 | 0.1159 | 0.0 | 0.6656 | 0.9437 | 0.6695 | 0.2605 | 0.6699 | | 1.0112 | 6.36 | 70 | 0.6673 | nan | 0.7189 | 0.1349 | 0.0 | 0.7137 | 0.9084 | 0.6931 | 0.2829 | 0.7173 | | 0.9925 | 7.27 | 80 | 0.6842 | nan | 0.7665 | 0.1452 | 0.0 | 0.7605 | 0.8647 | 0.7254 | 0.3019 | 0.7641 | | 0.9395 | 8.18 | 90 | 0.6818 | nan | 0.7921 | 0.1620 | 0.0 | 0.7856 | 0.8319 | 0.7369 | 0.3159 | 0.7888 | | 0.8902 | 9.09 | 100 | 0.6806 | nan | 0.8142 | 0.1770 | 0.0 | 0.8072 | 0.8014 | 0.7474 | 0.3281 | 0.8102 | | 0.9057 | 10.0 | 110 | 0.6984 | nan | 0.8179 | 0.1733 | 0.0 | 0.8109 | 0.7867 | 0.7581 | 0.3281 | 0.8143 | | 0.8321 | 10.91 | 120 | 0.6744 | nan | 0.8494 | 0.1862 | 0.0 | 0.8413 | 0.7440 | 0.7619 | 0.3425 | 0.8442 | | 0.8152 | 11.82 | 130 | 0.6688 | nan | 0.8590 | 0.2006 | 0.0 | 0.8507 | 0.7270 | 0.7639 | 0.3504 | 0.8534 | | 0.7929 | 12.73 | 140 | 0.6660 | nan | 0.8657 | 0.2085 | 0.0 | 0.8572 | 0.7045 | 0.7658 | 0.3553 | 0.8598 | | 0.7568 | 13.64 | 150 | 0.6571 | nan | 0.8838 | 0.2185 | 0.0 | 0.8748 | 0.6744 | 0.7704 | 0.3644 | 0.8771 | | 0.7085 | 14.55 | 160 | 0.6519 | nan | 0.8934 | 0.2260 | 0.0 | 0.8842 | 0.6556 | 0.7727 | 0.3701 | 0.8863 | | 0.7147 | 15.45 | 170 | 0.6561 | nan | 0.8964 | 0.2283 | 0.0 | 0.8872 | 0.6509 | 0.7762 | 0.3718 | 0.8893 | | 0.6991 | 16.36 | 180 | 0.6620 | nan | 0.8964 | 0.2267 | 0.0 | 0.8874 | 0.6502 | 0.7792 | 0.3714 | 0.8895 | | 0.6357 | 17.27 | 190 | 0.6612 | nan | 0.9051 | 0.2411 | 0.0 | 0.8960 | 0.6230 | 0.7831 | 0.3790 | 0.8979 | | 0.6815 | 18.18 | 200 | 0.6484 | nan | 0.9178 | 0.2594 | 0.0 | 0.9082 | 0.5993 | 0.7831 | 0.3892 | 0.9098 | | 0.6398 | 19.09 | 210 | 0.6414 | nan | 0.9258 | 0.2682 | 0.0 | 0.9159 | 0.5785 | 0.7836 | 0.3947 | 0.9174 | | 0.5845 | 20.0 | 220 | 0.6426 | nan | 0.9286 | 0.2698 | 0.0 | 0.9187 | 0.5641 | 0.7856 | 0.3962 | 0.9202 | | 0.6062 | 20.91 | 230 | 0.6520 | nan | 0.9252 | 0.2641 | 0.0 | 0.9156 | 0.5693 | 0.7886 | 0.3932 | 0.9171 | | 0.6071 | 21.82 | 240 | 0.6592 | nan | 0.9283 | 0.2675 | 0.0 | 0.9188 | 0.5627 | 0.7937 | 0.3955 | 0.9203 | | 0.6209 | 22.73 | 250 | 0.6619 | nan | 0.9300 | 0.2724 | 0.0 | 0.9205 | 0.5632 | 0.7959 | 0.3977 | 0.9220 | | 0.5609 | 23.64 | 260 | 0.6505 | nan | 0.9379 | 0.2868 | 0.0 | 0.9281 | 0.5416 | 0.7942 | 0.4050 | 0.9294 | | 0.5752 | 24.55 | 270 | 0.6412 | nan | 0.9451 | 0.2983 | 0.0 | 0.9350 | 0.5141 | 0.7932 | 0.4111 | 0.9362 | | 0.6004 | 25.45 | 280 | 0.6492 | nan | 0.9412 | 0.2907 | 0.0 | 0.9313 | 0.5255 | 0.7952 | 0.4073 | 0.9326 | | 0.5524 | 26.36 | 290 | 0.6588 | nan | 0.9387 | 0.2868 | 0.0 | 0.9291 | 0.5314 | 0.7987 | 0.4053 | 0.9304 | | 0.5758 | 27.27 | 300 | 0.6544 | nan | 0.9423 | 0.2913 | 0.0 | 0.9326 | 0.5268 | 0.7984 | 0.4080 | 0.9338 | | 0.5598 | 28.18 | 310 | 0.6605 | nan | 0.9408 | 0.2897 | 0.0 | 0.9312 | 0.5240 | 0.8006 | 0.4070 | 0.9325 | | 0.5505 | 29.09 | 320 | 0.6582 | nan | 0.9421 | 0.2959 | 0.0 | 0.9324 | 0.5165 | 0.8002 | 0.4094 | 0.9337 | | 0.5754 | 30.0 | 330 | 0.6578 | nan | 0.9433 | 0.2959 | 0.0 | 0.9336 | 0.5145 | 0.8005 | 0.4098 | 0.9348 | | 0.5284 | 30.91 | 340 | 0.6719 | nan | 0.9411 | 0.2941 | 0.0 | 0.9318 | 0.5175 | 0.8065 | 0.4086 | 0.9331 | | 0.5463 | 31.82 | 350 | 0.6684 | nan | 0.9448 | 0.3020 | 0.0 | 0.9354 | 0.5016 | 0.8066 | 0.4125 | 0.9367 | | 0.4923 | 32.73 | 360 | 0.6688 | nan | 0.9463 | 0.3066 | 0.0 | 0.9369 | 0.4947 | 0.8075 | 0.4145 | 0.9381 | | 0.4922 | 33.64 | 370 | 0.6685 | nan | 0.9504 | 0.3165 | 0.0 | 0.9409 | 0.4738 | 0.8094 | 0.4191 | 0.9420 | | 0.4976 | 34.55 | 380 | 0.6748 | nan | 0.9535 | 0.3233 | 0.0 | 0.9443 | 0.4663 | 0.8142 | 0.4225 | 0.9453 | | 0.4922 | 35.45 | 390 | 0.6509 | nan | 0.9653 | 0.3484 | 0.0 | 0.9552 | 0.4295 | 0.8081 | 0.4345 | 0.9560 | | 0.4608 | 36.36 | 400 | 0.6580 | nan | 0.9637 | 0.3507 | 0.0 | 0.9538 | 0.4434 | 0.8109 | 0.4348 | 0.9547 | | 0.4836 | 37.27 | 410 | 0.6522 | nan | 0.9662 | 0.3588 | 0.0 | 0.9561 | 0.4328 | 0.8092 | 0.4383 | 0.9569 | | 0.459 | 38.18 | 420 | 0.6477 | nan | 0.9691 | 0.3632 | 0.0 | 0.9588 | 0.4211 | 0.8084 | 0.4407 | 0.9596 | | 0.4528 | 39.09 | 430 | 0.6593 | nan | 0.9668 | 0.3574 | 0.0 | 0.9569 | 0.4239 | 0.8131 | 0.4381 | 0.9577 | | 0.4202 | 40.0 | 440 | 0.6572 | nan | 0.9689 | 0.3650 | 0.0 | 0.9590 | 0.4141 | 0.8130 | 0.4413 | 0.9597 | | 0.4805 | 40.91 | 450 | 0.6470 | nan | 0.9724 | 0.3754 | 0.0 | 0.9621 | 0.4012 | 0.8097 | 0.4458 | 0.9628 | | 0.4611 | 41.82 | 460 | 0.6525 | nan | 0.9718 | 0.3716 | 0.0 | 0.9617 | 0.4025 | 0.8122 | 0.4444 | 0.9624 | | 0.4339 | 42.73 | 470 | 0.6487 | nan | 0.9726 | 0.3744 | 0.0 | 0.9624 | 0.3951 | 0.8107 | 0.4456 | 0.9631 | | 0.4361 | 43.64 | 480 | 0.6448 | nan | 0.9740 | 0.3769 | 0.0 | 0.9636 | 0.3946 | 0.8094 | 0.4468 | 0.9643 | | 0.4416 | 44.55 | 490 | 0.6447 | nan | 0.9746 | 0.3783 | 0.0 | 0.9642 | 0.3871 | 0.8097 | 0.4475 | 0.9649 | | 0.4524 | 45.45 | 500 | 0.6589 | nan | 0.9712 | 0.3701 | 0.0 | 0.9612 | 0.4025 | 0.8151 | 0.4438 | 0.9620 | | 0.4319 | 46.36 | 510 | 0.6730 | nan | 0.9673 | 0.3594 | 0.0 | 0.9578 | 0.4169 | 0.8202 | 0.4391 | 0.9586 | | 0.4224 | 47.27 | 520 | 0.6603 | nan | 0.9712 | 0.3716 | 0.0 | 0.9613 | 0.3986 | 0.8158 | 0.4443 | 0.9620 | | 0.4333 | 48.18 | 530 | 0.6650 | nan | 0.9703 | 0.3724 | 0.0 | 0.9605 | 0.4038 | 0.8176 | 0.4443 | 0.9612 | | 0.3916 | 49.09 | 540 | 0.6624 | nan | 0.9724 | 0.3781 | 0.0 | 0.9626 | 0.3968 | 0.8174 | 0.4469 | 0.9633 | | 0.4803 | 50.0 | 550 | 0.6680 | nan | 0.9726 | 0.3809 | 0.0 | 0.9629 | 0.3942 | 0.8203 | 0.4479 | 0.9636 | | 0.3543 | 50.91 | 560 | 0.6473 | nan | 0.9777 | 0.3952 | 0.0 | 0.9673 | 0.3697 | 0.8125 | 0.4542 | 0.9680 | | 0.3684 | 51.82 | 570 | 0.6515 | nan | 0.9772 | 0.3951 | 0.0 | 0.9670 | 0.3708 | 0.8143 | 0.4540 | 0.9676 | | 0.4004 | 52.73 | 580 | 0.6437 | nan | 0.9793 | 0.4014 | 0.0 | 0.9688 | 0.3585 | 0.8115 | 0.4567 | 0.9694 | | 0.3656 | 53.64 | 590 | 0.6559 | nan | 0.9780 | 0.4010 | 0.0 | 0.9679 | 0.3654 | 0.8169 | 0.4563 | 0.9685 | | 0.3918 | 54.55 | 600 | 0.6432 | nan | 0.9809 | 0.4115 | 0.0 | 0.9704 | 0.3527 | 0.8121 | 0.4606 | 0.9709 | | 0.3741 | 55.45 | 610 | 0.6393 | nan | 0.9827 | 0.4185 | 0.0 | 0.9720 | 0.3361 | 0.8110 | 0.4635 | 0.9726 | | 0.3656 | 56.36 | 620 | 0.6540 | nan | 0.9807 | 0.4147 | 0.0 | 0.9705 | 0.3473 | 0.8174 | 0.4617 | 0.9710 | | 0.3341 | 57.27 | 630 | 0.6258 | nan | 0.9845 | 0.4247 | 0.0 | 0.9734 | 0.3335 | 0.8052 | 0.4660 | 0.9739 | | 0.3669 | 58.18 | 640 | 0.6495 | nan | 0.9815 | 0.4190 | 0.0 | 0.9712 | 0.3395 | 0.8155 | 0.4634 | 0.9717 | | 0.3347 | 59.09 | 650 | 0.6612 | nan | 0.9800 | 0.4174 | 0.0 | 0.9700 | 0.3416 | 0.8206 | 0.4625 | 0.9706 | | 0.4287 | 60.0 | 660 | 0.6673 | nan | 0.9797 | 0.4185 | 0.0 | 0.9699 | 0.3419 | 0.8235 | 0.4628 | 0.9705 | | 0.3838 | 60.91 | 670 | 0.6611 | nan | 0.9812 | 0.4227 | 0.0 | 0.9712 | 0.3381 | 0.8211 | 0.4646 | 0.9718 | | 0.352 | 61.82 | 680 | 0.6407 | nan | 0.9845 | 0.4318 | 0.0 | 0.9738 | 0.3216 | 0.8126 | 0.4685 | 0.9743 | | 0.3343 | 62.73 | 690 | 0.6499 | nan | 0.9837 | 0.4311 | 0.0 | 0.9733 | 0.3275 | 0.8168 | 0.4681 | 0.9738 | | 0.3443 | 63.64 | 700 | 0.6528 | nan | 0.9836 | 0.4324 | 0.0 | 0.9733 | 0.3273 | 0.8182 | 0.4686 | 0.9738 | | 0.3183 | 64.55 | 710 | 0.6456 | nan | 0.9848 | 0.4367 | 0.0 | 0.9743 | 0.3155 | 0.8152 | 0.4703 | 0.9748 | | 0.3346 | 65.45 | 720 | 0.6517 | nan | 0.9841 | 0.4356 | 0.0 | 0.9738 | 0.3212 | 0.8179 | 0.4698 | 0.9743 | | 0.3225 | 66.36 | 730 | 0.6367 | nan | 0.9863 | 0.4432 | 0.0 | 0.9755 | 0.3052 | 0.8115 | 0.4729 | 0.9759 | | 0.3792 | 67.27 | 740 | 0.6381 | nan | 0.9861 | 0.4429 | 0.0 | 0.9753 | 0.3037 | 0.8121 | 0.4728 | 0.9758 | | 0.3177 | 68.18 | 750 | 0.6345 | nan | 0.9865 | 0.4446 | 0.0 | 0.9756 | 0.2989 | 0.8105 | 0.4734 | 0.9761 | | 0.3295 | 69.09 | 760 | 0.6404 | nan | 0.9859 | 0.4426 | 0.0 | 0.9752 | 0.3064 | 0.8131 | 0.4726 | 0.9757 | | 0.3847 | 70.0 | 770 | 0.6429 | nan | 0.9857 | 0.4439 | 0.0 | 0.9751 | 0.3054 | 0.8143 | 0.4730 | 0.9756 | | 0.3406 | 70.91 | 780 | 0.6443 | nan | 0.9862 | 0.4476 | 0.0 | 0.9756 | 0.3075 | 0.8152 | 0.4744 | 0.9761 | | 0.3847 | 71.82 | 790 | 0.6343 | nan | 0.9877 | 0.4546 | 0.0 | 0.9769 | 0.2911 | 0.8110 | 0.4772 | 0.9773 | | 0.3292 | 72.73 | 800 | 0.6328 | nan | 0.9881 | 0.4567 | 0.0 | 0.9771 | 0.2905 | 0.8105 | 0.4779 | 0.9776 | | 0.3156 | 73.64 | 810 | 0.6318 | nan | 0.9882 | 0.4579 | 0.0 | 0.9773 | 0.2865 | 0.8100 | 0.4784 | 0.9777 | | 0.3106 | 74.55 | 820 | 0.6333 | nan | 0.9884 | 0.4600 | 0.0 | 0.9775 | 0.2812 | 0.8109 | 0.4792 | 0.9779 | | 0.3004 | 75.45 | 830 | 0.6232 | nan | 0.9893 | 0.4632 | 0.0 | 0.9781 | 0.2798 | 0.8063 | 0.4804 | 0.9785 | | 0.3336 | 76.36 | 840 | 0.6485 | nan | 0.9872 | 0.4593 | 0.0 | 0.9768 | 0.2954 | 0.8178 | 0.4787 | 0.9772 | | 0.299 | 77.27 | 850 | 0.6490 | nan | 0.9874 | 0.4613 | 0.0 | 0.9769 | 0.2909 | 0.8182 | 0.4794 | 0.9774 | | 0.292 | 78.18 | 860 | 0.6497 | nan | 0.9875 | 0.4629 | 0.0 | 0.9771 | 0.2853 | 0.8186 | 0.4800 | 0.9775 | | 0.2922 | 79.09 | 870 | 0.6586 | nan | 0.9866 | 0.4601 | 0.0 | 0.9765 | 0.2917 | 0.8226 | 0.4789 | 0.9770 | | 0.3583 | 80.0 | 880 | 0.6515 | nan | 0.9876 | 0.4644 | 0.0 | 0.9772 | 0.2876 | 0.8195 | 0.4805 | 0.9776 | | 0.293 | 80.91 | 890 | 0.6465 | nan | 0.9882 | 0.4674 | 0.0 | 0.9777 | 0.2767 | 0.8173 | 0.4817 | 0.9781 | | 0.3287 | 81.82 | 900 | 0.6518 | nan | 0.9876 | 0.4652 | 0.0 | 0.9773 | 0.2858 | 0.8197 | 0.4808 | 0.9777 | | 0.3067 | 82.73 | 910 | 0.6528 | nan | 0.9875 | 0.4654 | 0.0 | 0.9772 | 0.2861 | 0.8202 | 0.4809 | 0.9776 | | 0.3374 | 83.64 | 920 | 0.6577 | nan | 0.9870 | 0.4631 | 0.0 | 0.9768 | 0.2869 | 0.8224 | 0.4800 | 0.9773 | | 0.3171 | 84.55 | 930 | 0.6442 | nan | 0.9887 | 0.4714 | 0.0 | 0.9781 | 0.2706 | 0.8164 | 0.4832 | 0.9785 | | 0.3156 | 85.45 | 940 | 0.6321 | nan | 0.9899 | 0.4757 | 0.0 | 0.9789 | 0.2708 | 0.8110 | 0.4849 | 0.9793 | | 0.2749 | 86.36 | 950 | 0.6518 | nan | 0.9887 | 0.4765 | 0.0 | 0.9783 | 0.2760 | 0.8202 | 0.4850 | 0.9787 | | 0.2725 | 87.27 | 960 | 0.6681 | nan | 0.9876 | 0.4765 | 0.0 | 0.9777 | 0.2780 | 0.8279 | 0.4847 | 0.9782 | | 0.2948 | 88.18 | 970 | 0.6565 | nan | 0.9891 | 0.4845 | 0.0 | 0.9788 | 0.2636 | 0.8228 | 0.4878 | 0.9793 | | 0.2972 | 89.09 | 980 | 0.6722 | nan | 0.9879 | 0.4829 | 0.0 | 0.9782 | 0.2770 | 0.8301 | 0.4870 | 0.9786 | | 0.3101 | 90.0 | 990 | 0.6711 | nan | 0.9882 | 0.4859 | 0.0 | 0.9784 | 0.2765 | 0.8297 | 0.4881 | 0.9788 | | 0.2874 | 90.91 | 1000 | 0.6689 | nan | 0.9888 | 0.4899 | 0.0 | 0.9789 | 0.2690 | 0.8288 | 0.4896 | 0.9793 | | 0.275 | 91.82 | 1010 | 0.6542 | nan | 0.9901 | 0.4947 | 0.0 | 0.9798 | 0.2593 | 0.8221 | 0.4915 | 0.9802 | | 0.2711 | 92.73 | 1020 | 0.6673 | nan | 0.9893 | 0.4957 | 0.0 | 0.9794 | 0.2608 | 0.8283 | 0.4917 | 0.9798 | | 0.2691 | 93.64 | 1030 | 0.6819 | nan | 0.9884 | 0.4954 | 0.0 | 0.9789 | 0.2609 | 0.8352 | 0.4915 | 0.9794 | | 0.274 | 94.55 | 1040 | 0.6722 | nan | 0.9895 | 0.5007 | 0.0 | 0.9797 | 0.2542 | 0.8309 | 0.4935 | 0.9801 | | 0.27 | 95.45 | 1050 | 0.6436 | nan | 0.9919 | 0.5087 | 0.0 | 0.9812 | 0.2357 | 0.8177 | 0.4966 | 0.9816 | | 0.255 | 96.36 | 1060 | 0.6671 | nan | 0.9903 | 0.5074 | 0.0 | 0.9804 | 0.2460 | 0.8287 | 0.4959 | 0.9808 | | 0.2756 | 97.27 | 1070 | 0.6634 | nan | 0.9909 | 0.5113 | 0.0 | 0.9809 | 0.2411 | 0.8271 | 0.4974 | 0.9812 | | 0.2473 | 98.18 | 1080 | 0.6724 | nan | 0.9904 | 0.5116 | 0.0 | 0.9806 | 0.2447 | 0.8314 | 0.4974 | 0.9810 | | 0.266 | 99.09 | 1090 | 0.6778 | nan | 0.9901 | 0.5118 | 0.0 | 0.9804 | 0.2455 | 0.8339 | 0.4974 | 0.9808 | | 0.2682 | 100.0 | 1100 | 0.6651 | nan | 0.9911 | 0.5156 | 0.0 | 0.9811 | 0.2359 | 0.8281 | 0.4989 | 0.9815 | | 0.2607 | 100.91 | 1110 | 0.6739 | nan | 0.9905 | 0.5144 | 0.0 | 0.9808 | 0.2376 | 0.8322 | 0.4984 | 0.9812 | | 0.2506 | 101.82 | 1120 | 0.6727 | nan | 0.9907 | 0.5153 | 0.0 | 0.9809 | 0.2380 | 0.8317 | 0.4987 | 0.9813 | | 0.2729 | 102.73 | 1130 | 0.6802 | nan | 0.9902 | 0.5146 | 0.0 | 0.9806 | 0.2375 | 0.8352 | 0.4984 | 0.9810 | | 0.2348 | 103.64 | 1140 | 0.6731 | nan | 0.9908 | 0.5172 | 0.0 | 0.9810 | 0.2335 | 0.8319 | 0.4994 | 0.9814 | | 0.2409 | 104.55 | 1150 | 0.6781 | nan | 0.9904 | 0.5164 | 0.0 | 0.9808 | 0.2385 | 0.8343 | 0.4991 | 0.9812 | | 0.2737 | 105.45 | 1160 | 0.6774 | nan | 0.9906 | 0.5177 | 0.0 | 0.9809 | 0.2357 | 0.8340 | 0.4995 | 0.9813 | | 0.2857 | 106.36 | 1170 | 0.6659 | nan | 0.9915 | 0.5203 | 0.0 | 0.9815 | 0.2304 | 0.8287 | 0.5006 | 0.9818 | | 0.2503 | 107.27 | 1180 | 0.6822 | nan | 0.9902 | 0.5172 | 0.0 | 0.9807 | 0.2397 | 0.8362 | 0.4993 | 0.9811 | | 0.2524 | 108.18 | 1190 | 0.6741 | nan | 0.9909 | 0.5199 | 0.0 | 0.9812 | 0.2294 | 0.8325 | 0.5004 | 0.9816 | | 0.2722 | 109.09 | 1200 | 0.6928 | nan | 0.9894 | 0.5145 | 0.0 | 0.9802 | 0.2461 | 0.8411 | 0.4982 | 0.9806 | | 0.2761 | 110.0 | 1210 | 0.2530 | 0.4979 | 0.8435 | 0.9804 | nan | 0.6981 | 0.9889 | 0.0 | 0.5136 | 0.9799 | | 0.2595 | 110.91 | 1220 | 0.2386 | 0.5002 | 0.8395 | 0.9811 | nan | 0.6891 | 0.9900 | 0.0 | 0.5197 | 0.9808 | | 0.2877 | 111.82 | 1230 | 0.2260 | 0.5022 | 0.8345 | 0.9819 | nan | 0.6779 | 0.9911 | 0.0 | 0.5251 | 0.9815 | | 0.2307 | 112.73 | 1240 | 0.2219 | 0.5031 | 0.8317 | 0.9822 | nan | 0.6717 | 0.9916 | 0.0 | 0.5275 | 0.9818 | | 0.2559 | 113.64 | 1250 | 0.2382 | 0.5011 | 0.8413 | 0.9812 | nan | 0.6927 | 0.9900 | 0.0 | 0.5224 | 0.9808 | | 0.2668 | 114.55 | 1260 | 0.2275 | 0.5024 | 0.8395 | 0.9816 | nan | 0.6883 | 0.9906 | 0.0 | 0.5258 | 0.9813 | | 0.2269 | 115.45 | 1270 | 0.2212 | 0.5038 | 0.8356 | 0.9821 | nan | 0.6798 | 0.9913 | 0.0 | 0.5296 | 0.9818 | | 0.2713 | 116.36 | 1280 | 0.2265 | 0.5041 | 0.8365 | 0.9821 | nan | 0.6817 | 0.9913 | 0.0 | 0.5305 | 0.9818 | | 0.2351 | 117.27 | 1290 | 0.2113 | 0.5064 | 0.8255 | 0.9832 | nan | 0.6580 | 0.9931 | 0.0 | 0.5363 | 0.9828 | | 0.2306 | 118.18 | 1300 | 0.2258 | 0.5053 | 0.8354 | 0.9824 | nan | 0.6791 | 0.9917 | 0.0 | 0.5337 | 0.9821 | | 0.2371 | 119.09 | 1310 | 0.2234 | 0.5057 | 0.8342 | 0.9826 | nan | 0.6765 | 0.9919 | 0.0 | 0.5348 | 0.9822 | | 0.277 | 120.0 | 1320 | 0.2263 | 0.5061 | 0.8340 | 0.9827 | nan | 0.6760 | 0.9920 | 0.0 | 0.5359 | 0.9823 | | 0.2121 | 120.91 | 1330 | 0.2191 | 0.5065 | 0.8337 | 0.9828 | nan | 0.6752 | 0.9921 | 0.0 | 0.5370 | 0.9824 | | 0.2426 | 121.82 | 1340 | 0.2237 | 0.5055 | 0.8400 | 0.9822 | nan | 0.6889 | 0.9912 | 0.0 | 0.5345 | 0.9819 | | 0.2429 | 122.73 | 1350 | 0.2106 | 0.5069 | 0.8340 | 0.9829 | nan | 0.6757 | 0.9922 | 0.0 | 0.5383 | 0.9825 | | 0.244 | 123.64 | 1360 | 0.2133 | 0.5062 | 0.8395 | 0.9824 | nan | 0.6876 | 0.9914 | 0.0 | 0.5364 | 0.9821 | | 0.2287 | 124.55 | 1370 | 0.2126 | 0.5068 | 0.8371 | 0.9827 | nan | 0.6823 | 0.9918 | 0.0 | 0.5381 | 0.9823 | | 0.2223 | 125.45 | 1380 | 0.1988 | 0.5083 | 0.8305 | 0.9833 | nan | 0.6681 | 0.9929 | 0.0 | 0.5420 | 0.9830 | | 0.2275 | 126.36 | 1390 | 0.2164 | 0.5061 | 0.8409 | 0.9823 | nan | 0.6906 | 0.9912 | 0.0 | 0.5363 | 0.9820 | | 0.2378 | 127.27 | 1400 | 0.2201 | 0.5062 | 0.8405 | 0.9824 | nan | 0.6898 | 0.9913 | 0.0 | 0.5365 | 0.9820 | | 0.2385 | 128.18 | 1410 | 0.2286 | 0.5046 | 0.8455 | 0.9818 | nan | 0.7006 | 0.9903 | 0.0 | 0.5324 | 0.9814 | | 0.2787 | 129.09 | 1420 | 0.2157 | 0.5063 | 0.8405 | 0.9824 | nan | 0.6896 | 0.9913 | 0.0 | 0.5369 | 0.9820 | | 0.2377 | 130.0 | 1430 | 0.2236 | 0.5051 | 0.8441 | 0.9820 | nan | 0.6977 | 0.9906 | 0.0 | 0.5337 | 0.9816 | ### Framework versions - Transformers 4.30.2 - Pytorch 2.0.1+cu117 - Datasets 2.13.1 - Tokenizers 0.13.3