--- license: other base_model: nvidia/mit-b5 tags: - vision - image-segmentation - generated_from_trainer model-index: - name: SegFormer_Mixed_Set2_788images_mit-b5_RGB results: [] --- # SegFormer_Mixed_Set2_788images_mit-b5_RGB This model is a fine-tuned version of [nvidia/mit-b5](https://huggingface.co/nvidia/mit-b5) on the Hasano20/Mixed_Set2_788images dataset. It achieves the following results on the evaluation set: - Train-Loss: 0.0099 - Loss: 0.0150 - Mean Iou: 0.9788 - Mean Accuracy: 0.9887 - Overall Accuracy: 0.9948 - Accuracy Background: 0.9958 - Accuracy Melt: 0.9735 - Accuracy Substrate: 0.9969 - Iou Background: 0.9926 - Iou Melt: 0.9509 - Iou Substrate: 0.9927 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: cosine - lr_scheduler_warmup_steps: 100 - num_epochs: 50 ### Training results | Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Background | Accuracy Melt | Accuracy Substrate | Iou Background | Iou Melt | Iou Substrate | |:-------------:|:-------:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:-------------------:|:-------------:|:------------------:|:--------------:|:--------:|:-------------:| | 0.1619 | 0.7042 | 50 | 0.1799 | 0.7782 | 0.8306 | 0.9444 | 0.9902 | 0.5371 | 0.9645 | 0.9436 | 0.4720 | 0.9192 | | 0.062 | 1.4085 | 100 | 0.1065 | 0.8361 | 0.8630 | 0.9638 | 0.9833 | 0.6084 | 0.9972 | 0.9720 | 0.5922 | 0.9441 | | 0.1757 | 2.1127 | 150 | 0.1157 | 0.8551 | 0.8896 | 0.9617 | 0.9803 | 0.7065 | 0.9820 | 0.9484 | 0.6731 | 0.9438 | | 0.0872 | 2.8169 | 200 | 0.0446 | 0.9302 | 0.9539 | 0.9844 | 0.9938 | 0.8760 | 0.9920 | 0.9846 | 0.8282 | 0.9777 | | 0.0336 | 3.5211 | 250 | 0.0338 | 0.9469 | 0.9751 | 0.9877 | 0.9913 | 0.9431 | 0.9910 | 0.9857 | 0.8719 | 0.9831 | | 0.0417 | 4.2254 | 300 | 0.0488 | 0.9281 | 0.9820 | 0.9830 | 0.9941 | 0.9765 | 0.9753 | 0.9877 | 0.8233 | 0.9732 | | 0.0273 | 4.9296 | 350 | 0.0295 | 0.9516 | 0.9628 | 0.9892 | 0.9952 | 0.8960 | 0.9973 | 0.9895 | 0.8819 | 0.9835 | | 0.0249 | 5.6338 | 400 | 0.0228 | 0.9627 | 0.9807 | 0.9913 | 0.9916 | 0.9544 | 0.9960 | 0.9890 | 0.9112 | 0.9879 | | 0.0247 | 6.3380 | 450 | 0.0234 | 0.9642 | 0.9886 | 0.9915 | 0.9919 | 0.9814 | 0.9925 | 0.9894 | 0.9151 | 0.9881 | | 0.0219 | 7.0423 | 500 | 0.0220 | 0.9656 | 0.9768 | 0.9920 | 0.9943 | 0.9386 | 0.9975 | 0.9908 | 0.9178 | 0.9882 | | 0.0172 | 7.7465 | 550 | 0.0206 | 0.9672 | 0.9888 | 0.9923 | 0.9951 | 0.9792 | 0.9919 | 0.9913 | 0.9215 | 0.9888 | | 0.018 | 8.4507 | 600 | 0.0169 | 0.9747 | 0.9859 | 0.9937 | 0.9944 | 0.9665 | 0.9969 | 0.9910 | 0.9420 | 0.9911 | | 0.0152 | 9.1549 | 650 | 0.0180 | 0.9726 | 0.9856 | 0.9932 | 0.9968 | 0.9659 | 0.9942 | 0.9909 | 0.9366 | 0.9902 | | 0.016 | 9.8592 | 700 | 0.0180 | 0.9729 | 0.9877 | 0.9936 | 0.9955 | 0.9726 | 0.9949 | 0.9917 | 0.9360 | 0.9909 | | 0.0132 | 10.5634 | 750 | 0.0169 | 0.9746 | 0.9872 | 0.9938 | 0.9944 | 0.9708 | 0.9965 | 0.9914 | 0.9410 | 0.9913 | | 0.0115 | 11.2676 | 800 | 0.0156 | 0.9761 | 0.9898 | 0.9941 | 0.9952 | 0.9789 | 0.9954 | 0.9920 | 0.9446 | 0.9917 | | 0.0143 | 11.9718 | 850 | 0.0155 | 0.9765 | 0.9895 | 0.9943 | 0.9962 | 0.9772 | 0.9952 | 0.9923 | 0.9452 | 0.9920 | | 0.0106 | 12.6761 | 900 | 0.0146 | 0.9778 | 0.9898 | 0.9946 | 0.9959 | 0.9777 | 0.9959 | 0.9924 | 0.9485 | 0.9925 | | 0.0106 | 13.3803 | 950 | 0.0146 | 0.9780 | 0.9888 | 0.9947 | 0.9967 | 0.9736 | 0.9959 | 0.9923 | 0.9490 | 0.9928 | | 0.0068 | 14.0845 | 1000 | 0.0147 | 0.9784 | 0.9883 | 0.9947 | 0.9966 | 0.9718 | 0.9964 | 0.9924 | 0.9501 | 0.9928 | | 0.0115 | 14.7887 | 1050 | 0.0163 | 0.9759 | 0.9901 | 0.9942 | 0.9958 | 0.9795 | 0.9950 | 0.9925 | 0.9436 | 0.9917 | | 0.0099 | 15.4930 | 1100 | 0.0150 | 0.9788 | 0.9887 | 0.9948 | 0.9958 | 0.9735 | 0.9969 | 0.9926 | 0.9509 | 0.9927 | ### Framework versions - Transformers 4.41.2 - Pytorch 2.0.1+cu117 - Datasets 2.19.2 - Tokenizers 0.19.1