JCAI2000's picture
End of training
0e60cf5
metadata
license: other
base_model: nvidia/mit-b5
tags:
  - vision
  - image-segmentation
  - generated_from_trainer
model-index:
  - name: >-
      segformer-b3-finetuned-100by100PNG-50epochs-attempt2-100epochs-backgroundclass
    results: []

segformer-b3-finetuned-100by100PNG-50epochs-attempt2-100epochs-backgroundclass

This model is a fine-tuned version of nvidia/mit-b5 on the JCAI2000/100By100BranchPNG dataset. It achieves the following results on the evaluation set:

  • Loss: 0.1497
  • Mean Iou: 0.8933
  • Mean Accuracy: 0.9531
  • Overall Accuracy: 0.9662
  • Accuracy Background: 0.9732
  • Accuracy Branch: 0.9330
  • Iou Background: 0.9597
  • Iou Branch: 0.8270

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 6e-05
  • train_batch_size: 2
  • eval_batch_size: 2
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100

Training results

Training Loss Epoch Step Validation Loss Mean Iou Mean Accuracy Overall Accuracy Accuracy Background Accuracy Branch Iou Background Iou Branch
0.2055 1.05 20 0.2925 0.8151 0.9469 0.9320 0.9242 0.9695 0.9183 0.7118
0.1549 2.11 40 0.1328 0.8802 0.9311 0.9628 0.9796 0.8825 0.9561 0.8043
0.0735 3.16 60 0.1178 0.8804 0.9512 0.9613 0.9666 0.9357 0.9538 0.8070
0.0636 4.21 80 0.0844 0.8966 0.9368 0.9686 0.9854 0.8881 0.9629 0.8303
0.0546 5.26 100 0.1099 0.8969 0.9526 0.9676 0.9756 0.9297 0.9614 0.8325
0.0567 6.32 120 0.1012 0.8996 0.9500 0.9688 0.9788 0.9213 0.9629 0.8364
0.0515 7.37 140 0.1137 0.8935 0.9462 0.9668 0.9777 0.9147 0.9605 0.8265
0.052 8.42 160 0.0987 0.8914 0.9317 0.9670 0.9858 0.8776 0.9611 0.8217
0.0358 9.47 180 0.1167 0.8978 0.9581 0.9676 0.9726 0.9435 0.9613 0.8344
0.0254 10.53 200 0.0767 0.9111 0.9519 0.9729 0.9840 0.9197 0.9678 0.8545
0.0483 11.58 220 0.0953 0.9037 0.9524 0.9701 0.9795 0.9253 0.9645 0.8429
0.0285 12.63 240 0.0904 0.9026 0.9490 0.9700 0.9811 0.9169 0.9643 0.8409
0.0389 13.68 260 0.0902 0.9025 0.9472 0.9701 0.9821 0.9123 0.9644 0.8406
0.0473 14.74 280 0.0852 0.9084 0.9522 0.9719 0.9823 0.9220 0.9665 0.8502
0.0266 15.79 300 0.0983 0.8985 0.9409 0.9690 0.9839 0.8979 0.9633 0.8337
0.0233 16.84 320 0.0965 0.9052 0.9601 0.9702 0.9756 0.9447 0.9644 0.8460
0.0257 17.89 340 0.0941 0.9039 0.9550 0.9701 0.9781 0.9319 0.9643 0.8434
0.0352 18.95 360 0.0855 0.9043 0.9483 0.9706 0.9824 0.9142 0.9651 0.8435
0.1941 20.0 380 0.0946 0.9045 0.9509 0.9706 0.9809 0.9210 0.9650 0.8441
0.0325 21.05 400 0.0972 0.8973 0.9449 0.9683 0.9807 0.9092 0.9624 0.8323
0.0159 22.11 420 0.0828 0.9081 0.9528 0.9717 0.9817 0.9239 0.9664 0.8498
0.0175 23.16 440 0.1061 0.8995 0.9491 0.9688 0.9793 0.9188 0.9629 0.8360
0.0281 24.21 460 0.1090 0.8969 0.9516 0.9677 0.9761 0.9271 0.9615 0.8323
0.0177 25.26 480 0.1122 0.8983 0.9547 0.9680 0.9750 0.9343 0.9618 0.8347
0.0228 26.32 500 0.1088 0.8957 0.9546 0.9670 0.9736 0.9357 0.9606 0.8307
0.0348 27.37 520 0.0933 0.9059 0.9524 0.9710 0.9808 0.9241 0.9654 0.8464
0.0177 28.42 540 0.1053 0.9025 0.9527 0.9697 0.9787 0.9268 0.9639 0.8411
0.0182 29.47 560 0.1039 0.8992 0.9473 0.9688 0.9802 0.9143 0.9630 0.8355
0.0171 30.53 580 0.1117 0.8991 0.9555 0.9682 0.9750 0.9360 0.9621 0.8361
0.0275 31.58 600 0.1142 0.8935 0.9497 0.9665 0.9754 0.9241 0.9601 0.8268
0.0186 32.63 620 0.1065 0.9024 0.9524 0.9697 0.9788 0.9261 0.9639 0.8408
0.0173 33.68 640 0.1081 0.8986 0.9529 0.9682 0.9764 0.9294 0.9621 0.8351
0.015 34.74 660 0.1243 0.8935 0.9530 0.9663 0.9733 0.9327 0.9598 0.8272
0.0183 35.79 680 0.1120 0.9005 0.9500 0.9691 0.9792 0.9209 0.9633 0.8377
0.0248 36.84 700 0.1185 0.8962 0.9517 0.9674 0.9757 0.9277 0.9611 0.8312
0.0104 37.89 720 0.1136 0.8975 0.9506 0.9680 0.9771 0.9241 0.9619 0.8332
0.0481 38.95 740 0.1127 0.9010 0.9528 0.9691 0.9778 0.9277 0.9632 0.8388
0.0153 40.0 760 0.1101 0.9019 0.9537 0.9694 0.9777 0.9297 0.9635 0.8402
0.0143 41.05 780 0.1105 0.9032 0.9558 0.9698 0.9771 0.9345 0.9639 0.8425
0.0104 42.11 800 0.1122 0.8986 0.9428 0.9689 0.9827 0.9028 0.9631 0.8340
0.0172 43.16 820 0.1097 0.9041 0.9540 0.9702 0.9788 0.9291 0.9645 0.8437
0.0371 44.21 840 0.1064 0.9011 0.9503 0.9693 0.9794 0.9212 0.9635 0.8387
0.0221 45.26 860 0.1150 0.9004 0.9515 0.9690 0.9783 0.9247 0.9631 0.8377
0.0186 46.32 880 0.1228 0.8958 0.9518 0.9672 0.9754 0.9282 0.9610 0.8306
0.0119 47.37 900 0.1205 0.8980 0.9525 0.9680 0.9762 0.9288 0.9619 0.8340
0.0113 48.42 920 0.1133 0.8998 0.9502 0.9688 0.9787 0.9216 0.9629 0.8366
0.0121 49.47 940 0.1145 0.8993 0.9490 0.9688 0.9792 0.9188 0.9629 0.8358
0.0263 50.53 960 0.1168 0.8977 0.9542 0.9678 0.9750 0.9334 0.9616 0.8338
0.0093 51.58 980 0.1213 0.8940 0.9534 0.9664 0.9733 0.9334 0.9600 0.8280
0.0193 52.63 1000 0.1241 0.8971 0.9507 0.9678 0.9769 0.9246 0.9617 0.8326
0.0139 53.68 1020 0.1263 0.8962 0.9546 0.9672 0.9739 0.9353 0.9609 0.8316
0.012 54.74 1040 0.1252 0.8952 0.9504 0.9671 0.9760 0.9247 0.9609 0.8296
0.008 55.79 1060 0.1219 0.8986 0.9516 0.9683 0.9772 0.9260 0.9623 0.8349
0.0092 56.84 1080 0.1290 0.8995 0.9552 0.9684 0.9754 0.9349 0.9623 0.8366
0.015 57.89 1100 0.1243 0.8989 0.9545 0.9682 0.9755 0.9335 0.9621 0.8358
0.0126 58.95 1120 0.1214 0.8977 0.9541 0.9678 0.9751 0.9331 0.9616 0.8337
0.0212 60.0 1140 0.1298 0.8953 0.9542 0.9669 0.9736 0.9347 0.9605 0.8301
0.0192 61.05 1160 0.1341 0.8930 0.9518 0.9661 0.9737 0.9299 0.9597 0.8262
0.0136 62.11 1180 0.1327 0.8970 0.9528 0.9676 0.9754 0.9302 0.9614 0.8325
0.0131 63.16 1200 0.1233 0.8997 0.9549 0.9685 0.9757 0.9340 0.9624 0.8369
0.0135 64.21 1220 0.1301 0.8957 0.9542 0.9670 0.9738 0.9345 0.9607 0.8307
0.0228 65.26 1240 0.1274 0.8979 0.9524 0.9680 0.9762 0.9285 0.9618 0.8339
0.0138 66.32 1260 0.1336 0.8965 0.9520 0.9675 0.9757 0.9283 0.9613 0.8318
0.0127 67.37 1280 0.1278 0.8980 0.9519 0.9681 0.9767 0.9271 0.9620 0.8341
0.0107 68.42 1300 0.1293 0.8970 0.9530 0.9676 0.9753 0.9308 0.9614 0.8327
0.0278 69.47 1320 0.1413 0.8926 0.9534 0.9659 0.9725 0.9343 0.9593 0.8258
0.0159 70.53 1340 0.1360 0.8953 0.9522 0.9670 0.9748 0.9296 0.9607 0.8298
0.0105 71.58 1360 0.1319 0.8972 0.9537 0.9676 0.9750 0.9324 0.9614 0.8330
0.0168 72.63 1380 0.1343 0.8942 0.9533 0.9665 0.9735 0.9331 0.9601 0.8283
0.0156 73.68 1400 0.1357 0.8950 0.9516 0.9669 0.9751 0.9281 0.9606 0.8294
0.0109 74.74 1420 0.1446 0.8905 0.9524 0.9652 0.9719 0.9328 0.9585 0.8226
0.0168 75.79 1440 0.1339 0.8958 0.9533 0.9671 0.9745 0.9320 0.9608 0.8308
0.0252 76.84 1460 0.1355 0.8935 0.9532 0.9662 0.9731 0.9333 0.9597 0.8272
0.0109 77.89 1480 0.1388 0.8932 0.9533 0.9661 0.9729 0.9338 0.9596 0.8267
0.0109 78.95 1500 0.1404 0.8924 0.9519 0.9659 0.9734 0.9305 0.9594 0.8255
0.0112 80.0 1520 0.1424 0.8921 0.9535 0.9657 0.9722 0.9349 0.9591 0.8251
0.0094 81.05 1540 0.1451 0.8924 0.9524 0.9659 0.9730 0.9317 0.9593 0.8254
0.007 82.11 1560 0.1457 0.8931 0.9527 0.9661 0.9732 0.9322 0.9596 0.8266
0.0119 83.16 1580 0.1424 0.8927 0.9520 0.9661 0.9735 0.9306 0.9595 0.8259
0.0153 84.21 1600 0.1535 0.8909 0.9530 0.9653 0.9718 0.9342 0.9586 0.8233
0.0104 85.26 1620 0.1452 0.8921 0.9529 0.9658 0.9725 0.9333 0.9592 0.8251
0.0101 86.32 1640 0.1503 0.8910 0.9536 0.9653 0.9714 0.9358 0.9586 0.8235
0.009 87.37 1660 0.1508 0.8925 0.9532 0.9659 0.9725 0.9339 0.9593 0.8257
0.0073 88.42 1680 0.1419 0.8949 0.9528 0.9668 0.9742 0.9315 0.9604 0.8293
0.0137 89.47 1700 0.1437 0.8942 0.9526 0.9666 0.9739 0.9313 0.9601 0.8282
0.0061 90.53 1720 0.1474 0.8928 0.9523 0.9660 0.9733 0.9313 0.9595 0.8260
0.0132 91.58 1740 0.1408 0.8935 0.9522 0.9663 0.9738 0.9306 0.9598 0.8271
0.0089 92.63 1760 0.1468 0.8933 0.9527 0.9662 0.9734 0.9320 0.9597 0.8268
0.0141 93.68 1780 0.1458 0.8930 0.9529 0.9661 0.9731 0.9328 0.9596 0.8265
0.0132 94.74 1800 0.1442 0.8934 0.9528 0.9662 0.9733 0.9324 0.9597 0.8270
0.0109 95.79 1820 0.1445 0.8928 0.9529 0.9660 0.9730 0.9327 0.9595 0.8262
0.0248 96.84 1840 0.1391 0.8938 0.9529 0.9664 0.9736 0.9322 0.9599 0.8276
0.0074 97.89 1860 0.1424 0.8938 0.9531 0.9664 0.9735 0.9327 0.9599 0.8277
0.0072 98.95 1880 0.1465 0.8931 0.9534 0.9661 0.9728 0.9339 0.9596 0.8266
0.0183 100.0 1900 0.1497 0.8933 0.9531 0.9662 0.9732 0.9330 0.9597 0.8270

Framework versions

  • Transformers 4.33.0
  • Pytorch 2.0.1+cu117
  • Datasets 2.14.4
  • Tokenizers 0.13.3