Hugging Face's logo

jericojr23
/
segformer-b0-finetuned-segments-sidewalk-2

Image Segmentation
Transformers
PyTorch
segformer
vision
Generated from Trainer
Inference Endpoints
Model card Files Community
jericojr23 commited on
Commit
5a2cd90
•
1 Parent(s): 70b533b

End of training

Browse files
Files changed (4) hide show
  1. README.md +136 -0
  2. config.json +144 -0
  3. pytorch_model.bin +3 -0
  4. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,136 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: nvidia/mit-b0
4
+ tags:
5
+ - vision
6
+ - image-segmentation
7
+ - generated_from_trainer
8
+ model-index:
9
+ - name: segformer-b0-finetuned-segments-sidewalk-2
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # segformer-b0-finetuned-segments-sidewalk-2
17
+
18
+ This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the segments/sidewalk-semantic dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 1.6325
21
+ - Mean Iou: 0.0535
22
+ - Mean Accuracy: 0.0868
23
+ - Overall Accuracy: 0.5176
24
+ - Accuracy Unlabeled: nan
25
+ - Accuracy Flat-road: 0.0813
26
+ - Accuracy Flat-sidewalk: 0.9451
27
+ - Accuracy Flat-crosswalk: 0.0
28
+ - Accuracy Flat-cyclinglane: 0.0
29
+ - Accuracy Flat-parkingdriveway: 0.0
30
+ - Accuracy Flat-railtrack: nan
31
+ - Accuracy Flat-curb: 0.0
32
+ - Accuracy Human-person: 0.0
33
+ - Accuracy Human-rider: 0.0
34
+ - Accuracy Vehicle-car: 0.0017
35
+ - Accuracy Vehicle-truck: 0.0
36
+ - Accuracy Vehicle-bus: 0.0
37
+ - Accuracy Vehicle-tramtrain: nan
38
+ - Accuracy Vehicle-motorcycle: 0.0
39
+ - Accuracy Vehicle-bicycle: 0.0
40
+ - Accuracy Vehicle-caravan: 0.0
41
+ - Accuracy Vehicle-cartrailer: 0.0
42
+ - Accuracy Construction-building: 0.2409
43
+ - Accuracy Construction-door: 0.0
44
+ - Accuracy Construction-wall: 0.0
45
+ - Accuracy Construction-fenceguardrail: 0.0
46
+ - Accuracy Construction-bridge: 0.0
47
+ - Accuracy Construction-tunnel: 0.0
48
+ - Accuracy Construction-stairs: 0.0
49
+ - Accuracy Object-pole: 0.0
50
+ - Accuracy Object-trafficsign: 0.0
51
+ - Accuracy Object-trafficlight: 0.0
52
+ - Accuracy Nature-vegetation: 0.9096
53
+ - Accuracy Nature-terrain: 0.0349
54
+ - Accuracy Sky: 0.5635
55
+ - Accuracy Void-ground: 0.0
56
+ - Accuracy Void-dynamic: 0.0
57
+ - Accuracy Void-static: 0.0
58
+ - Accuracy Void-unclear: 0.0
59
+ - Iou Unlabeled: nan
60
+ - Iou Flat-road: 0.0721
61
+ - Iou Flat-sidewalk: 0.4933
62
+ - Iou Flat-crosswalk: 0.0
63
+ - Iou Flat-cyclinglane: 0.0
64
+ - Iou Flat-parkingdriveway: 0.0
65
+ - Iou Flat-railtrack: nan
66
+ - Iou Flat-curb: 0.0
67
+ - Iou Human-person: 0.0
68
+ - Iou Human-rider: 0.0
69
+ - Iou Vehicle-car: 0.0017
70
+ - Iou Vehicle-truck: 0.0
71
+ - Iou Vehicle-bus: 0.0
72
+ - Iou Vehicle-tramtrain: nan
73
+ - Iou Vehicle-motorcycle: 0.0
74
+ - Iou Vehicle-bicycle: 0.0
75
+ - Iou Vehicle-caravan: 0.0
76
+ - Iou Vehicle-cartrailer: 0.0
77
+ - Iou Construction-building: 0.1927
78
+ - Iou Construction-door: 0.0
79
+ - Iou Construction-wall: 0.0
80
+ - Iou Construction-fenceguardrail: 0.0
81
+ - Iou Construction-bridge: 0.0
82
+ - Iou Construction-tunnel: 0.0
83
+ - Iou Construction-stairs: 0.0
84
+ - Iou Object-pole: 0.0
85
+ - Iou Object-trafficsign: 0.0
86
+ - Iou Object-trafficlight: 0.0
87
+ - Iou Nature-vegetation: 0.5226
88
+ - Iou Nature-terrain: 0.0332
89
+ - Iou Sky: 0.3971
90
+ - Iou Void-ground: 0.0
91
+ - Iou Void-dynamic: 0.0
92
+ - Iou Void-static: 0.0
93
+ - Iou Void-unclear: 0.0
94
+
95
+ ## Model description
96
+
97
+ More information needed
98
+
99
+ ## Intended uses & limitations
100
+
101
+ More information needed
102
+
103
+ ## Training and evaluation data
104
+
105
+ More information needed
106
+
107
+ ## Training procedure
108
+
109
+ ### Training hyperparameters
110
+
111
+ The following hyperparameters were used during training:
112
+ - learning_rate: 0.01
113
+ - train_batch_size: 8
114
+ - eval_batch_size: 8
115
+ - seed: 42
116
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
117
+ - lr_scheduler_type: linear
118
+ - num_epochs: 1
119
+
120
+ ### Training results
121
+
122
+ | Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Flat-road | Accuracy Flat-sidewalk | Accuracy Flat-crosswalk | Accuracy Flat-cyclinglane | Accuracy Flat-parkingdriveway | Accuracy Flat-railtrack | Accuracy Flat-curb | Accuracy Human-person | Accuracy Human-rider | Accuracy Vehicle-car | Accuracy Vehicle-truck | Accuracy Vehicle-bus | Accuracy Vehicle-tramtrain | Accuracy Vehicle-motorcycle | Accuracy Vehicle-bicycle | Accuracy Vehicle-caravan | Accuracy Vehicle-cartrailer | Accuracy Construction-building | Accuracy Construction-door | Accuracy Construction-wall | Accuracy Construction-fenceguardrail | Accuracy Construction-bridge | Accuracy Construction-tunnel | Accuracy Construction-stairs | Accuracy Object-pole | Accuracy Object-trafficsign | Accuracy Object-trafficlight | Accuracy Nature-vegetation | Accuracy Nature-terrain | Accuracy Sky | Accuracy Void-ground | Accuracy Void-dynamic | Accuracy Void-static | Accuracy Void-unclear | Iou Unlabeled | Iou Flat-road | Iou Flat-sidewalk | Iou Flat-crosswalk | Iou Flat-cyclinglane | Iou Flat-parkingdriveway | Iou Flat-railtrack | Iou Flat-curb | Iou Human-person | Iou Human-rider | Iou Vehicle-car | Iou Vehicle-truck | Iou Vehicle-bus | Iou Vehicle-tramtrain | Iou Vehicle-motorcycle | Iou Vehicle-bicycle | Iou Vehicle-caravan | Iou Vehicle-cartrailer | Iou Construction-building | Iou Construction-door | Iou Construction-wall | Iou Construction-fenceguardrail | Iou Construction-bridge | Iou Construction-tunnel | Iou Construction-stairs | Iou Object-pole | Iou Object-trafficsign | Iou Object-trafficlight | Iou Nature-vegetation | Iou Nature-terrain | Iou Sky | Iou Void-ground | Iou Void-dynamic | Iou Void-static | Iou Void-unclear |
123
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:------------------:|:----------------------:|:-----------------------:|:-------------------------:|:-----------------------------:|:-----------------------:|:------------------:|:---------------------:|:--------------------:|:--------------------:|:----------------------:|:--------------------:|:--------------------------:|:---------------------------:|:------------------------:|:------------------------:|:---------------------------:|:------------------------------:|:--------------------------:|:--------------------------:|:------------------------------------:|:----------------------------:|:----------------------------:|:----------------------------:|:--------------------:|:---------------------------:|:----------------------------:|:--------------------------:|:-----------------------:|:------------:|:--------------------:|:---------------------:|:--------------------:|:---------------------:|:-------------:|:-------------:|:-----------------:|:------------------:|:--------------------:|:------------------------:|:------------------:|:-------------:|:----------------:|:---------------:|:---------------:|:-----------------:|:---------------:|:---------------------:|:----------------------:|:-------------------:|:-------------------:|:----------------------:|:-------------------------:|:---------------------:|:---------------------:|:-------------------------------:|:-----------------------:|:-----------------------:|:-----------------------:|:---------------:|:----------------------:|:-----------------------:|:---------------------:|:------------------:|:-------:|:---------------:|:----------------:|:---------------:|:----------------:|
124
+ | 2.1406 | 0.2 | 20 | 3.3169 | 0.0250 | 0.0555 | 0.4250 | nan | 0.0 | 0.8293 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0225 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.9246 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.4257 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0208 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.3535 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
125
+ | 1.856 | 0.4 | 40 | 1.9761 | 0.0295 | 0.0611 | 0.4511 | nan | 0.0 | 0.8624 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.1301 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.9616 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.4700 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.1012 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.3725 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
126
+ | 1.9981 | 0.6 | 60 | 2.2395 | 0.0259 | 0.0508 | 0.4085 | nan | 0.0 | 0.9972 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.4062 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.2213 | 0.0000 | 0.0001 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.4001 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.2248 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.2034 | 0.0000 | 0.0001 | 0.0 | 0.0 | 0.0 | 0.0 |
127
+ | 2.1244 | 0.8 | 80 | 1.7573 | 0.0401 | 0.0707 | 0.4917 | nan | 0.0004 | 0.9494 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.2756 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.9149 | 0.0540 | 0.0670 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0004 | 0.4783 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.1872 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.5061 | 0.0472 | 0.0636 | 0.0 | 0.0 | 0.0 | 0.0 |
128
+ | 1.8822 | 1.0 | 100 | 1.6325 | 0.0535 | 0.0868 | 0.5176 | nan | 0.0813 | 0.9451 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0017 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.2409 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.9096 | 0.0349 | 0.5635 | 0.0 | 0.0 | 0.0 | 0.0 | nan | 0.0721 | 0.4933 | 0.0 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0017 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.1927 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.5226 | 0.0332 | 0.3971 | 0.0 | 0.0 | 0.0 | 0.0 |
129
+
130
+
131
+ ### Framework versions
132
+
133
+ - Transformers 4.34.1
134
+ - Pytorch 2.1.0+cu118
135
+ - Datasets 2.14.5
136
+ - Tokenizers 0.14.1
config.json ADDED
@@ -0,0 +1,144 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "nvidia/mit-b0",
3
+ "architectures": [
4
+ "SegformerForSemanticSegmentation"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.0,
7
+ "classifier_dropout_prob": 0.1,
8
+ "decoder_hidden_size": 256,
9
+ "depths": [
10
+ 2,
11
+ 2,
12
+ 2,
13
+ 2
14
+ ],
15
+ "downsampling_rates": [
16
+ 1,
17
+ 4,
18
+ 8,
19
+ 16
20
+ ],
21
+ "drop_path_rate": 0.1,
22
+ "hidden_act": "gelu",
23
+ "hidden_dropout_prob": 0.0,
24
+ "hidden_sizes": [
25
+ 32,
26
+ 64,
27
+ 160,
28
+ 256
29
+ ],
30
+ "id2label": {
31
+ "0": "unlabeled",
32
+ "1": "flat-road",
33
+ "2": "flat-sidewalk",
34
+ "3": "flat-crosswalk",
35
+ "4": "flat-cyclinglane",
36
+ "5": "flat-parkingdriveway",
37
+ "6": "flat-railtrack",
38
+ "7": "flat-curb",
39
+ "8": "human-person",
40
+ "9": "human-rider",
41
+ "10": "vehicle-car",
42
+ "11": "vehicle-truck",
43
+ "12": "vehicle-bus",
44
+ "13": "vehicle-tramtrain",
45
+ "14": "vehicle-motorcycle",
46
+ "15": "vehicle-bicycle",
47
+ "16": "vehicle-caravan",
48
+ "17": "vehicle-cartrailer",
49
+ "18": "construction-building",
50
+ "19": "construction-door",
51
+ "20": "construction-wall",
52
+ "21": "construction-fenceguardrail",
53
+ "22": "construction-bridge",
54
+ "23": "construction-tunnel",
55
+ "24": "construction-stairs",
56
+ "25": "object-pole",
57
+ "26": "object-trafficsign",
58
+ "27": "object-trafficlight",
59
+ "28": "nature-vegetation",
60
+ "29": "nature-terrain",
61
+ "30": "sky",
62
+ "31": "void-ground",
63
+ "32": "void-dynamic",
64
+ "33": "void-static",
65
+ "34": "void-unclear"
66
+ },
67
+ "image_size": 224,
68
+ "initializer_range": 0.02,
69
+ "label2id": {
70
+ "construction-bridge": 22,
71
+ "construction-building": 18,
72
+ "construction-door": 19,
73
+ "construction-fenceguardrail": 21,
74
+ "construction-stairs": 24,
75
+ "construction-tunnel": 23,
76
+ "construction-wall": 20,
77
+ "flat-crosswalk": 3,
78
+ "flat-curb": 7,
79
+ "flat-cyclinglane": 4,
80
+ "flat-parkingdriveway": 5,
81
+ "flat-railtrack": 6,
82
+ "flat-road": 1,
83
+ "flat-sidewalk": 2,
84
+ "human-person": 8,
85
+ "human-rider": 9,
86
+ "nature-terrain": 29,
87
+ "nature-vegetation": 28,
88
+ "object-pole": 25,
89
+ "object-trafficlight": 27,
90
+ "object-trafficsign": 26,
91
+ "sky": 30,
92
+ "unlabeled": 0,
93
+ "vehicle-bicycle": 15,
94
+ "vehicle-bus": 12,
95
+ "vehicle-car": 10,
96
+ "vehicle-caravan": 16,
97
+ "vehicle-cartrailer": 17,
98
+ "vehicle-motorcycle": 14,
99
+ "vehicle-tramtrain": 13,
100
+ "vehicle-truck": 11,
101
+ "void-dynamic": 32,
102
+ "void-ground": 31,
103
+ "void-static": 33,
104
+ "void-unclear": 34
105
+ },
106
+ "layer_norm_eps": 1e-06,
107
+ "mlp_ratios": [
108
+ 4,
109
+ 4,
110
+ 4,
111
+ 4
112
+ ],
113
+ "model_type": "segformer",
114
+ "num_attention_heads": [
115
+ 1,
116
+ 2,
117
+ 5,
118
+ 8
119
+ ],
120
+ "num_channels": 3,
121
+ "num_encoder_blocks": 4,
122
+ "patch_sizes": [
123
+ 7,
124
+ 3,
125
+ 3,
126
+ 3
127
+ ],
128
+ "reshape_last_stage": true,
129
+ "semantic_loss_ignore_index": 255,
130
+ "sr_ratios": [
131
+ 8,
132
+ 4,
133
+ 2,
134
+ 1
135
+ ],
136
+ "strides": [
137
+ 4,
138
+ 2,
139
+ 2,
140
+ 2
141
+ ],
142
+ "torch_dtype": "float32",
143
+ "transformers_version": "4.34.1"
144
+ }
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df4080c91e848631f56bbbed3fa93661c4bab07a624bf083f2ab9e7c24f08294
3
+ size 14966154
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa14a2fe1c456c2917af7464dfc1be6700cbab2aea5754ea26b0fca5b25373d4
3
+ size 4600