yolo12138 commited on
Commit
42f387c
1 Parent(s): 62bc717

yolo12138/segformer-b2-human-parse-24

Browse files
README.md ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: mattmdjaga/segformer_b2_clothes
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - human_parsing_29_mix
8
+ model-index:
9
+ - name: segformer-b2-human-parse-24
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # segformer-b2-human-parse-24
17
+
18
+ This model is a fine-tuned version of [mattmdjaga/segformer_b2_clothes](https://huggingface.co/mattmdjaga/segformer_b2_clothes) on the human_parsing_29_mix dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.0818
21
+ - Mean Iou: 0.6023
22
+ - Mean Accuracy: 0.6321
23
+ - Overall Accuracy: 0.9780
24
+ - Accuracy Background: 0.9969
25
+ - Accuracy Hat: nan
26
+ - Accuracy Hair: 0.9646
27
+ - Accuracy Glove: 0.0
28
+ - Accuracy Glasses: 0.0
29
+ - Accuracy Upper Only Torso Region: 0.9747
30
+ - Accuracy Dresses Only Torso Region: 0.4939
31
+ - Accuracy Coat Only Torso Region: 0.0039
32
+ - Accuracy Socks: 0.0
33
+ - Accuracy Left Pants: 0.9604
34
+ - Accuracy Right Patns: 0.9646
35
+ - Accuracy Skin Around Neck Region: 0.9585
36
+ - Accuracy Scarf: nan
37
+ - Accuracy Skirts: 0.8904
38
+ - Accuracy Face: 0.9796
39
+ - Accuracy Left Arm: 0.9703
40
+ - Accuracy Right Arm: 0.9700
41
+ - Accuracy Left Leg: 0.9267
42
+ - Accuracy Right Leg: 0.9297
43
+ - Accuracy Left Shoe: 0.0
44
+ - Accuracy Right Shoe: 0.0
45
+ - Accuracy Left Sleeve For Upper: 0.9462
46
+ - Accuracy Right Sleeve For Upper: 0.9517
47
+ - Accuracy Bag: 0.0234
48
+ - Iou Background: 0.9941
49
+ - Iou Hat: nan
50
+ - Iou Hair: 0.9268
51
+ - Iou Glove: 0.0
52
+ - Iou Glasses: 0.0
53
+ - Iou Upper Only Torso Region: 0.9351
54
+ - Iou Dresses Only Torso Region: 0.4059
55
+ - Iou Coat Only Torso Region: 0.0035
56
+ - Iou Socks: 0.0
57
+ - Iou Left Pants: 0.9232
58
+ - Iou Right Patns: 0.9217
59
+ - Iou Skin Around Neck Region: 0.9227
60
+ - Iou Scarf: nan
61
+ - Iou Skirts: 0.7887
62
+ - Iou Face: 0.9582
63
+ - Iou Left Arm: 0.9436
64
+ - Iou Right Arm: 0.9426
65
+ - Iou Left Leg: 0.8836
66
+ - Iou Right Leg: 0.8767
67
+ - Iou Left Shoe: 0.0
68
+ - Iou Right Shoe: 0.0
69
+ - Iou Left Sleeve For Upper: 0.9005
70
+ - Iou Right Sleeve For Upper: 0.9012
71
+ - Iou Bag: 0.0232
72
+
73
+ ## Model description
74
+
75
+ More information needed
76
+
77
+ ## Intended uses & limitations
78
+
79
+ More information needed
80
+
81
+ ## Training and evaluation data
82
+
83
+ More information needed
84
+
85
+ ## Training procedure
86
+
87
+ ### Training hyperparameters
88
+
89
+ The following hyperparameters were used during training:
90
+ - learning_rate: 6e-05
91
+ - train_batch_size: 16
92
+ - eval_batch_size: 12
93
+ - seed: 42
94
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
95
+ - lr_scheduler_type: linear
96
+ - num_epochs: 8
97
+
98
+ ### Training results
99
+
100
+ | Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Background | Accuracy Hat | Accuracy Hair | Accuracy Glove | Accuracy Glasses | Accuracy Upper Only Torso Region | Accuracy Dresses Only Torso Region | Accuracy Coat Only Torso Region | Accuracy Socks | Accuracy Left Pants | Accuracy Right Patns | Accuracy Skin Around Neck Region | Accuracy Scarf | Accuracy Skirts | Accuracy Face | Accuracy Left Arm | Accuracy Right Arm | Accuracy Left Leg | Accuracy Right Leg | Accuracy Left Shoe | Accuracy Right Shoe | Accuracy Left Sleeve For Upper | Accuracy Right Sleeve For Upper | Accuracy Bag | Iou Background | Iou Hat | Iou Hair | Iou Glove | Iou Glasses | Iou Upper Only Torso Region | Iou Dresses Only Torso Region | Iou Coat Only Torso Region | Iou Socks | Iou Left Pants | Iou Right Patns | Iou Skin Around Neck Region | Iou Scarf | Iou Skirts | Iou Face | Iou Left Arm | Iou Right Arm | Iou Left Leg | Iou Right Leg | Iou Left Shoe | Iou Right Shoe | Iou Left Sleeve For Upper | Iou Right Sleeve For Upper | Iou Bag |
101
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:-------------------:|:------------:|:-------------:|:--------------:|:----------------:|:--------------------------------:|:----------------------------------:|:-------------------------------:|:--------------:|:-------------------:|:--------------------:|:--------------------------------:|:--------------:|:---------------:|:-------------:|:-----------------:|:------------------:|:-----------------:|:------------------:|:------------------:|:-------------------:|:------------------------------:|:-------------------------------:|:------------:|:--------------:|:-------:|:--------:|:---------:|:-----------:|:---------------------------:|:-----------------------------:|:--------------------------:|:---------:|:--------------:|:---------------:|:---------------------------:|:---------:|:----------:|:--------:|:------------:|:-------------:|:------------:|:-------------:|:-------------:|:--------------:|:-------------------------:|:--------------------------:|:-------:|
102
+ | 0.0652 | 1.62 | 1000 | 0.0802 | 0.5857 | 0.6166 | 0.9737 | 0.9963 | nan | 0.9490 | 0.0 | 0.0 | 0.9801 | 0.4034 | 0.0 | 0.0 | 0.9487 | 0.9574 | 0.9272 | nan | 0.8783 | 0.9782 | 0.9628 | 0.9534 | 0.8874 | 0.9012 | 0.0 | 0.0 | 0.9227 | 0.9197 | 0.0 | 0.9926 | nan | 0.9117 | 0.0 | 0.0 | 0.9217 | 0.3541 | 0.0 | 0.0 | 0.9084 | 0.9073 | 0.8963 | nan | 0.7766 | 0.9455 | 0.9210 | 0.9191 | 0.8405 | 0.8496 | 0.0 | 0.0 | 0.8673 | 0.8728 | 0.0 |
103
+ | 0.061 | 3.23 | 2000 | 0.0843 | 0.5977 | 0.6335 | 0.9747 | 0.9967 | nan | 0.9580 | 0.0 | 0.0 | 0.9657 | 0.5733 | 0.1504 | 0.0 | 0.9591 | 0.9600 | 0.9497 | nan | 0.8169 | 0.9789 | 0.9667 | 0.9645 | 0.8906 | 0.9165 | 0.0 | 0.0 | 0.9444 | 0.9445 | 0.0003 | 0.9935 | nan | 0.9199 | 0.0 | 0.0 | 0.9273 | 0.4058 | 0.1206 | 0.0 | 0.9131 | 0.9082 | 0.9128 | nan | 0.7330 | 0.9527 | 0.9355 | 0.9343 | 0.8534 | 0.8651 | 0.0 | 0.0 | 0.8860 | 0.8879 | 0.0003 |
104
+ | 0.0653 | 4.85 | 3000 | 0.0823 | 0.6000 | 0.6295 | 0.9775 | 0.9967 | nan | 0.9621 | 0.0 | 0.0 | 0.9780 | 0.4991 | 0.0044 | 0.0 | 0.9587 | 0.9649 | 0.9562 | nan | 0.8842 | 0.9769 | 0.9692 | 0.9651 | 0.9198 | 0.9273 | 0.0 | 0.0 | 0.9422 | 0.9415 | 0.0037 | 0.9939 | nan | 0.9247 | 0.0 | 0.0 | 0.9341 | 0.4136 | 0.0042 | 0.0 | 0.9202 | 0.9193 | 0.9193 | nan | 0.7899 | 0.9563 | 0.9403 | 0.9388 | 0.8745 | 0.8741 | 0.0 | 0.0 | 0.8963 | 0.8970 | 0.0037 |
105
+ | 0.0402 | 6.46 | 4000 | 0.0818 | 0.6023 | 0.6321 | 0.9780 | 0.9969 | nan | 0.9646 | 0.0 | 0.0 | 0.9747 | 0.4939 | 0.0039 | 0.0 | 0.9604 | 0.9646 | 0.9585 | nan | 0.8904 | 0.9796 | 0.9703 | 0.9700 | 0.9267 | 0.9297 | 0.0 | 0.0 | 0.9462 | 0.9517 | 0.0234 | 0.9941 | nan | 0.9268 | 0.0 | 0.0 | 0.9351 | 0.4059 | 0.0035 | 0.0 | 0.9232 | 0.9217 | 0.9227 | nan | 0.7887 | 0.9582 | 0.9436 | 0.9426 | 0.8836 | 0.8767 | 0.0 | 0.0 | 0.9005 | 0.9012 | 0.0232 |
106
+
107
+
108
+ ### Framework versions
109
+
110
+ - Transformers 4.35.2
111
+ - Pytorch 2.1.1
112
+ - Datasets 2.15.0
113
+ - Tokenizers 0.15.0
config.json ADDED
@@ -0,0 +1,122 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "mattmdjaga/segformer_b2_clothes",
3
+ "architectures": [
4
+ "SegformerForSemanticSegmentation"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.0,
7
+ "classifier_dropout_prob": 0.1,
8
+ "decoder_hidden_size": 768,
9
+ "depths": [
10
+ 3,
11
+ 4,
12
+ 6,
13
+ 3
14
+ ],
15
+ "downsampling_rates": [
16
+ 1,
17
+ 4,
18
+ 8,
19
+ 16
20
+ ],
21
+ "drop_path_rate": 0.1,
22
+ "hidden_act": "gelu",
23
+ "hidden_dropout_prob": 0.0,
24
+ "hidden_sizes": [
25
+ 64,
26
+ 128,
27
+ 320,
28
+ 512
29
+ ],
30
+ "id2label": {
31
+ "0": "background",
32
+ "1": "hat",
33
+ "2": "hair",
34
+ "3": "glove",
35
+ "4": "glasses",
36
+ "5": "upper_only_torso_region",
37
+ "6": "dresses_only_torso_region",
38
+ "7": "coat_only_torso_region",
39
+ "8": "socks",
40
+ "9": "left_pants",
41
+ "10": "right_patns",
42
+ "11": "skin_around_neck_region",
43
+ "12": "scarf",
44
+ "13": "skirts",
45
+ "14": "face",
46
+ "15": "left_arm",
47
+ "16": "right_arm",
48
+ "17": "left_leg",
49
+ "18": "right_leg",
50
+ "19": "left_shoe",
51
+ "20": "right_shoe",
52
+ "21": "left_sleeve_for_upper",
53
+ "22": "right_sleeve_for_upper",
54
+ "23": "bag"
55
+ },
56
+ "image_size": 224,
57
+ "initializer_range": 0.02,
58
+ "label2id": {
59
+ "background": 0,
60
+ "bag": 23,
61
+ "coat_only_torso_region": 7,
62
+ "dresses_only_torso_region": 6,
63
+ "face": 14,
64
+ "glasses": 4,
65
+ "glove": 3,
66
+ "hair": 2,
67
+ "hat": 1,
68
+ "left_arm": 15,
69
+ "left_leg": 17,
70
+ "left_pants": 9,
71
+ "left_shoe": 19,
72
+ "left_sleeve_for_upper": 21,
73
+ "right_arm": 16,
74
+ "right_leg": 18,
75
+ "right_patns": 10,
76
+ "right_shoe": 20,
77
+ "right_sleeve_for_upper": 22,
78
+ "scarf": 12,
79
+ "skin_around_neck_region": 11,
80
+ "skirts": 13,
81
+ "socks": 8,
82
+ "upper_only_torso_region": 5
83
+ },
84
+ "layer_norm_eps": 1e-06,
85
+ "mlp_ratios": [
86
+ 4,
87
+ 4,
88
+ 4,
89
+ 4
90
+ ],
91
+ "model_type": "segformer",
92
+ "num_attention_heads": [
93
+ 1,
94
+ 2,
95
+ 5,
96
+ 8
97
+ ],
98
+ "num_channels": 3,
99
+ "num_encoder_blocks": 4,
100
+ "patch_sizes": [
101
+ 7,
102
+ 3,
103
+ 3,
104
+ 3
105
+ ],
106
+ "reshape_last_stage": true,
107
+ "semantic_loss_ignore_index": 255,
108
+ "sr_ratios": [
109
+ 8,
110
+ 4,
111
+ 2,
112
+ 1
113
+ ],
114
+ "strides": [
115
+ 4,
116
+ 2,
117
+ 2,
118
+ 2
119
+ ],
120
+ "torch_dtype": "float32",
121
+ "transformers_version": "4.35.2"
122
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a14fd5a0ecda5f575a25bab2c3e65a541e685f78cae2748e843c6aedbba3fe10
3
+ size 109511696
runs/Dec08_20-20-08_theone-ubuntu/events.out.tfevents.1702038009.theone-ubuntu.13205.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d0a935e785d7b710fa989dc5b1363e7b2effbb5b4a15f698c5ab05248a2489e
3
+ size 796787
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:077b1bf7af3558a45ae576188d24e30461247d03e076933190553b0b4e82c3d6
3
+ size 4600