INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/NNCFLinear[classifier]/linear_0 INFO:nncf:Not adding activation input quantizer for operation: 4 SwinForImageClassification/SwinModel[swin]/SwinEmbeddings[embeddings]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 6 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 26 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 29 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 41 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 42 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 47 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 48 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 69 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 71 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 75 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 88 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 89 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 94 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 102 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 104 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 124 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 127 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 139 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 140 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 145 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 146 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 167 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 169 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 173 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 186 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 187 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 192 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 200 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 202 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 222 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 225 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 237 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 238 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 243 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 244 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 265 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 267 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 271 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 284 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 285 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 290 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 291 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 311 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 314 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 326 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 327 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 332 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 333 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 354 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 356 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 360 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 373 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 374 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 379 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 380 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 400 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 403 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 415 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 416 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 421 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 422 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 443 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 445 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 449 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 462 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 463 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 468 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 469 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 489 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 492 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 504 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 505 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 510 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 511 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 532 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 534 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 538 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 551 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 552 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 557 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 558 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 578 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 581 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 593 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 594 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 599 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 600 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 621 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 623 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 627 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 640 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 641 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 646 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 647 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 667 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 670 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 682 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 683 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 688 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 689 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 710 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 712 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 716 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 729 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 730 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 735 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 736 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 756 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 759 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 771 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 772 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 777 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 778 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 799 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 801 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 805 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 818 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 819 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 824 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 825 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 845 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 848 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 860 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 861 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 866 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 867 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 888 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 890 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 894 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 907 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 908 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 913 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 914 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 934 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 937 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 949 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 950 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 955 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 956 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 977 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 979 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 983 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 996 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 997 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1002 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1010 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1012 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1032 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1035 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 1047 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1048 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1053 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1054 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1074 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1077 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 1089 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1090 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1095 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1096 SwinForImageClassification/SwinModel[swin]/NNCFLayerNorm[layernorm]/layer_norm_0 INFO:nncf:Collecting tensor statistics |████████ | 1 / 2 INFO:nncf:Collecting tensor statistics |████████████████| 2 / 2 INFO:nncf:Compiling and loading torch extension: quantized_functions_cuda... INFO:nncf:Finished loading torch extension: quantized_functions_cuda INFO:nncf:BatchNorm statistics adaptation |█ | 1 / 13 INFO:nncf:BatchNorm statistics adaptation |██ | 2 / 13 INFO:nncf:BatchNorm statistics adaptation |███ | 3 / 13 INFO:nncf:BatchNorm statistics adaptation |████ | 4 / 13 INFO:nncf:BatchNorm statistics adaptation |██████ | 5 / 13 INFO:nncf:BatchNorm statistics adaptation |███████ | 6 / 13 INFO:nncf:BatchNorm statistics adaptation |████████ | 7 / 13 INFO:nncf:BatchNorm statistics adaptation |█████████ | 8 / 13 INFO:nncf:BatchNorm statistics adaptation |███████████ | 9 / 13 INFO:nncf:BatchNorm statistics adaptation |████████████ | 10 / 13 INFO:nncf:BatchNorm statistics adaptation |█████████████ | 11 / 13 INFO:nncf:BatchNorm statistics adaptation |██████████████ | 12 / 13 INFO:nncf:BatchNorm statistics adaptation |████████████████| 13 / 13 WARNING:nncf:Number of potential building blocks is too much. The processing time can be high. Shallow the accepted range for the length of building blocks via max_block_size and min_block_size to accelerate the search process. INFO:nncf:Movement sparsity scheduler updates importance threshold and regularizationfactor per optimizer step, but steps_per_epoch was not set in config. Will measure the actual steps per epoch as signaled by a .epoch_step() call. INFO:nncf:Statistics of the sparsified model: Epoch 0 |+-----------------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+=========================================+=======+ Epoch 0 || Sparsity level of the whole model | 0 | Epoch 0 |+-----------------------------------------+-------+ Epoch 0 || Sparsity level of all sparsified layers | 0 | Epoch 0 |+-----------------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics by sparsified layers: Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 0 |+======================+================+================+=====================+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 | Epoch 0 |Statistics of the movement-sparsity algorithm: Epoch 0 |+----------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+==================================+=======+ Epoch 0 || Mask Importance Threshold | -inf | Epoch 0 |+----------------------------------+-------+ Epoch 0 || Importance Regularization Factor | 0 | Epoch 0 |+----------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics of the quantization algorithm: Epoch 0 |+--------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+================================+=======+ Epoch 0 || Ratio of enabled quantizations | 100 | Epoch 0 |+--------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics of the quantization share: Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+==================================+======================+ Epoch 0 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 | Epoch 0 |Statistics of the bitwidth distribution: Epoch 0 |+--------------+---------------------+--------------------+--------------------+ Epoch 0 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 0 || | WQs | Placed AQs | Qs | Epoch 0 |+==============+=====================+====================+====================+ Epoch 0 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 0 || | 149) | 149) | 298) | Epoch 0 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 1 |+-----------------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+=========================================+=======+ Epoch 1 || Sparsity level of the whole model | 0 | Epoch 1 |+-----------------------------------------+-------+ Epoch 1 || Sparsity level of all sparsified layers | 0 | Epoch 1 |+-----------------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics by sparsified layers: Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 1 |+======================+================+================+=====================+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 | Epoch 1 |Statistics of the movement-sparsity algorithm: Epoch 1 |+----------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+==================================+=======+ Epoch 1 || Mask Importance Threshold | -inf | Epoch 1 |+----------------------------------+-------+ Epoch 1 || Importance Regularization Factor | 0 | Epoch 1 |+----------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics of the quantization algorithm: Epoch 1 |+--------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+================================+=======+ Epoch 1 || Ratio of enabled quantizations | 100 | Epoch 1 |+--------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics of the quantization share: Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+==================================+======================+ Epoch 1 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 | Epoch 1 |Statistics of the bitwidth distribution: Epoch 1 |+--------------+---------------------+--------------------+--------------------+ Epoch 1 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 1 || | WQs | Placed AQs | Qs | Epoch 1 |+==============+=====================+====================+====================+ Epoch 1 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 1 || | 149) | 149) | 298) | Epoch 1 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 2 |+-----------------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+=========================================+=======+ Epoch 2 || Sparsity level of the whole model | 0 | Epoch 2 |+-----------------------------------------+-------+ Epoch 2 || Sparsity level of all sparsified layers | 0 | Epoch 2 |+-----------------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics by sparsified layers: Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 2 |+======================+================+================+=====================+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 | Epoch 2 |Statistics of the movement-sparsity algorithm: Epoch 2 |+----------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+==================================+=======+ Epoch 2 || Mask Importance Threshold | -inf | Epoch 2 |+----------------------------------+-------+ Epoch 2 || Importance Regularization Factor | 0 | Epoch 2 |+----------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics of the quantization algorithm: Epoch 2 |+--------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+================================+=======+ Epoch 2 || Ratio of enabled quantizations | 100 | Epoch 2 |+--------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics of the quantization share: Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+==================================+======================+ Epoch 2 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 | Epoch 2 |Statistics of the bitwidth distribution: Epoch 2 |+--------------+---------------------+--------------------+--------------------+ Epoch 2 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 2 || | WQs | Placed AQs | Qs | Epoch 2 |+==============+=====================+====================+====================+ Epoch 2 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 2 || | 149) | 149) | 298) | Epoch 2 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Movement sparsity automatically calculates `init_importance_threshold` as -0.007113098166882992 so that warmup starts from ~0.1% linear layer sparsity. INFO:nncf:Statistics of the sparsified model: Epoch 3 |+-----------------------------------------+-------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+=========================================+=======+ Epoch 3 || Sparsity level of the whole model | 0.671 | Epoch 3 |+-----------------------------------------+-------+ Epoch 3 || Sparsity level of all sparsified layers | 0.695 | Epoch 3 |+-----------------------------------------+-------+ Epoch 3 | Epoch 3 |Statistics by sparsified layers: Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 3 |+======================+================+================+=====================+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.969 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 128] | 0.369 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.217 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 512] | 0.371 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.859 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.844 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 128] | 0.250 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.131 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 512] | 0.275 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.656 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.555 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 256] | 0.151 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.051 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 1024] | 0.276 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.750 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.688 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.750 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.672 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.562 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 256] | 0.257 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.057 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 1024] | 0.377 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.975 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.956 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.659 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.520 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.469 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.563 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.110 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.767 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.652 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.576 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.441 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.091 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.695 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.899 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.891 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.521 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.433 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.594 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.542 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.079 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.723 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.925 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.702 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.665 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.622 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.099 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.820 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.847 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.575 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.489 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.652 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.104 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.809 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.933 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.924 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.764 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.709 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.652 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.088 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.820 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.861 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.832 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.605 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.546 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.646 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.077 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.794 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.913 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.887 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.602 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.569 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.557 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.082 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.761 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.811 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.344 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.732 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.542 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.512 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.501 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.095 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.721 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.858 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.794 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.604 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.559 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.486 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.087 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.710 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.769 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.695 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.454 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.442 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.503 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.081 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.722 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.826 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.759 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.579 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.573 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.566 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.079 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.741 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.728 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.641 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.481 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.493 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.639 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.094 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.750 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.835 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.156 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.769 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.622 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.597 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.669 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.101 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.764 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.779 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.281 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.729 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.561 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.540 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.781 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.120 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.811 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.853 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.125 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.780 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.680 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.634 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.790 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.131 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.808 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.838 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.759 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.568 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.520 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.789 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.149 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.807 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.908 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.219 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.822 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.680 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.589 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.705 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.156 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.739 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.768 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.219 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.615 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.358 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.277 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.469 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096, 1024] | 0.940 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096] | 0.094 | 0.005 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 4096] | 0.949 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.936 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.344 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.841 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.344 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.308 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.469 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096, 1024] | 0.611 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096] | 0.248 | 0.005 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 4096] | 0.649 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 | Epoch 3 |Statistics of the movement-sparsity algorithm: Epoch 3 |+----------------------------------+--------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+==================================+========+ Epoch 3 || Mask Importance Threshold | -0.002 | Epoch 3 |+----------------------------------+--------+ Epoch 3 || Importance Regularization Factor | 0.703 | Epoch 3 |+----------------------------------+--------+ Epoch 3 | Epoch 3 |Statistics of the quantization algorithm: Epoch 3 |+--------------------------------+-------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+================================+=======+ Epoch 3 || Ratio of enabled quantizations | 100 | Epoch 3 |+--------------------------------+-------+ Epoch 3 | Epoch 3 |Statistics of the quantization share: Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+==================================+======================+ Epoch 3 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 | Epoch 3 |Statistics of the bitwidth distribution: Epoch 3 |+--------------+---------------------+--------------------+--------------------+ Epoch 3 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 3 || | WQs | Placed AQs | Qs | Epoch 3 |+==============+=====================+====================+====================+ Epoch 3 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 3 || | 149) | 149) | 298) | Epoch 3 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 4 |+-----------------------------------------+-------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+=========================================+=======+ Epoch 4 || Sparsity level of the whole model | 0.869 | Epoch 4 |+-----------------------------------------+-------+ Epoch 4 || Sparsity level of all sparsified layers | 0.900 | Epoch 4 |+-----------------------------------------+-------+ Epoch 4 | Epoch 4 |Statistics by sparsified layers: Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 4 |+======================+================+================+=====================+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 128] | 0.633 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.467 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 512] | 0.592 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 128] | 0.564 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.389 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 512] | 0.527 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.816 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.793 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 256] | 0.583 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.296 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 1024] | 0.650 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.930 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.926 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 256] | 0.696 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.241 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 1024] | 0.699 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.814 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.796 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.921 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.396 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.949 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.842 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.823 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.869 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.373 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.898 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.955 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.947 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.734 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.732 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.891 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.375 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.904 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.967 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.964 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.879 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.886 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.937 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.380 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.945 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.931 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.918 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.844 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.849 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.945 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.372 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.957 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.972 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.972 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.949 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.945 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.945 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.376 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.956 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.965 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.838 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.818 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.940 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.373 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.950 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.926 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.916 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.925 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.375 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.939 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.964 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.933 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.857 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.916 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.358 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.927 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.954 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.953 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.912 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.374 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.923 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.899 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.830 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.785 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.747 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.905 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.385 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.912 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.958 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.942 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.944 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.907 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.378 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.917 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.900 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.824 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.776 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.757 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.916 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.363 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.918 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.934 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.937 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.936 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.916 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.373 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.910 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.952 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.894 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.899 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.877 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.931 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.415 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.927 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.977 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.916 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.434 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.915 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.953 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.931 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.924 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.909 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.461 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.909 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.973 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.948 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.941 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.895 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.463 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.893 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.926 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.406 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.822 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.667 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.594 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096, 1024] | 0.974 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096] | 0.389 | 0.005 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 4096] | 0.970 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.980 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.500 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.941 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.649 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.626 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096, 1024] | 0.875 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096] | 0.516 | 0.005 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 4096] | 0.869 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 | Epoch 4 |Statistics of the movement-sparsity algorithm: Epoch 4 |+----------------------------------+--------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+==================================+========+ Epoch 4 || Mask Importance Threshold | -0.000 | Epoch 4 |+----------------------------------+--------+ Epoch 4 || Importance Regularization Factor | 0.963 | Epoch 4 |+----------------------------------+--------+ Epoch 4 | Epoch 4 |Statistics of the quantization algorithm: Epoch 4 |+--------------------------------+-------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+================================+=======+ Epoch 4 || Ratio of enabled quantizations | 100 | Epoch 4 |+--------------------------------+-------+ Epoch 4 | Epoch 4 |Statistics of the quantization share: Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+==================================+======================+ Epoch 4 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 | Epoch 4 |Statistics of the bitwidth distribution: Epoch 4 |+--------------+---------------------+--------------------+--------------------+ Epoch 4 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 4 || | WQs | Placed AQs | Qs | Epoch 4 |+==============+=====================+====================+====================+ Epoch 4 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 4 || | 149) | 149) | 298) | Epoch 4 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 5 |+-----------------------------------------+-------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+=========================================+=======+ Epoch 5 || Sparsity level of the whole model | 0.894 | Epoch 5 |+-----------------------------------------+-------+ Epoch 5 || Sparsity level of all sparsified layers | 0.926 | Epoch 5 |+-----------------------------------------+-------+ Epoch 5 | Epoch 5 |Statistics by sparsified layers: Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 5 |+======================+================+================+=====================+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 128] | 0.697 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.498 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 512] | 0.658 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 128] | 0.611 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.418 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 512] | 0.576 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.883 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.871 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 256] | 0.673 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.336 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 1024] | 0.688 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.969 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 256] | 0.791 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.294 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 1024] | 0.769 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.854 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.825 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.959 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.454 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.962 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.882 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.861 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.917 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.426 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.922 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.972 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.969 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.771 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.758 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.922 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.417 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.921 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.968 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.963 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.896 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.903 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.959 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.444 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.957 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.939 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.928 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.856 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.871 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.970 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.438 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.971 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.976 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.963 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.960 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.968 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.969 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.855 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.842 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.963 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.429 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.962 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.969 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.955 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.435 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.955 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.951 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.900 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.894 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.952 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.406 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.951 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.948 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.438 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.946 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.909 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.851 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.795 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.785 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.945 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.439 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.944 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.976 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.950 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.434 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.946 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.927 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.858 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.793 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.789 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.951 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.425 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.948 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.961 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.954 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.948 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.945 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.433 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.938 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.930 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.934 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.925 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.952 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.502 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.947 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.939 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.549 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.935 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.929 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.576 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.928 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.921 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.563 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.920 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.949 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.453 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.848 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.692 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.623 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096, 1024] | 0.979 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096] | 0.506 | 0.005 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 4096] | 0.976 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.980 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.562 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.948 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.695 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.679 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096, 1024] | 0.925 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096] | 0.556 | 0.005 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 4096] | 0.924 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 | Epoch 5 |Statistics of the movement-sparsity algorithm: Epoch 5 |+----------------------------------+--------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+==================================+========+ Epoch 5 || Mask Importance Threshold | -0.000 | Epoch 5 |+----------------------------------+--------+ Epoch 5 || Importance Regularization Factor | 1.000 | Epoch 5 |+----------------------------------+--------+ Epoch 5 | Epoch 5 |Statistics of the quantization algorithm: Epoch 5 |+--------------------------------+-------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+================================+=======+ Epoch 5 || Ratio of enabled quantizations | 100 | Epoch 5 |+--------------------------------+-------+ Epoch 5 | Epoch 5 |Statistics of the quantization share: Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+==================================+======================+ Epoch 5 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 | Epoch 5 |Statistics of the bitwidth distribution: Epoch 5 |+--------------+---------------------+--------------------+--------------------+ Epoch 5 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 5 || | WQs | Placed AQs | Qs | Epoch 5 |+==============+=====================+====================+====================+ Epoch 5 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 5 || | 149) | 149) | 298) | Epoch 5 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 6 |+-----------------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+=========================================+=======+ Epoch 6 || Sparsity level of the whole model | 0.394 | Epoch 6 |+-----------------------------------------+-------+ Epoch 6 || Sparsity level of all sparsified layers | 0.408 | Epoch 6 |+-----------------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics by sparsified layers: Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 6 |+======================+================+================+=====================+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 128] | 0.395 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.395 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 512] | 0.395 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 128] | 0.197 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.197 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 512] | 0.197 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 256] | 0.231 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0.231 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 1024] | 0.231 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 256] | 0.199 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0.199 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 1024] | 0.199 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.428 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.428 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.384 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.384 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.384 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.379 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.379 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.379 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.416 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.416 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.416 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.414 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.414 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.414 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.406 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.406 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.406 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.402 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.402 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.402 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.367 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.367 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.367 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.399 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.399 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.399 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.380 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.380 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.380 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.458 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.458 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.458 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.496 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.496 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.496 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.518 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.518 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.518 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.501 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.501 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.501 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096, 1024] | 0.487 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096] | 0.487 | 0.005 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 4096] | 0.487 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096, 1024] | 0.483 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096] | 0.483 | 0.005 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 4096] | 0.483 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 | Epoch 6 |Statistics of the movement-sparsity algorithm: Epoch 6 |+----------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+==================================+=======+ Epoch 6 || Mask Importance Threshold | 0 | Epoch 6 |+----------------------------------+-------+ Epoch 6 || Importance Regularization Factor | 1 | Epoch 6 |+----------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics of the quantization algorithm: Epoch 6 |+--------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+================================+=======+ Epoch 6 || Ratio of enabled quantizations | 100 | Epoch 6 |+--------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics of the quantization share: Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+==================================+======================+ Epoch 6 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 | Epoch 6 |Statistics of the bitwidth distribution: Epoch 6 |+--------------+---------------------+--------------------+--------------------+ Epoch 6 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 6 || | WQs | Placed AQs | Qs | Epoch 6 |+==============+=====================+====================+====================+ Epoch 6 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 6 || | 149) | 149) | 298) | Epoch 6 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 7 |+-----------------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+=========================================+=======+ Epoch 7 || Sparsity level of the whole model | 0.394 | Epoch 7 |+-----------------------------------------+-------+ Epoch 7 || Sparsity level of all sparsified layers | 0.408 | Epoch 7 |+-----------------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics by sparsified layers: Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 7 |+======================+================+================+=====================+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 128] | 0.395 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.395 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 512] | 0.395 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 128] | 0.197 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.197 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 512] | 0.197 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 256] | 0.231 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0.231 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 1024] | 0.231 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 256] | 0.199 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0.199 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 1024] | 0.199 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.428 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.428 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.384 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.384 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.384 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.379 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.379 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.379 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.416 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.416 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.416 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.414 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.414 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.414 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.406 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.406 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.406 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.402 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.402 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.402 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.367 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.367 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.367 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.399 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.399 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.399 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.380 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.380 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.380 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.458 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.458 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.458 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.496 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.496 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.496 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.518 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.518 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.518 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.501 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.501 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.501 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096, 1024] | 0.487 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096] | 0.487 | 0.005 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 4096] | 0.487 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096, 1024] | 0.483 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096] | 0.483 | 0.005 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 4096] | 0.483 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 | Epoch 7 |Statistics of the movement-sparsity algorithm: Epoch 7 |+----------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+==================================+=======+ Epoch 7 || Mask Importance Threshold | 0 | Epoch 7 |+----------------------------------+-------+ Epoch 7 || Importance Regularization Factor | 1 | Epoch 7 |+----------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics of the quantization algorithm: Epoch 7 |+--------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+================================+=======+ Epoch 7 || Ratio of enabled quantizations | 100 | Epoch 7 |+--------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics of the quantization share: Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+==================================+======================+ Epoch 7 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 | Epoch 7 |Statistics of the bitwidth distribution: Epoch 7 |+--------------+---------------------+--------------------+--------------------+ Epoch 7 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 7 || | WQs | Placed AQs | Qs | Epoch 7 |+==============+=====================+====================+====================+ Epoch 7 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 7 || | 149) | 149) | 298) | Epoch 7 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 8 |+-----------------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+=========================================+=======+ Epoch 8 || Sparsity level of the whole model | 0.394 | Epoch 8 |+-----------------------------------------+-------+ Epoch 8 || Sparsity level of all sparsified layers | 0.408 | Epoch 8 |+-----------------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics by sparsified layers: Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 8 |+======================+================+================+=====================+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 128] | 0.395 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.395 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 512] | 0.395 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 128] | 0.197 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.197 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 512] | 0.197 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 256] | 0.231 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0.231 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 1024] | 0.231 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 256] | 0.199 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0.199 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 1024] | 0.199 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.428 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.428 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.384 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.384 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.384 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.379 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.379 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.379 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.416 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.416 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.416 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.414 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.414 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.414 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.406 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.406 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.406 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.402 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.402 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.402 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.367 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.367 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.367 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.399 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.399 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.399 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.380 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.380 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.380 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.458 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.458 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.458 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.496 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.496 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.496 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.518 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.518 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.518 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.501 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.501 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.501 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096, 1024] | 0.487 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096] | 0.487 | 0.005 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 4096] | 0.487 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096, 1024] | 0.483 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096] | 0.483 | 0.005 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 4096] | 0.483 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 | Epoch 8 |Statistics of the movement-sparsity algorithm: Epoch 8 |+----------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+==================================+=======+ Epoch 8 || Mask Importance Threshold | 0 | Epoch 8 |+----------------------------------+-------+ Epoch 8 || Importance Regularization Factor | 1 | Epoch 8 |+----------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics of the quantization algorithm: Epoch 8 |+--------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+================================+=======+ Epoch 8 || Ratio of enabled quantizations | 100 | Epoch 8 |+--------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics of the quantization share: Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+==================================+======================+ Epoch 8 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 | Epoch 8 |Statistics of the bitwidth distribution: Epoch 8 |+--------------+---------------------+--------------------+--------------------+ Epoch 8 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 8 || | WQs | Placed AQs | Qs | Epoch 8 |+==============+=====================+====================+====================+ Epoch 8 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 8 || | 149) | 149) | 298) | Epoch 8 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 9 |+-----------------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+=========================================+=======+ Epoch 9 || Sparsity level of the whole model | 0.394 | Epoch 9 |+-----------------------------------------+-------+ Epoch 9 || Sparsity level of all sparsified layers | 0.408 | Epoch 9 |+-----------------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics by sparsified layers: Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 9 |+======================+================+================+=====================+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 128] | 0.395 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.395 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 512] | 0.395 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 128] | 0.197 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.197 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 512] | 0.197 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 256] | 0.231 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0.231 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 1024] | 0.231 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 256] | 0.199 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0.199 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 1024] | 0.199 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.428 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.428 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.384 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.384 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.384 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.379 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.379 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.379 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.416 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.416 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.416 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.414 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.414 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.414 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.406 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.406 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.406 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.402 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.402 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.402 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.367 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.367 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.367 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.399 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.399 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.399 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.397 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.397 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.250 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.380 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.380 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.380 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.458 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.458 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.458 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.496 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.496 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.496 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.518 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.518 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.518 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.501 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.501 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.501 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096, 1024] | 0.487 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096] | 0.487 | 0.005 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 4096] | 0.487 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096, 1024] | 0.483 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096] | 0.483 | 0.005 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 4096] | 0.483 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 | Epoch 9 |Statistics of the movement-sparsity algorithm: Epoch 9 |+----------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+==================================+=======+ Epoch 9 || Mask Importance Threshold | 0 | Epoch 9 |+----------------------------------+-------+ Epoch 9 || Importance Regularization Factor | 1 | Epoch 9 |+----------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics of the quantization algorithm: Epoch 9 |+--------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+================================+=======+ Epoch 9 || Ratio of enabled quantizations | 100 | Epoch 9 |+--------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics of the quantization share: Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+==================================+======================+ Epoch 9 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 | Epoch 9 |Statistics of the bitwidth distribution: Epoch 9 |+--------------+---------------------+--------------------+--------------------+ Epoch 9 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 9 || | WQs | Placed AQs | Qs | Epoch 9 |+==============+=====================+====================+====================+ Epoch 9 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 9 || | 149) | 149) | 298) | Epoch 9 |+--------------+---------------------+--------------------+--------------------+