INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/NNCFLinear[classifier]/linear_0 INFO:nncf:Not adding activation input quantizer for operation: 4 SwinForImageClassification/SwinModel[swin]/SwinEmbeddings[embeddings]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 6 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 26 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 29 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 41 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 42 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 47 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 48 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 69 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 71 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 75 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 88 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 89 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 94 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 102 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 104 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 124 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 127 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 139 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 140 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 145 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 146 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 167 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 169 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 173 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 186 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 187 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 192 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 200 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 202 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 222 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 225 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 237 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 238 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 243 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 244 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 265 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 267 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 271 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 284 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 285 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 290 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 291 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 311 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 314 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 326 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 327 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 332 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 333 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 354 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 356 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 360 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 373 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 374 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 379 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 380 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 400 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 403 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 415 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 416 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 421 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 422 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 443 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 445 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 449 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 462 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 463 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 468 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 469 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 489 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 492 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 504 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 505 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 510 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 511 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 532 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 534 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 538 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 551 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 552 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 557 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 558 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 578 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 581 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 593 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 594 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 599 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 600 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 621 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 623 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 627 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 640 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 641 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 646 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 647 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 667 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 670 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 682 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 683 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 688 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 689 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 710 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 712 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 716 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 729 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 730 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 735 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 736 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 756 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 759 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 771 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 772 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 777 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 778 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 799 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 801 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 805 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 818 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 819 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 824 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 825 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 845 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 848 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 860 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 861 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 866 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 867 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 888 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 890 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 894 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 907 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 908 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 913 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 914 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 934 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 937 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 949 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 950 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 955 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 956 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 977 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 979 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 983 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 996 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 997 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1002 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1010 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1012 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1032 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1035 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 1047 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1048 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1053 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1054 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1074 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1077 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 1089 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1090 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1095 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1096 SwinForImageClassification/SwinModel[swin]/NNCFLayerNorm[layernorm]/layer_norm_0 INFO:nncf:Collecting tensor statistics |████████ | 1 / 2 INFO:nncf:Collecting tensor statistics |████████████████| 2 / 2 INFO:nncf:Compiling and loading torch extension: quantized_functions_cuda... INFO:nncf:Finished loading torch extension: quantized_functions_cuda INFO:nncf:BatchNorm statistics adaptation |█ | 1 / 13 INFO:nncf:BatchNorm statistics adaptation |██ | 2 / 13 INFO:nncf:BatchNorm statistics adaptation |███ | 3 / 13 INFO:nncf:BatchNorm statistics adaptation |████ | 4 / 13 INFO:nncf:BatchNorm statistics adaptation |██████ | 5 / 13 INFO:nncf:BatchNorm statistics adaptation |███████ | 6 / 13 INFO:nncf:BatchNorm statistics adaptation |████████ | 7 / 13 INFO:nncf:BatchNorm statistics adaptation |█████████ | 8 / 13 INFO:nncf:BatchNorm statistics adaptation |███████████ | 9 / 13 INFO:nncf:BatchNorm statistics adaptation |████████████ | 10 / 13 INFO:nncf:BatchNorm statistics adaptation |█████████████ | 11 / 13 INFO:nncf:BatchNorm statistics adaptation |██████████████ | 12 / 13 INFO:nncf:BatchNorm statistics adaptation |████████████████| 13 / 13 WARNING:nncf:Number of potential building blocks is too much. The processing time can be high. Shallow the accepted range for the length of building blocks via max_block_size and min_block_size to accelerate the search process. INFO:nncf:Movement sparsity scheduler updates importance threshold and regularizationfactor per optimizer step, but steps_per_epoch was not set in config. Will measure the actual steps per epoch as signaled by a .epoch_step() call. INFO:nncf:Statistics of the sparsified model: Epoch 0 |+-----------------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+=========================================+=======+ Epoch 0 || Sparsity level of the whole model | 0 | Epoch 0 |+-----------------------------------------+-------+ Epoch 0 || Sparsity level of all sparsified layers | 0 | Epoch 0 |+-----------------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics by sparsified layers: Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 0 |+======================+================+================+=====================+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 | Epoch 0 |Statistics of the movement-sparsity algorithm: Epoch 0 |+----------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+==================================+=======+ Epoch 0 || Mask Importance Threshold | -inf | Epoch 0 |+----------------------------------+-------+ Epoch 0 || Importance Regularization Factor | 0 | Epoch 0 |+----------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics of the quantization algorithm: Epoch 0 |+--------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+================================+=======+ Epoch 0 || Ratio of enabled quantizations | 100 | Epoch 0 |+--------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics of the quantization share: Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+==================================+======================+ Epoch 0 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 | Epoch 0 |Statistics of the bitwidth distribution: Epoch 0 |+--------------+---------------------+--------------------+--------------------+ Epoch 0 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 0 || | WQs | Placed AQs | Qs | Epoch 0 |+==============+=====================+====================+====================+ Epoch 0 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 0 || | 149) | 149) | 298) | Epoch 0 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 1 |+-----------------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+=========================================+=======+ Epoch 1 || Sparsity level of the whole model | 0 | Epoch 1 |+-----------------------------------------+-------+ Epoch 1 || Sparsity level of all sparsified layers | 0 | Epoch 1 |+-----------------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics by sparsified layers: Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 1 |+======================+================+================+=====================+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 | Epoch 1 |Statistics of the movement-sparsity algorithm: Epoch 1 |+----------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+==================================+=======+ Epoch 1 || Mask Importance Threshold | -inf | Epoch 1 |+----------------------------------+-------+ Epoch 1 || Importance Regularization Factor | 0 | Epoch 1 |+----------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics of the quantization algorithm: Epoch 1 |+--------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+================================+=======+ Epoch 1 || Ratio of enabled quantizations | 100 | Epoch 1 |+--------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics of the quantization share: Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+==================================+======================+ Epoch 1 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 | Epoch 1 |Statistics of the bitwidth distribution: Epoch 1 |+--------------+---------------------+--------------------+--------------------+ Epoch 1 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 1 || | WQs | Placed AQs | Qs | Epoch 1 |+==============+=====================+====================+====================+ Epoch 1 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 1 || | 149) | 149) | 298) | Epoch 1 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 2 |+-----------------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+=========================================+=======+ Epoch 2 || Sparsity level of the whole model | 0 | Epoch 2 |+-----------------------------------------+-------+ Epoch 2 || Sparsity level of all sparsified layers | 0 | Epoch 2 |+-----------------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics by sparsified layers: Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 2 |+======================+================+================+=====================+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 | Epoch 2 |Statistics of the movement-sparsity algorithm: Epoch 2 |+----------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+==================================+=======+ Epoch 2 || Mask Importance Threshold | -inf | Epoch 2 |+----------------------------------+-------+ Epoch 2 || Importance Regularization Factor | 0 | Epoch 2 |+----------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics of the quantization algorithm: Epoch 2 |+--------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+================================+=======+ Epoch 2 || Ratio of enabled quantizations | 100 | Epoch 2 |+--------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics of the quantization share: Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+==================================+======================+ Epoch 2 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 | Epoch 2 |Statistics of the bitwidth distribution: Epoch 2 |+--------------+---------------------+--------------------+--------------------+ Epoch 2 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 2 || | WQs | Placed AQs | Qs | Epoch 2 |+==============+=====================+====================+====================+ Epoch 2 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 2 || | 149) | 149) | 298) | Epoch 2 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Movement sparsity automatically calculates `init_importance_threshold` as -0.0058449343778193 so that warmup starts from ~0.1% linear layer sparsity. INFO:nncf:Statistics of the sparsified model: Epoch 3 |+-----------------------------------------+-------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+=========================================+=======+ Epoch 3 || Sparsity level of the whole model | 0.716 | Epoch 3 |+-----------------------------------------+-------+ Epoch 3 || Sparsity level of all sparsified layers | 0.742 | Epoch 3 |+-----------------------------------------+-------+ Epoch 3 | Epoch 3 |Statistics by sparsified layers: Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 3 |+======================+================+================+=====================+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 128] | 0.406 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.234 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 512] | 0.400 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.875 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.828 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 128] | 0.297 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.150 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 512] | 0.324 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.812 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.977 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.609 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.523 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.375 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 256] | 0.194 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.058 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 1024] | 0.330 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.812 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.758 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.691 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.750 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 256] | 0.328 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.058 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 1024] | 0.413 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.964 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.948 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.682 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.583 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.650 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.108 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.833 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.686 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.641 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.549 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.096 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.741 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.907 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.904 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.595 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.505 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.613 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.107 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.760 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.949 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.936 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.713 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.699 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.708 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.121 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.829 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.888 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.843 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.641 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.567 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.725 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.113 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.844 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.949 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.807 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.768 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.730 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.119 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.854 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.870 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.848 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.602 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.570 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.741 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.104 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.839 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.931 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.902 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.711 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.662 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.676 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.109 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.798 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.773 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.406 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.729 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.566 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.521 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.626 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.105 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.770 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.918 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.873 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.698 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.668 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.604 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.113 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.751 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.806 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.344 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.728 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.542 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.494 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.635 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.083 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.766 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.858 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.281 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.801 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.670 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.668 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.666 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.103 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.782 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.761 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.344 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.679 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.522 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.522 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.722 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.100 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.799 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.156 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.797 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.693 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.695 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.741 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.122 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.804 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.814 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.746 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.614 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.588 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.829 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.126 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.847 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.902 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.156 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.823 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.751 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.721 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.825 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.158 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.833 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.872 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.771 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.630 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.578 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.825 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.177 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.836 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.942 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.853 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.735 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.662 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.753 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.197 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.771 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.823 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.234 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.659 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.385 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.303 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.531 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096, 1024] | 0.953 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096] | 0.105 | 0.005 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 4096] | 0.956 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.951 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.250 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.865 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.376 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.953 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.345 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.641 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096, 1024] | 0.662 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096] | 0.278 | 0.005 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 4096] | 0.689 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 | Epoch 3 |Statistics of the movement-sparsity algorithm: Epoch 3 |+----------------------------------+--------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+==================================+========+ Epoch 3 || Mask Importance Threshold | -0.002 | Epoch 3 |+----------------------------------+--------+ Epoch 3 || Importance Regularization Factor | 0.703 | Epoch 3 |+----------------------------------+--------+ Epoch 3 | Epoch 3 |Statistics of the quantization algorithm: Epoch 3 |+--------------------------------+-------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+================================+=======+ Epoch 3 || Ratio of enabled quantizations | 100 | Epoch 3 |+--------------------------------+-------+ Epoch 3 | Epoch 3 |Statistics of the quantization share: Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+==================================+======================+ Epoch 3 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 | Epoch 3 |Statistics of the bitwidth distribution: Epoch 3 |+--------------+---------------------+--------------------+--------------------+ Epoch 3 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 3 || | WQs | Placed AQs | Qs | Epoch 3 |+==============+=====================+====================+====================+ Epoch 3 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 3 || | 149) | 149) | 298) | Epoch 3 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 4 |+-----------------------------------------+-------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+=========================================+=======+ Epoch 4 || Sparsity level of the whole model | 0.880 | Epoch 4 |+-----------------------------------------+-------+ Epoch 4 || Sparsity level of all sparsified layers | 0.912 | Epoch 4 |+-----------------------------------------+-------+ Epoch 4 | Epoch 4 |Statistics by sparsified layers: Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 4 |+======================+================+================+=====================+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 128] | 0.654 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.461 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 512] | 0.637 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 128] | 0.580 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.336 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 512] | 0.572 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.836 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.789 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 256] | 0.588 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.271 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 1024] | 0.636 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 256] | 0.746 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.245 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 1024] | 0.732 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.962 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.818 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.794 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.945 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.956 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.872 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.840 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.892 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.374 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.902 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.970 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.960 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.769 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.769 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.900 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.369 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.908 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.960 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.955 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.864 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.870 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.945 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.396 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.950 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.930 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.923 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.844 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.829 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.959 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.382 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.964 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.977 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.962 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.957 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.960 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.366 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.963 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.855 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.845 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.955 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.363 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.954 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.968 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.929 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.917 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.944 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.366 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.946 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.945 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.914 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.851 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.837 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.938 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.358 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.940 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.955 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.945 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.921 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.364 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.924 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.892 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.834 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.768 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.779 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.931 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.369 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.934 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.969 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.929 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.381 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.928 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.910 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.469 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.836 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.784 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.763 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.931 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.384 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.935 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.967 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.943 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.940 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.936 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.397 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.930 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.944 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.594 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.886 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.867 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.875 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.944 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.939 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.931 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.462 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.931 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.594 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.977 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.975 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.973 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.916 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.513 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.917 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.972 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.967 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.919 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.487 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.919 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.942 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.391 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.824 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.666 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.594 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096, 1024] | 0.976 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096] | 0.440 | 0.005 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 4096] | 0.973 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.980 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.484 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.938 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.665 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.645 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096, 1024] | 0.903 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096] | 0.513 | 0.005 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 4096] | 0.898 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 | Epoch 4 |Statistics of the movement-sparsity algorithm: Epoch 4 |+----------------------------------+--------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+==================================+========+ Epoch 4 || Mask Importance Threshold | -0.000 | Epoch 4 |+----------------------------------+--------+ Epoch 4 || Importance Regularization Factor | 0.963 | Epoch 4 |+----------------------------------+--------+ Epoch 4 | Epoch 4 |Statistics of the quantization algorithm: Epoch 4 |+--------------------------------+-------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+================================+=======+ Epoch 4 || Ratio of enabled quantizations | 100 | Epoch 4 |+--------------------------------+-------+ Epoch 4 | Epoch 4 |Statistics of the quantization share: Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+==================================+======================+ Epoch 4 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 | Epoch 4 |Statistics of the bitwidth distribution: Epoch 4 |+--------------+---------------------+--------------------+--------------------+ Epoch 4 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 4 || | WQs | Placed AQs | Qs | Epoch 4 |+==============+=====================+====================+====================+ Epoch 4 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 4 || | 149) | 149) | 298) | Epoch 4 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 5 |+-----------------------------------------+-------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+=========================================+=======+ Epoch 5 || Sparsity level of the whole model | 0.901 | Epoch 5 |+-----------------------------------------+-------+ Epoch 5 || Sparsity level of all sparsified layers | 0.933 | Epoch 5 |+-----------------------------------------+-------+ Epoch 5 | Epoch 5 |Statistics by sparsified layers: Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 5 |+======================+================+================+=====================+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 128] | 0.703 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.498 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 512] | 0.688 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 128] | 0.633 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.377 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 512] | 0.613 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.953 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.934 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.875 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 256] | 0.694 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.302 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 1024] | 0.710 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 256] | 0.811 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.292 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 1024] | 0.796 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.858 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.833 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.967 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.452 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.969 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.908 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.896 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.923 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.420 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.924 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.972 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.808 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.795 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.919 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.426 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.920 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.970 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.965 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.890 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.902 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.967 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.455 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.964 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.944 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.932 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.855 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.854 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.974 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.453 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.973 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.976 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.425 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.975 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.892 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.873 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.970 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.427 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.967 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.957 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.951 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.964 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.426 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.964 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.945 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.887 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.877 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.959 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.412 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.959 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.977 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.947 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.945 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.902 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.855 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.788 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.779 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.956 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.952 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.956 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.443 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.955 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.881 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.848 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.828 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.957 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.448 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.954 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.970 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.961 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.958 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.953 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.462 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.949 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.970 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.927 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.918 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.913 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.962 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.542 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.956 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.952 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.602 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.950 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.933 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.662 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.931 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.939 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.620 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.938 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.964 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.453 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.852 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.702 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.641 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.953 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096, 1024] | 0.980 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096] | 0.586 | 0.005 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 4096] | 0.978 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.980 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.578 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.946 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.721 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.712 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096, 1024] | 0.941 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096] | 0.555 | 0.005 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 4096] | 0.940 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 | Epoch 5 |Statistics of the movement-sparsity algorithm: Epoch 5 |+----------------------------------+--------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+==================================+========+ Epoch 5 || Mask Importance Threshold | -0.000 | Epoch 5 |+----------------------------------+--------+ Epoch 5 || Importance Regularization Factor | 1.000 | Epoch 5 |+----------------------------------+--------+ Epoch 5 | Epoch 5 |Statistics of the quantization algorithm: Epoch 5 |+--------------------------------+-------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+================================+=======+ Epoch 5 || Ratio of enabled quantizations | 100 | Epoch 5 |+--------------------------------+-------+ Epoch 5 | Epoch 5 |Statistics of the quantization share: Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+==================================+======================+ Epoch 5 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 | Epoch 5 |Statistics of the bitwidth distribution: Epoch 5 |+--------------+---------------------+--------------------+--------------------+ Epoch 5 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 5 || | WQs | Placed AQs | Qs | Epoch 5 |+==============+=====================+====================+====================+ Epoch 5 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 5 || | 149) | 149) | 298) | Epoch 5 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 6 |+-----------------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+=========================================+=======+ Epoch 6 || Sparsity level of the whole model | 0.430 | Epoch 6 |+-----------------------------------------+-------+ Epoch 6 || Sparsity level of all sparsified layers | 0.445 | Epoch 6 |+-----------------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics by sparsified layers: Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 6 |+======================+================+================+=====================+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 | Epoch 6 |Statistics of the movement-sparsity algorithm: Epoch 6 |+----------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+==================================+=======+ Epoch 6 || Mask Importance Threshold | 0 | Epoch 6 |+----------------------------------+-------+ Epoch 6 || Importance Regularization Factor | 1 | Epoch 6 |+----------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics of the quantization algorithm: Epoch 6 |+--------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+================================+=======+ Epoch 6 || Ratio of enabled quantizations | 100 | Epoch 6 |+--------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics of the quantization share: Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+==================================+======================+ Epoch 6 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 | Epoch 6 |Statistics of the bitwidth distribution: Epoch 6 |+--------------+---------------------+--------------------+--------------------+ Epoch 6 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 6 || | WQs | Placed AQs | Qs | Epoch 6 |+==============+=====================+====================+====================+ Epoch 6 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 6 || | 149) | 149) | 298) | Epoch 6 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 7 |+-----------------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+=========================================+=======+ Epoch 7 || Sparsity level of the whole model | 0.430 | Epoch 7 |+-----------------------------------------+-------+ Epoch 7 || Sparsity level of all sparsified layers | 0.445 | Epoch 7 |+-----------------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics by sparsified layers: Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 7 |+======================+================+================+=====================+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 | Epoch 7 |Statistics of the movement-sparsity algorithm: Epoch 7 |+----------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+==================================+=======+ Epoch 7 || Mask Importance Threshold | 0 | Epoch 7 |+----------------------------------+-------+ Epoch 7 || Importance Regularization Factor | 1 | Epoch 7 |+----------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics of the quantization algorithm: Epoch 7 |+--------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+================================+=======+ Epoch 7 || Ratio of enabled quantizations | 100 | Epoch 7 |+--------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics of the quantization share: Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+==================================+======================+ Epoch 7 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 | Epoch 7 |Statistics of the bitwidth distribution: Epoch 7 |+--------------+---------------------+--------------------+--------------------+ Epoch 7 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 7 || | WQs | Placed AQs | Qs | Epoch 7 |+==============+=====================+====================+====================+ Epoch 7 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 7 || | 149) | 149) | 298) | Epoch 7 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 8 |+-----------------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+=========================================+=======+ Epoch 8 || Sparsity level of the whole model | 0.430 | Epoch 8 |+-----------------------------------------+-------+ Epoch 8 || Sparsity level of all sparsified layers | 0.445 | Epoch 8 |+-----------------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics by sparsified layers: Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 8 |+======================+================+================+=====================+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 | Epoch 8 |Statistics of the movement-sparsity algorithm: Epoch 8 |+----------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+==================================+=======+ Epoch 8 || Mask Importance Threshold | 0 | Epoch 8 |+----------------------------------+-------+ Epoch 8 || Importance Regularization Factor | 1 | Epoch 8 |+----------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics of the quantization algorithm: Epoch 8 |+--------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+================================+=======+ Epoch 8 || Ratio of enabled quantizations | 100 | Epoch 8 |+--------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics of the quantization share: Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+==================================+======================+ Epoch 8 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 | Epoch 8 |Statistics of the bitwidth distribution: Epoch 8 |+--------------+---------------------+--------------------+--------------------+ Epoch 8 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 8 || | WQs | Placed AQs | Qs | Epoch 8 |+==============+=====================+====================+====================+ Epoch 8 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 8 || | 149) | 149) | 298) | Epoch 8 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 9 |+-----------------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+=========================================+=======+ Epoch 9 || Sparsity level of the whole model | 0.430 | Epoch 9 |+-----------------------------------------+-------+ Epoch 9 || Sparsity level of all sparsified layers | 0.445 | Epoch 9 |+-----------------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics by sparsified layers: Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 9 |+======================+================+================+=====================+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 | Epoch 9 |Statistics of the movement-sparsity algorithm: Epoch 9 |+----------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+==================================+=======+ Epoch 9 || Mask Importance Threshold | 0 | Epoch 9 |+----------------------------------+-------+ Epoch 9 || Importance Regularization Factor | 1 | Epoch 9 |+----------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics of the quantization algorithm: Epoch 9 |+--------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+================================+=======+ Epoch 9 || Ratio of enabled quantizations | 100 | Epoch 9 |+--------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics of the quantization share: Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+==================================+======================+ Epoch 9 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 | Epoch 9 |Statistics of the bitwidth distribution: Epoch 9 |+--------------+---------------------+--------------------+--------------------+ Epoch 9 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 9 || | WQs | Placed AQs | Qs | Epoch 9 |+==============+=====================+====================+====================+ Epoch 9 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 9 || | 149) | 149) | 298) | Epoch 9 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 10 |+-----------------------------------------+-------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+=========================================+=======+ Epoch 10 || Sparsity level of the whole model | 0.430 | Epoch 10 |+-----------------------------------------+-------+ Epoch 10 || Sparsity level of all sparsified layers | 0.445 | Epoch 10 |+-----------------------------------------+-------+ Epoch 10 | Epoch 10 |Statistics by sparsified layers: Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 10 |+======================+================+================+=====================+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 | Epoch 10 |Statistics of the movement-sparsity algorithm: Epoch 10 |+----------------------------------+-------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+==================================+=======+ Epoch 10 || Mask Importance Threshold | 0 | Epoch 10 |+----------------------------------+-------+ Epoch 10 || Importance Regularization Factor | 1 | Epoch 10 |+----------------------------------+-------+ Epoch 10 | Epoch 10 |Statistics of the quantization algorithm: Epoch 10 |+--------------------------------+-------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+================================+=======+ Epoch 10 || Ratio of enabled quantizations | 100 | Epoch 10 |+--------------------------------+-------+ Epoch 10 | Epoch 10 |Statistics of the quantization share: Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+==================================+======================+ Epoch 10 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 | Epoch 10 |Statistics of the bitwidth distribution: Epoch 10 |+--------------+---------------------+--------------------+--------------------+ Epoch 10 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 10 || | WQs | Placed AQs | Qs | Epoch 10 |+==============+=====================+====================+====================+ Epoch 10 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 10 || | 149) | 149) | 298) | Epoch 10 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 11 |+-----------------------------------------+-------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+=========================================+=======+ Epoch 11 || Sparsity level of the whole model | 0.430 | Epoch 11 |+-----------------------------------------+-------+ Epoch 11 || Sparsity level of all sparsified layers | 0.445 | Epoch 11 |+-----------------------------------------+-------+ Epoch 11 | Epoch 11 |Statistics by sparsified layers: Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 11 |+======================+================+================+=====================+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 | Epoch 11 |Statistics of the movement-sparsity algorithm: Epoch 11 |+----------------------------------+-------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+==================================+=======+ Epoch 11 || Mask Importance Threshold | 0 | Epoch 11 |+----------------------------------+-------+ Epoch 11 || Importance Regularization Factor | 1 | Epoch 11 |+----------------------------------+-------+ Epoch 11 | Epoch 11 |Statistics of the quantization algorithm: Epoch 11 |+--------------------------------+-------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+================================+=======+ Epoch 11 || Ratio of enabled quantizations | 100 | Epoch 11 |+--------------------------------+-------+ Epoch 11 | Epoch 11 |Statistics of the quantization share: Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+==================================+======================+ Epoch 11 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 | Epoch 11 |Statistics of the bitwidth distribution: Epoch 11 |+--------------+---------------------+--------------------+--------------------+ Epoch 11 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 11 || | WQs | Placed AQs | Qs | Epoch 11 |+==============+=====================+====================+====================+ Epoch 11 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 11 || | 149) | 149) | 298) | Epoch 11 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 12 |+-----------------------------------------+-------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+=========================================+=======+ Epoch 12 || Sparsity level of the whole model | 0.430 | Epoch 12 |+-----------------------------------------+-------+ Epoch 12 || Sparsity level of all sparsified layers | 0.445 | Epoch 12 |+-----------------------------------------+-------+ Epoch 12 | Epoch 12 |Statistics by sparsified layers: Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 12 |+======================+================+================+=====================+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 | Epoch 12 |Statistics of the movement-sparsity algorithm: Epoch 12 |+----------------------------------+-------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+==================================+=======+ Epoch 12 || Mask Importance Threshold | 0 | Epoch 12 |+----------------------------------+-------+ Epoch 12 || Importance Regularization Factor | 1 | Epoch 12 |+----------------------------------+-------+ Epoch 12 | Epoch 12 |Statistics of the quantization algorithm: Epoch 12 |+--------------------------------+-------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+================================+=======+ Epoch 12 || Ratio of enabled quantizations | 100 | Epoch 12 |+--------------------------------+-------+ Epoch 12 | Epoch 12 |Statistics of the quantization share: Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+==================================+======================+ Epoch 12 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 | Epoch 12 |Statistics of the bitwidth distribution: Epoch 12 |+--------------+---------------------+--------------------+--------------------+ Epoch 12 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 12 || | WQs | Placed AQs | Qs | Epoch 12 |+==============+=====================+====================+====================+ Epoch 12 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 12 || | 149) | 149) | 298) | Epoch 12 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 13 |+-----------------------------------------+-------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+=========================================+=======+ Epoch 13 || Sparsity level of the whole model | 0.430 | Epoch 13 |+-----------------------------------------+-------+ Epoch 13 || Sparsity level of all sparsified layers | 0.445 | Epoch 13 |+-----------------------------------------+-------+ Epoch 13 | Epoch 13 |Statistics by sparsified layers: Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 13 |+======================+================+================+=====================+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 | Epoch 13 |Statistics of the movement-sparsity algorithm: Epoch 13 |+----------------------------------+-------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+==================================+=======+ Epoch 13 || Mask Importance Threshold | 0 | Epoch 13 |+----------------------------------+-------+ Epoch 13 || Importance Regularization Factor | 1 | Epoch 13 |+----------------------------------+-------+ Epoch 13 | Epoch 13 |Statistics of the quantization algorithm: Epoch 13 |+--------------------------------+-------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+================================+=======+ Epoch 13 || Ratio of enabled quantizations | 100 | Epoch 13 |+--------------------------------+-------+ Epoch 13 | Epoch 13 |Statistics of the quantization share: Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+==================================+======================+ Epoch 13 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 | Epoch 13 |Statistics of the bitwidth distribution: Epoch 13 |+--------------+---------------------+--------------------+--------------------+ Epoch 13 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 13 || | WQs | Placed AQs | Qs | Epoch 13 |+==============+=====================+====================+====================+ Epoch 13 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 13 || | 149) | 149) | 298) | Epoch 13 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 14 |+-----------------------------------------+-------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+=========================================+=======+ Epoch 14 || Sparsity level of the whole model | 0.430 | Epoch 14 |+-----------------------------------------+-------+ Epoch 14 || Sparsity level of all sparsified layers | 0.445 | Epoch 14 |+-----------------------------------------+-------+ Epoch 14 | Epoch 14 |Statistics by sparsified layers: Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 14 |+======================+================+================+=====================+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 | Epoch 14 |Statistics of the movement-sparsity algorithm: Epoch 14 |+----------------------------------+-------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+==================================+=======+ Epoch 14 || Mask Importance Threshold | 0 | Epoch 14 |+----------------------------------+-------+ Epoch 14 || Importance Regularization Factor | 1 | Epoch 14 |+----------------------------------+-------+ Epoch 14 | Epoch 14 |Statistics of the quantization algorithm: Epoch 14 |+--------------------------------+-------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+================================+=======+ Epoch 14 || Ratio of enabled quantizations | 100 | Epoch 14 |+--------------------------------+-------+ Epoch 14 | Epoch 14 |Statistics of the quantization share: Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+==================================+======================+ Epoch 14 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 | Epoch 14 |Statistics of the bitwidth distribution: Epoch 14 |+--------------+---------------------+--------------------+--------------------+ Epoch 14 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 14 || | WQs | Placed AQs | Qs | Epoch 14 |+==============+=====================+====================+====================+ Epoch 14 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 14 || | 149) | 149) | 298) | Epoch 14 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 15 |+-----------------------------------------+-------+ Epoch 15 || Statistic's name | Value | Epoch 15 |+=========================================+=======+ Epoch 15 || Sparsity level of the whole model | 0.430 | Epoch 15 |+-----------------------------------------+-------+ Epoch 15 || Sparsity level of all sparsified layers | 0.445 | Epoch 15 |+-----------------------------------------+-------+ Epoch 15 | Epoch 15 |Statistics by sparsified layers: Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 15 |+======================+================+================+=====================+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[0]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[1]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[2]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[3]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[4]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[5]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[6]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[7]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[8]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[9]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[10]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[11]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[12]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[13]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[14]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[15]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[16]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[query]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[key]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfAttention[self]/NN | | | | Epoch 15 || CFLinear[value]/line | | | | Epoch 15 || ar_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinAttenti | | | | Epoch 15 || on[attention]/SwinSe | | | | Epoch 15 || lfOutput[output]/NNC | | | | Epoch 15 || FLinear[dense]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinInterme | | | | Epoch 15 || diate[intermediate]/ | | | | Epoch 15 || NNCFLinear[dense]/li | | | | Epoch 15 || near_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[2]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[17]/SwinOutput[ | | | | Epoch 15 || output]/NNCFLinear[d | | | | Epoch 15 || ense]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[0]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[query]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[key]/linear_ | | | | Epoch 15 || 0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fAttention[self]/NNC | | | | Epoch 15 || FLinear[value]/linea | | | | Epoch 15 || r_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinAttentio | | | | Epoch 15 || n[attention]/SwinSel | | | | Epoch 15 || fOutput[output]/NNCF | | | | Epoch 15 || Linear[dense]/linear | | | | Epoch 15 || _0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinIntermed | | | | Epoch 15 || iate[intermediate]/N | | | | Epoch 15 || NCFLinear[dense]/lin | | | | Epoch 15 || ear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0 | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 15 || cation/SwinModel[swi | | | | Epoch 15 || n]/SwinEncoder[encod | | | | Epoch 15 || er]/ModuleList[layer | | | | Epoch 15 || s]/SwinStage[3]/Modu | | | | Epoch 15 || leList[blocks]/SwinL | | | | Epoch 15 || ayer[1]/SwinOutput[o | | | | Epoch 15 || utput]/NNCFLinear[de | | | | Epoch 15 || nse]/linear_0/bias | | | | Epoch 15 |+----------------------+----------------+----------------+---------------------+ Epoch 15 | Epoch 15 |Statistics of the movement-sparsity algorithm: Epoch 15 |+----------------------------------+-------+ Epoch 15 || Statistic's name | Value | Epoch 15 |+==================================+=======+ Epoch 15 || Mask Importance Threshold | 0 | Epoch 15 |+----------------------------------+-------+ Epoch 15 || Importance Regularization Factor | 1 | Epoch 15 |+----------------------------------+-------+ Epoch 15 | Epoch 15 |Statistics of the quantization algorithm: Epoch 15 |+--------------------------------+-------+ Epoch 15 || Statistic's name | Value | Epoch 15 |+================================+=======+ Epoch 15 || Ratio of enabled quantizations | 100 | Epoch 15 |+--------------------------------+-------+ Epoch 15 | Epoch 15 |Statistics of the quantization share: Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Statistic's name | Value | Epoch 15 |+==================================+======================+ Epoch 15 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 15 |+----------------------------------+----------------------+ Epoch 15 | Epoch 15 |Statistics of the bitwidth distribution: Epoch 15 |+--------------+---------------------+--------------------+--------------------+ Epoch 15 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 15 || | WQs | Placed AQs | Qs | Epoch 15 |+==============+=====================+====================+====================+ Epoch 15 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 15 || | 149) | 149) | 298) | Epoch 15 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 16 |+-----------------------------------------+-------+ Epoch 16 || Statistic's name | Value | Epoch 16 |+=========================================+=======+ Epoch 16 || Sparsity level of the whole model | 0.430 | Epoch 16 |+-----------------------------------------+-------+ Epoch 16 || Sparsity level of all sparsified layers | 0.445 | Epoch 16 |+-----------------------------------------+-------+ Epoch 16 | Epoch 16 |Statistics by sparsified layers: Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 16 |+======================+================+================+=====================+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[0]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[1]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[2]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[3]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[4]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[5]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[6]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[7]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[8]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[9]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[10]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[11]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[12]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[13]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[14]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[15]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[16]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[query]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[key]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfAttention[self]/NN | | | | Epoch 16 || CFLinear[value]/line | | | | Epoch 16 || ar_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinAttenti | | | | Epoch 16 || on[attention]/SwinSe | | | | Epoch 16 || lfOutput[output]/NNC | | | | Epoch 16 || FLinear[dense]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinInterme | | | | Epoch 16 || diate[intermediate]/ | | | | Epoch 16 || NNCFLinear[dense]/li | | | | Epoch 16 || near_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[2]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[17]/SwinOutput[ | | | | Epoch 16 || output]/NNCFLinear[d | | | | Epoch 16 || ense]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[0]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[query]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[key]/linear_ | | | | Epoch 16 || 0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fAttention[self]/NNC | | | | Epoch 16 || FLinear[value]/linea | | | | Epoch 16 || r_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinAttentio | | | | Epoch 16 || n[attention]/SwinSel | | | | Epoch 16 || fOutput[output]/NNCF | | | | Epoch 16 || Linear[dense]/linear | | | | Epoch 16 || _0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinIntermed | | | | Epoch 16 || iate[intermediate]/N | | | | Epoch 16 || NCFLinear[dense]/lin | | | | Epoch 16 || ear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0 | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 16 || cation/SwinModel[swi | | | | Epoch 16 || n]/SwinEncoder[encod | | | | Epoch 16 || er]/ModuleList[layer | | | | Epoch 16 || s]/SwinStage[3]/Modu | | | | Epoch 16 || leList[blocks]/SwinL | | | | Epoch 16 || ayer[1]/SwinOutput[o | | | | Epoch 16 || utput]/NNCFLinear[de | | | | Epoch 16 || nse]/linear_0/bias | | | | Epoch 16 |+----------------------+----------------+----------------+---------------------+ Epoch 16 | Epoch 16 |Statistics of the movement-sparsity algorithm: Epoch 16 |+----------------------------------+-------+ Epoch 16 || Statistic's name | Value | Epoch 16 |+==================================+=======+ Epoch 16 || Mask Importance Threshold | 0 | Epoch 16 |+----------------------------------+-------+ Epoch 16 || Importance Regularization Factor | 1 | Epoch 16 |+----------------------------------+-------+ Epoch 16 | Epoch 16 |Statistics of the quantization algorithm: Epoch 16 |+--------------------------------+-------+ Epoch 16 || Statistic's name | Value | Epoch 16 |+================================+=======+ Epoch 16 || Ratio of enabled quantizations | 100 | Epoch 16 |+--------------------------------+-------+ Epoch 16 | Epoch 16 |Statistics of the quantization share: Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Statistic's name | Value | Epoch 16 |+==================================+======================+ Epoch 16 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 16 |+----------------------------------+----------------------+ Epoch 16 | Epoch 16 |Statistics of the bitwidth distribution: Epoch 16 |+--------------+---------------------+--------------------+--------------------+ Epoch 16 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 16 || | WQs | Placed AQs | Qs | Epoch 16 |+==============+=====================+====================+====================+ Epoch 16 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 16 || | 149) | 149) | 298) | Epoch 16 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 17 |+-----------------------------------------+-------+ Epoch 17 || Statistic's name | Value | Epoch 17 |+=========================================+=======+ Epoch 17 || Sparsity level of the whole model | 0.430 | Epoch 17 |+-----------------------------------------+-------+ Epoch 17 || Sparsity level of all sparsified layers | 0.445 | Epoch 17 |+-----------------------------------------+-------+ Epoch 17 | Epoch 17 |Statistics by sparsified layers: Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 17 |+======================+================+================+=====================+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[0]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[1]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[2]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[3]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[4]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[5]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[6]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[7]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[8]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[9]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[10]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[11]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[12]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[13]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[14]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[15]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[16]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[query]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[key]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfAttention[self]/NN | | | | Epoch 17 || CFLinear[value]/line | | | | Epoch 17 || ar_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinAttenti | | | | Epoch 17 || on[attention]/SwinSe | | | | Epoch 17 || lfOutput[output]/NNC | | | | Epoch 17 || FLinear[dense]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinInterme | | | | Epoch 17 || diate[intermediate]/ | | | | Epoch 17 || NNCFLinear[dense]/li | | | | Epoch 17 || near_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[2]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[17]/SwinOutput[ | | | | Epoch 17 || output]/NNCFLinear[d | | | | Epoch 17 || ense]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[0]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[query]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[key]/linear_ | | | | Epoch 17 || 0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fAttention[self]/NNC | | | | Epoch 17 || FLinear[value]/linea | | | | Epoch 17 || r_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinAttentio | | | | Epoch 17 || n[attention]/SwinSel | | | | Epoch 17 || fOutput[output]/NNCF | | | | Epoch 17 || Linear[dense]/linear | | | | Epoch 17 || _0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinIntermed | | | | Epoch 17 || iate[intermediate]/N | | | | Epoch 17 || NCFLinear[dense]/lin | | | | Epoch 17 || ear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0 | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 17 || cation/SwinModel[swi | | | | Epoch 17 || n]/SwinEncoder[encod | | | | Epoch 17 || er]/ModuleList[layer | | | | Epoch 17 || s]/SwinStage[3]/Modu | | | | Epoch 17 || leList[blocks]/SwinL | | | | Epoch 17 || ayer[1]/SwinOutput[o | | | | Epoch 17 || utput]/NNCFLinear[de | | | | Epoch 17 || nse]/linear_0/bias | | | | Epoch 17 |+----------------------+----------------+----------------+---------------------+ Epoch 17 | Epoch 17 |Statistics of the movement-sparsity algorithm: Epoch 17 |+----------------------------------+-------+ Epoch 17 || Statistic's name | Value | Epoch 17 |+==================================+=======+ Epoch 17 || Mask Importance Threshold | 0 | Epoch 17 |+----------------------------------+-------+ Epoch 17 || Importance Regularization Factor | 1 | Epoch 17 |+----------------------------------+-------+ Epoch 17 | Epoch 17 |Statistics of the quantization algorithm: Epoch 17 |+--------------------------------+-------+ Epoch 17 || Statistic's name | Value | Epoch 17 |+================================+=======+ Epoch 17 || Ratio of enabled quantizations | 100 | Epoch 17 |+--------------------------------+-------+ Epoch 17 | Epoch 17 |Statistics of the quantization share: Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Statistic's name | Value | Epoch 17 |+==================================+======================+ Epoch 17 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 17 |+----------------------------------+----------------------+ Epoch 17 | Epoch 17 |Statistics of the bitwidth distribution: Epoch 17 |+--------------+---------------------+--------------------+--------------------+ Epoch 17 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 17 || | WQs | Placed AQs | Qs | Epoch 17 |+==============+=====================+====================+====================+ Epoch 17 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 17 || | 149) | 149) | 298) | Epoch 17 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 18 |+-----------------------------------------+-------+ Epoch 18 || Statistic's name | Value | Epoch 18 |+=========================================+=======+ Epoch 18 || Sparsity level of the whole model | 0.430 | Epoch 18 |+-----------------------------------------+-------+ Epoch 18 || Sparsity level of all sparsified layers | 0.445 | Epoch 18 |+-----------------------------------------+-------+ Epoch 18 | Epoch 18 |Statistics by sparsified layers: Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 18 |+======================+================+================+=====================+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[0]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[1]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[2]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[3]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[4]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[5]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[6]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[7]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[8]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[9]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[10]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[11]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[12]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[13]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[14]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[15]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[16]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[query]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[key]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfAttention[self]/NN | | | | Epoch 18 || CFLinear[value]/line | | | | Epoch 18 || ar_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinAttenti | | | | Epoch 18 || on[attention]/SwinSe | | | | Epoch 18 || lfOutput[output]/NNC | | | | Epoch 18 || FLinear[dense]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinInterme | | | | Epoch 18 || diate[intermediate]/ | | | | Epoch 18 || NNCFLinear[dense]/li | | | | Epoch 18 || near_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[2]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[17]/SwinOutput[ | | | | Epoch 18 || output]/NNCFLinear[d | | | | Epoch 18 || ense]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[0]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[query]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[key]/linear_ | | | | Epoch 18 || 0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fAttention[self]/NNC | | | | Epoch 18 || FLinear[value]/linea | | | | Epoch 18 || r_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinAttentio | | | | Epoch 18 || n[attention]/SwinSel | | | | Epoch 18 || fOutput[output]/NNCF | | | | Epoch 18 || Linear[dense]/linear | | | | Epoch 18 || _0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinIntermed | | | | Epoch 18 || iate[intermediate]/N | | | | Epoch 18 || NCFLinear[dense]/lin | | | | Epoch 18 || ear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0 | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 18 || cation/SwinModel[swi | | | | Epoch 18 || n]/SwinEncoder[encod | | | | Epoch 18 || er]/ModuleList[layer | | | | Epoch 18 || s]/SwinStage[3]/Modu | | | | Epoch 18 || leList[blocks]/SwinL | | | | Epoch 18 || ayer[1]/SwinOutput[o | | | | Epoch 18 || utput]/NNCFLinear[de | | | | Epoch 18 || nse]/linear_0/bias | | | | Epoch 18 |+----------------------+----------------+----------------+---------------------+ Epoch 18 | Epoch 18 |Statistics of the movement-sparsity algorithm: Epoch 18 |+----------------------------------+-------+ Epoch 18 || Statistic's name | Value | Epoch 18 |+==================================+=======+ Epoch 18 || Mask Importance Threshold | 0 | Epoch 18 |+----------------------------------+-------+ Epoch 18 || Importance Regularization Factor | 1 | Epoch 18 |+----------------------------------+-------+ Epoch 18 | Epoch 18 |Statistics of the quantization algorithm: Epoch 18 |+--------------------------------+-------+ Epoch 18 || Statistic's name | Value | Epoch 18 |+================================+=======+ Epoch 18 || Ratio of enabled quantizations | 100 | Epoch 18 |+--------------------------------+-------+ Epoch 18 | Epoch 18 |Statistics of the quantization share: Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Statistic's name | Value | Epoch 18 |+==================================+======================+ Epoch 18 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 18 |+----------------------------------+----------------------+ Epoch 18 | Epoch 18 |Statistics of the bitwidth distribution: Epoch 18 |+--------------+---------------------+--------------------+--------------------+ Epoch 18 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 18 || | WQs | Placed AQs | Qs | Epoch 18 |+==============+=====================+====================+====================+ Epoch 18 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 18 || | 149) | 149) | 298) | Epoch 18 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 19 |+-----------------------------------------+-------+ Epoch 19 || Statistic's name | Value | Epoch 19 |+=========================================+=======+ Epoch 19 || Sparsity level of the whole model | 0.430 | Epoch 19 |+-----------------------------------------+-------+ Epoch 19 || Sparsity level of all sparsified layers | 0.445 | Epoch 19 |+-----------------------------------------+-------+ Epoch 19 | Epoch 19 |Statistics by sparsified layers: Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 19 |+======================+================+================+=====================+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 128] | 0.412 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 512] | 0.412 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 128] | 0.191 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.191 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128, 512] | 0.191 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[0]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 256] | 0.230 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0.230 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 1024] | 0.230 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0.500 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 256] | 0.500 | 0.078 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 256] | 0.216 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0.216 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256, 1024] | 0.216 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[1]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.432 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.432 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.432 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.387 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.387 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.387 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[2]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.437 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.437 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.437 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[3]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.436 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.436 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[4]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.938 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.405 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.405 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.405 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[5]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.404 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.404 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.404 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[6]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[7]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.389 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.389 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.389 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[8]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.386 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.386 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[9]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.395 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.395 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.395 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[10]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.408 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.408 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.408 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[11]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.413 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.413 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.413 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[12]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.421 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.421 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.421 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[13]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.508 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.508 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.508 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[14]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.562 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.562 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.562 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[15]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.610 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.610 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.610 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[16]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[query]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[key]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfAttention[self]/NN | | | | Epoch 19 || CFLinear[value]/line | | | | Epoch 19 || ar_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinAttenti | | | | Epoch 19 || on[attention]/SwinSe | | | | Epoch 19 || lfOutput[output]/NNC | | | | Epoch 19 || FLinear[dense]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048, 512] | 0.574 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [2048] | 0.574 | 0.002 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinInterme | | | | Epoch 19 || diate[intermediate]/ | | | | Epoch 19 || NNCFLinear[dense]/li | | | | Epoch 19 || near_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512, 2048] | 0.574 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[2]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[17]/SwinOutput[ | | | | Epoch 19 || output]/NNCFLinear[d | | | | Epoch 19 || ense]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [4096, 1024] | 0.569 | 5.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [4096] | 0.569 | 0.005 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 4096] | 0.569 | 5.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[0]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[query]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[key]/linear_ | | | | Epoch 19 || 0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fAttention[self]/NNC | | | | Epoch 19 || FLinear[value]/linea | | | | Epoch 19 || r_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinAttentio | | | | Epoch 19 || n[attention]/SwinSel | | | | Epoch 19 || fOutput[output]/NNCF | | | | Epoch 19 || Linear[dense]/linear | | | | Epoch 19 || _0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [4096, 1024] | 0.498 | 5.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [4096] | 0.498 | 0.005 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinIntermed | | | | Epoch 19 || iate[intermediate]/N | | | | Epoch 19 || NCFLinear[dense]/lin | | | | Epoch 19 || ear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024, 4096] | 0.498 | 5.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0 | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 19 || cation/SwinModel[swi | | | | Epoch 19 || n]/SwinEncoder[encod | | | | Epoch 19 || er]/ModuleList[layer | | | | Epoch 19 || s]/SwinStage[3]/Modu | | | | Epoch 19 || leList[blocks]/SwinL | | | | Epoch 19 || ayer[1]/SwinOutput[o | | | | Epoch 19 || utput]/NNCFLinear[de | | | | Epoch 19 || nse]/linear_0/bias | | | | Epoch 19 |+----------------------+----------------+----------------+---------------------+ Epoch 19 | Epoch 19 |Statistics of the movement-sparsity algorithm: Epoch 19 |+----------------------------------+-------+ Epoch 19 || Statistic's name | Value | Epoch 19 |+==================================+=======+ Epoch 19 || Mask Importance Threshold | 0 | Epoch 19 |+----------------------------------+-------+ Epoch 19 || Importance Regularization Factor | 1 | Epoch 19 |+----------------------------------+-------+ Epoch 19 | Epoch 19 |Statistics of the quantization algorithm: Epoch 19 |+--------------------------------+-------+ Epoch 19 || Statistic's name | Value | Epoch 19 |+================================+=======+ Epoch 19 || Ratio of enabled quantizations | 100 | Epoch 19 |+--------------------------------+-------+ Epoch 19 | Epoch 19 |Statistics of the quantization share: Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Statistic's name | Value | Epoch 19 |+==================================+======================+ Epoch 19 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 19 |+----------------------------------+----------------------+ Epoch 19 | Epoch 19 |Statistics of the bitwidth distribution: Epoch 19 |+--------------+---------------------+--------------------+--------------------+ Epoch 19 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 19 || | WQs | Placed AQs | Qs | Epoch 19 |+==============+=====================+====================+====================+ Epoch 19 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 19 || | 149) | 149) | 298) | Epoch 19 |+--------------+---------------------+--------------------+--------------------+