Guess-What-Moves / configs /maskformer /swin /maskformer_swin_small_bs16_160k.yaml
subhc's picture
Code Commit
5e88f62
raw
history blame contribute delete
No virus
566 Bytes
_BASE_: ../maskformer_R50_bs16_160k.yaml
MODEL:
BACKBONE:
NAME: "D2SwinTransformer"
SWIN:
EMBED_DIM: 96
DEPTHS: [2, 2, 18, 2]
NUM_HEADS: [3, 6, 12, 24]
WINDOW_SIZE: 7
APE: False
DROP_PATH_RATE: 0.3
PATCH_NORM: True
WEIGHTS: "pretrained_weights/swin_small_patch4_window7_224.pkl"
PIXEL_MEAN: [123.675, 116.280, 103.530]
PIXEL_STD: [58.395, 57.120, 57.375]
SOLVER:
BASE_LR: 0.00006
WARMUP_FACTOR: 1e-6
WARMUP_ITERS: 1500
WEIGHT_DECAY: 0.01
WEIGHT_DECAY_NORM: 0.0
WEIGHT_DECAY_EMBED: 0.0
BACKBONE_MULTIPLIER: 1.0