Before revision:  In this work, we improve the original Pyramid Vision Transformer (PVTv1) by adding three improvement designs, which include (1) locally continuous features with convolutions , (2) position encodings with zero paddings , and (3) linear complexity attention layers with average pooling .
After revision:  In this work, we improve the original Pyramid Vision Transformer (PVTv1) by adding three improvement designs, which include (1) overlapping patch embedding , (2) position encodings with zero paddings , and (3) linear complexity attention layers with average pooling .