Before revision:  In this work, we improve the original Pyramid Vision Transformer (  PVTv1) by adding three improvement designs, which include (1) overlapping patch embedding, (2) convolutional feed-forward networks, and (3) linear complexity attention layers.
After revision:  In this work, we present new baselines by improving the original Pyramid Vision Transformer ( PVTv1) by adding three improvement designs, which include (1) overlapping patch embedding, (2) convolutional feed-forward networks, and (3) linear complexity attention layers.