Before revision:  Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining .
After revision:  Second, an enhanced mask decoder is used to incorporate absolute positions in the decoding layer to predict the masked tokens for model pretraining .