Before revision:  Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining .
After revision:  Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens in model pre-training .