Rewrite the sentence more clearly: Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens in model pre-training.
Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining.