Before revision:  We also propose a simple but effective model called MacBERT, which improves upon RoBERTa in several ways, especially the masking strategy  .
After revision:  We also propose a simple but effective model called MacBERT, which improves upon RoBERTa in several ways, especially the masking strategy that adopts MLM as correction (Mac) .