Before revision:  Nonetheless, the current pre-training methods mostly rely on a language modeling pre-training task and often show limited performances.
After revision:  Nonetheless, the current pre-training methods mostly rely on a language modeling task and often show limited performances.