Before revision:  Our BERTweet is trained using the RoBERTa pre-training procedure (Liu et al., 2019), with the same model configuration as BERT-base (Devlin et al., 2019).
After revision:  Our BERTweet is trained using the RoBERTa pre-training procedure (Liu et al., 2019), is trained using the RoBERTa pre-training procedure (Liu et al., 2019).