Before revision:  Our most successful model is an ensemble of transformers  including RoBERTa, XLNet, and BERTweet trained in a semi-supervised experimental setting.
After revision:  Our most successful model is an ensemble of transformers , including RoBERTa, XLNet, and BERTweet trained in a semi-supervised experimental setting.