Before revision:  Our most successful model is an ensemble of transformers  including RoBERTa, XLNet, and BERTweet trained in a semi-supervised experimental setting.
After revision:  Our most successful model is an ensemble of transformers including RoBERTa, XLNet, and BERTweet trained in a Semi-Supervised Learning (SSL) setting.