Before revision:  This has been widely demonstrated for English using contextualized word representations such as OpenAI GPT (Radford et al., 2018 ), BERT ( Devlin et al., 2019 ), or XLNet ( Yang et al., 2019b).
After revision:  This has been widely demonstrated for English using contextualized representations (Dai and Le, 2015; Peters et al., 2018 ), BERT ( Devlin et al., 2019 ), or XLNet ( Yang et al., 2019b).