Before revision: Inductive transfer learning , enabled by self-supervised learning, have taken the entire Natural Language Processing (NLP ) field by storm, with models such as BERT and BART setting new state of the art on countless natural language understanding tasks. While there are some notable exceptions , most of the available models and research have been conducted for the Englishlanguage .
After revision: Inductive transfer learning , enabled by self-supervised learning, have taken the entire Natural Language Processing (NLP ) field by storm, with models such as BERT and BART setting new state of the art on countless NLU tasks. However , most of the available models and research have been conducted for the Englishlanguage .