Before revision:  This paper considers the following questions: (1) Why should learning the distribution of natural language help with downstream classificationtasks ? (2) Why do features learned using language modelinghelp solve downstream tasks with linear classifiers ?
After revision:  This paper considers the following questions: (1) Why should learning the distribution of natural language help with downstream classificationtasks ? (2) How can we mathematically formalize this connection and quantify the benefit of language modeling ?