Before revision:  We show that our approach improves over baseline language models, gaining 5\% on the i.i.d. split and 9\% on an out-of-distribution test split .
After revision:  We show that our approach improves over baseline language models, gaining 5\% , and by 11\% in a zero prior knowledge training setting .