Before revision:  We show that this approach scales surprisingly well with model size and outperforms models that explicitly look up knowledge on the open-domain variants of Natural Questions and WebQuestions .
After revision:  We show that this approach scales surprisingly well with model size and performs competitively with open-domain variants of Natural Questions and WebQuestions .