Before revision:  We show that this approach scales surprisingly well with model size and outperforms models that explicitly look up knowledge on the open-domain variants of Natural Questions and WebQuestions .
After revision:  We show that this approach scales with model size and outperforms models that explicitly look up knowledge on the open-domain variants of Natural Questions and WebQuestions .