Before revision:  We show that this approach scales surprisingly well with model size and outperforms models that explicitly look up knowledge on the open-domain variants of Natural Questions and WebQuestions .
After revision:  We show that this approach scales surprisingly well with model size and outperforms models that explicitly look up knowledge on the open-domain systems that explicitly retrieve answers from an external knowledge source when answering questions .