Before revision:  To improve the recall of facts stated in the trainingtext , we combine BERT (Devlin et al., 2019) with a  kNN search over a large corpus .
After revision:  To improve the recall of facts encountered during training , we combine BERT (Devlin et al., 2019) with a kNN search over a large corpus .