actually get the corpus information in the background