runs on entire corpus now