adds a check to make sure that all links look like real article titles
turns off profiling and makes the crawl unlimited instead of the first 10k pages