Use regex for filtering urls

Allow the CrawlController to pass regex to crawler object for deciding
which page to be visited.  Now you can do
controller.setShouldVisitRegex("your regex") which will pass the regex
to all crawler objects created by CrawlController.