Crawler doesn't crawl URLs that don't match the root URL provided