able to crawl all URLS