Will now crawl a website and discover all of the internal links and their query parameters.