Crawler is now able to optionally crawl single or multiple pages. CompleteSpider is now functional.