Created the spider for crawling the web.