Crawler which crawls the site and gets the data.