Crawler can now crawl complete pages and store data.