Crawler now crawls and stores a website.