Crawler can now crawl multiple websites successfully.