Added much more efficient data retrieval.
Added functionality for crawling multiple websites at once.