Bug fixes; Was able to crawl from time.com up until yahoo.com\!\!\!