Fixing a bug that caused the crawl to stop if no sitemap was found,
and/or no urls were in the sitemap. Also added exception raising to be
a bit more specific rather than a StandardError