Crawling should not break for exceptions