restore error handling on crawler.