crawler error handling