crawler error handling
doc