scraper error handling improvements