modified error handling for scrapers