update scraper to handle crashes