handle crwling errors