fix bad url cb err and add check for bad scrape