Log failures and improve response handling in OAG scraper.