failures in db in production detected