Reject errors with the whole response object, not just the error message