Simplify fallback check to only honor 404 response codes.