Remove UserAuthorizer record