Simplify set_user_votes safety-check