Always break out of visual mode in s:set_visual_marks()