Only try to hide menus and selector once per drag operation