Prevent flickering of map controls on quick swipes