A better description of what is going on is that at the very pole, as the user drags left or right, the azimuthal angle continues to be updated, but does not affect the view because the camera position is the only thing being changed. If you repeat the experiment that I described but then drag downward at the end, the view discontinuously jumps in azimuth.