Turns out that it was Windows getting in the way that led to the
undesirable panning direction, not our logic. Reverted.