Fix panning when looking up at terrain.