[polyfocalAxis] Fixes jumping when dragging begins