Adjust modifiers by the offest used in MultiPointHandler.AdjustModifierPointToCenter.