Use local position for pointer offset