Remove pointer-events for area being drawn