If mouse is disabled, don't respond to pointer events gernated by mouse