Remove pointer events from glove