Add modifier state to mouse events.