Don't send mouse-up events if modifier keys are pressed