Handle the case where the pointer moved out then up over a toggle button, so it will respond to the next press