Fix issue to deal with mouse button up/down.