only change hand state if for mouse press if it is your hand