Don't fake a mouse move and unselect buttons with that on screen change