[SiteIcon] Don't flicker when opening site info popup

Make sure the Down state doesn't change between clicking on icon
and opening popup.

[ci skip]