Remove focus from toggle item if clicked with the mouse