Fix bug on remove admin where queue owners can see the button

In old version queue owners could click the red cross button (but nothing happened).