Fix: can add and remove permissions on different panels