Remove permissions again