Allow ~ to mean "not this permission"