Avoid having the permissions twice in memory