Make sure to set permissions recursively only when requested so