Set preserve attribute on config files