Fix config files to not be overwritten on package install