Don't clobber config when reconfiguring