Add removal of Puppet config