Delayed puppet provisioning