Ensure puppet directory files exist