Create /etc/foreman directory for /etc/foreman/puppet.yaml