The first provision of a new 5.4 installation fails

We need to run `vagrant provision --provision-with puppet` again to make it work :cry: