Makes sense. Unfortunately test-kitchen isn't really up to the task here. Would be nice to extract bin/supermarket into a gem that works with test-kitchen and lets you do all the stuff those scripts do.

The advantage of test-kitchen over vagrant for something like this is that you can use ec2, docker, or any of the drivers on https://github.com/test-kitchen instead of vagrant/vbox. What I want is https://github.com/phinze/freighthop, but using chef/tk instead of puppet :)

This is good for now, though, and actually if you compare it to the vagrant setup that something like discourse has, it's very nice.