The test machine needs to have Java installed as well.

The kitchen test failed out of the box for me since the launched test machine lacked Java.
I just added the Java recipe to the run list.