Test runner updates

This isn't entirely accurate, is it? I could run against a running cluster without KVM, right?