Make subunit-output executable.
Fix tests with testtools 1.2.0 and above.

Import errors don't break execution or listing now in testtools, so to
test execution breaking we have to be a little bit more direct.