Ability to run testsuite with 3rdparty testrunners

This is a minimal set of modifications necessary for py.test to correctly
collect all tests and skip the ones with missing dependencies.