Abstraction over the various ways to clobber test frameworks autorun capabilities