Output directory initialized only once by calling TestResultHandler.initializeTestOutputDirectory
Ability to use numbered output directory - can keep multiple results.

This can be enabled by TestResultHandler.TEST_OUTPUT_NUMBERED=true