Artifact folders need to exist before test suites are run