ERT-755: Split collecting and running of tests.