Externalize test file lookup

Runner should be respoonsible of orchestration only.