test: Create new build on restart

Signed-off-by: Lewis Marshall <lewis@lmars.net>
Merge pull request #530 from flynn/test-runner-restart

test: Create new build on restart