Make tmp paths in TestRunner dynamic based on pid

Fixes #4723