[RFC] Only run a subset of testcases in separated processes

This is quite a crude implementation that works, so RFC.