Support running a suite of tests concurrently

ping @titanous