Update parallel execution implementation and related test case.