Actually, this brings up another issue. Shouldn't all randomized tests always use the same RNG seed? If we don't, this opens up the door to tests failing/succeeding nondeterministically (definitely a headache for me in reproducing the bug).

Although I can also imagine that always using the same seed might cause other bugs to go undiscovered. Unit testing of smaller chunks of planner code is probably the answer here, I think.