Perform setups and teardowns blocking on each other. To avoid interfering.

I suspect that might be the cause of a lot of our rotate-lots-of-times-quickly gotchas...