Delay initiating layout operations for as long as possible.

The mutex is good enough, and I think `join_layout` is racey anyhow.