add more synchronization points to prepare for model / data mix parallelism