Synchronize iteration start.
Hoist the loops.
Autoadjust stride size.
Detect lagging workers from all the workers. More gradual adjust.