Added distributed gradient accumulation.