Working Regularization in DDP

Based on Tom Erez's thesis.