Fixed several bugs related to AllReduce and Iterations.

Fixed #450 and other bugs that occurred in conjunction with the large test job.