Parallel weight gradients.
Fix parallel forward pass in compressed layer.