Before revision:  The derivation  also indicates that such a deep convolution network is significantly more efficient to construct and learn in the spectral domain.
After revision:  The derivation in the invariant setting suggests a trade-off between sparsity and invariance, and also indicates that such a deep convolution network is significantly more efficient to construct and learn in the spectral domain.