Merge means that are close in upsampled, realigned space
Full covariance estimation when clustering