All HMM gaussians should be done