If either mean_mode or variance_mode is set, clearing sort_type = NULL; shall save wastefully computing the max and min that we aren't going to use.