Only calculate distances to the correct number of centroids when using prespecified mus.