Is it worth noting things like that Grid Search will evaluate these parameters when training on 2/3 (by default) of the training data, but then learns a model over all the data with the best parameters?