To fix high variance, you first need to identify it. When a model is high in variance, it tends to perform extremely well on the training dataset but does not hold its own when a testing or cross-validation dataset is used. So, if the training accuracy is high and the test accuracy is low, you can say that the model has high variance.