Regularization causes a significant reduction in the variance of the model, without a large increase in its bias.