The bias-variance trade-off refers to the trade-off between model complexity (variance) and model bias, where a complex model may fit the data well but have high variance, while a simpler model may have low variance but high bias.