A hyperparameter is a parameter set before the learning process begins and controls the model's behavior, such as the learning rate in neural networks or the number of trees in a random forest. Unlike model parameters, hyperparameters are not learned from the data.