In the context of machine learning, a Gradient is a vector that points in the direction of the greatest rate of increase of a function. It is used in gradient-based optimization algorithms like gradient descent, which adjust the parameters of a model in order to minimize a loss function.