An activation function's primary goal is to apply a nonlinear function to the input such that the input does not map directly to the output