Neural networks struggle with extrapolation, which is the ability to generalize beyond the range of training data. This limitation hinders their ability to perform complex mathematical operations effectively.