Before revision: In machine learning, a neural scaling law is a scaling law relating parameters of a family of neural networks an empirical scaling law that describes how neural network performance changes as key factors are scaled up or down.
After revision: In machine learning, a neural scaling law is an empirical scaling law that describes how neural network performance changes as key factors are scaled up or down.