We show that gradient descent converges to a local minimizer, almost surely with random initialization. This is proved by applying the Stable Manifold Theorem from dynamical systems theory.
Lee et al. REF showed that GD converges to a local minimizer almost surely if the initial point is randomly chosen.
Gradient Descent Converges to Minimizers
ArXiv
ArXiv
Mathematics Computer Science