Shahar Azulay, Edward Moroshko, Mor Shpigel Nacson, Blake E. Woodworth, Nathan Srebro, Amir Globerson, and Daniel Soudry. On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent. In ICML, pages 468-477, 2021. 2
Mikhail Belkin, Daniel Hsu, Siyuan Ma, and Soumik Mandal. Reconciling modern machine-learning practice and the classical bias-variance trade-off. Proc. Natl. Acad. Sci., 116(32):15849-15854, 2019. 1
Jérôme Bolte, Aris Daniilidis, Olivier Ley, and Laurent Mazet. Characterizations of Łojasiewicz inequalities: subgradient flows, talweg, convexity. Trans. Amer. Math. Soc., 362(6):3319-3363, 2010. 5
Etienne Boursier and Nicolas Flammarion. Penalising the biases in norm regularisation enforces sparsity. CoRR, abs/2303.01353, 2023. Accepted to NeurIPS 2023.
Etienne Boursier, Loucas Pillaud-Vivien, and Nicolas Flammarion. Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs. In NeurIPS, 2022. 2, 3, 4, 5, 6, 9, 10
Frank H. Clarke. Generalized gradients and applications. Trans. Amer. Math. Soc., 205:247-262, 1975. 4
Damek Davis, Dmitriy Drusvyatskiy, Sham M. Kakade, and Jason D. Lee. Stochastic Subgradient Method Converges on Tame Functions. Found. Comput. Math., 20(1):119-154, 2020.
Simon S. Du, Wei Hu, and Jason D. Lee. Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced. In NeurIPS, pages 382-393, 2018. 4
Matthias Englert and Ranko Lazic. Adversarial Reprogramming Revisited. In NeurIPS, 2022.
Tolga Ergen and Mert Pilanci. Convex Geometry and Duality of Over-parameterized Neural Networks. J. Mach. Learn. Res., 22(212):1-63, 2021.
Mathieu Even, Scott Pesme, Suriya Gunasekar, and Nicolas Flammarion. (S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability. CoRR, abs/2302.08982, 2023. Accepted to NeurIPS 2023.
Miroslav Fiedler and Vlastimil Pták. On matrices with non-positive off-diagonal elements and positive principal minors. *Czechoslovak Mathematical Journal*, 12(3):382-400, 1962. 9
Spencer Frei, Yuan Cao, and Quanquan Gu. Agnostic Learning of a Single Neuron with Gradient Descent. In NeurIPS, 2020.
Spencer Frei, Gal Vardi, Peter L. Bartlett, and Nathan Srebro. Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization. In COLT, pages 3173-3228, 2023a.
Spencer Frei, Gal Vardi, Peter L. Bartlett, and Nathan Srebro. The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks. CoRR, abs/2303.01456, 2023b. Accepted to NeurIPS 2023.
Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro, and Wei Hu. Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data. In ICLR, 2023c.
Suriya Gunasekar, Blake E. Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, and Nati Srebro. Implicit Regularization in Matrix Factorization. In NeurIPS, pages 6151-6159, 2017. 2
Niv Haim, Gal Vardi, Gilad Yehudai, Ohad Shamir, and Michal Irani. Reconstructing Training Data From Trained Neural Networks. In NeurIPS, 2022. 2
Arthur Jacot, François Ged, Berfin Şimşek, Clément Hongler, and Franck Gabriel. Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity. CoRR, abs/2106.15933, 2021. 2