[17] C. Finlay, J.-H. Jacobsen, L. Nurbekyan, and A. Oberman. How to Train Your Neural ODE: The World of Jacobian and Kinetic Regularization. In Proceedings of the 37th International Conference on Machine Learning, volume 37, pages 3154-3164. PMLR, 2020.
[18] M. Finzi, K. A. Wang, and A. G. Wilson. Simplifying Hamiltonian and Lagrangian Neural Networks via Explicit Constraints. In H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 13880-13889. Curran Associates, Inc., 2020.
[19] B. Ghorbani, S. Krishnan, and Y. Xiao. An Investigation into Neural Net Optimization via Hessian Eigenvalue Density. In Proceedings of the 36th International Conference on Machine Learning, pages 2232-2241. PMLR, 2019.
[20] A. Ghosh, H. Behl, E. Dupont, P. Torr, and V. Namboodiri. STEER: Simple Temporal Regularization For Neural ODE. In Advances in Neural Information Processing Systems, volume 33, pages 14831-14843. Curran Associates, Inc., 2020.
[21] P. J. Green, B. W. Silverman, P. J. Green, and B. W. Silverman. Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach. Number 58 in Monographs on Statistics and Applied Probability. Chapman & Hall /CRC, Boca Raton, Fla., 2000.
[22] S. Greydanus, M. Dzamba, and J. Yosinski. Hamiltonian Neural Networks. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019.
[23] N. Gruver, M. A. Finzi, S. D. Stanton, and A. G. Wilson. Deconstructing the Inductive Biases of Hamiltonian Neural Networks. In International Conference on Learning Representations, volume 9, 2021.
[24] C. Gulcehre, M. Moczulski, F. Visin, and Y. Bengio. Mollifying Networks. In International Conference on Learning Representations, volume 5, 2017.
[25] R. Hasani, M. Lechner, A. Amini, D. Rus, and R. Grosu. Liquid Time-constant Networks. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 7657–7666, 2021.
[26] J.-H. He. Homotopy perturbation technique. Computer Methods in Applied Mechanics and Engineering, 178(3-4):257-262, 1999.
[27] H. Iwakiri, Y. Wang, S. Ito, and A. Takeda. Single Loop Gaussian Homotopy Method for Non-convex Optimization. Advances in Neural Information Processing Systems, 35:7065-7076, 2022.
[28] G. A. Johnson, D. J. Mar, T. L. Carroll, and L. M. Pecora. Synchronization and imposed bifurcations in the presence of large parameter mismatch. Physical Review Letters, 80(18):3956-3959, 1998.
[29] S. Kanai, Y. Fujiwara, and S. Iwamura. Preventing Gradient Explosions in Gated Recurrent Units. In Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017.
[30] P. Kidger, R. T. Q. Chen, and T. J. Lyons. "Hey, that's not an ODE": Faster ODE Adjoints via Seminorms. In Proceedings of the 38th International Conference on Machine Learning, pages 5443-5452. PMLR, 2021.
[31] S. Kim, W. Ji, S. Deng, Y. Ma, and C. Rackauckas. Stiff neural ordinary differential equations. Chaos: An Interdisciplinary Journal of Nonlinear Science, 31(9):093122, 2021.
[32] A. Krishnapriyan, A. Gholami, S. Zhe, R. Kirby, and M. W. Mahoney. Characterizing possible failure modes in physics-informed neural networks. In Advances in Neural Information Processing Systems, volume 34, pages 26548-26560. Curran Associates, Inc., 2021.
[33] P. J. M. Laarhoven and E. H. L. Aarts. Simulated Annealing: Theory and Applications. Springer Netherlands, Dordrecht, 1987.