[59] S. P. Singh, G. Bachmann, and T. Hofmann. Analytic insights into structure and rank of neural network Hessian maps. In Advances in Neural Information Processing Systems, volume 34, 2021.
[60] S. Singla and S. Feizi. Skew orthogonal convolutions. In International Conference on Machine Learning, pages 9756-9766. PMLR, 2021.
[61] S. Singla, S. Singla, and S. Feizi. Improved deterministic 12 robustness on CIFar-10 and CIFar-100. In International Conference on Learning Representations, 2021.
[62] C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus. Intriguing properties of neural networks. In International Conference on Learning Representations (ICLR), 2014.
[63] D. Terjek. Adversarial lipschitz regularization. In International Conference on Learning Representations, 2020.
[64] L. N. Trefethen and D. Bau. Numerical Linear Algebra. SIAM, 1997.
[65] A. Trockman and J. Z. Kolter. Orthogonalizing convolutional layers with the cayley transform. In International Conference on Learning Representations, 2021.
[66] T. Tsiligkaridis and J. Roberts. On frank-wolfe adversarial training. In ICML 2021 Workshop on Adversarial Machine Learning, 2021.
[67] D. Tsipras, S. Santurkar, L. Engstrom, A. Turner, and A. Madry. Robustness may be at odds with accuracy. In International Conference on Learning Representations, 2018.
[68] Y. Tsuzuki, I. Sato, and M. Sugiyama. Lipschitz-margin training: Scalable certification of perturbation invariance for deep neural networks. Advances in neural information processing systems, 31, 2018.
[69] M. Udell and A. Townsend. Why are big data matrices approximately low rank? SIAM Journal on Mathematics of Data Science, 1(1):144-160, 2019.
[70] A. Uschmajew and B. Vandereycken. Geometric methods on low-rank matrix and tensor manifolds. Handbook of variational methods for nonlinear geometric data, pages 261-313, 2020.
[71] H. Wang, S. Agarwal, and D. Papailiopoulos. Pufferfish: communication-efficient models at no extra cost. Proceedings of Machine Learning and Systems, 3:365-386, 2021.
[72] X. Wei, Y. Xu, Y. Huang, H. Lv, H. Lan, M. Chen, and X. Tang. Learning extremely lightweight and robust model with differentiable constraints on sparsity and condition number. In European Conference on Computer Vision, pages 690-707. Springer, 2022.
[73] Y.-L. Wu, H.-H. Shuai, Z.-R. Tam, and H.-Y. Chiu. Gradient normalization for generative adversarial networks. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 6373-6382, 2021.
[74] L. Xiao, Y. Bahri, J. Sohl-Dickstein, S. Schoenholz, and J. Pennington. Dynamical isometry and a mean field theory of CNNs: How to train 10,000-layer vanilla convolutional neural networks. In International Conference on Machine Learning, pages 5393-5402. PMLR, 2018.
[75] H. Yang, M. Tang, W. Wen, F. Yan, D. Hu, A. Li, H. Li, and Y. Chen. Learning low-rank deep neural networks via singular vector orthogonality regularization and singular value sparsification. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 2899-2908, 2020.
[76] S. Ye, K. Xu, S. Liu, H. Cheng, J.-H. Lambrechts, H. Zhang, A. Zhou, K. Ma, Y. Wang, and X. Lin. Adversarial robustness vs. model compression, or both? In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019.
[77] T. Yu, J. Li, Y. Cai, and P. Li. Constructing orthogonal convolutions in an explicit manner. In International Conference on Learning Representations, 2022.