[46] Bo Li, Yifei Shen, Yezhen Wang, Wenzhen Zhu, Dongsheng Li, Kurt Keutzer, and Han Zhao. "Invariant information bottleneck for domain generalization." AAAI Conference on Artificial Intelligence. 2022.
[47] Ming Li and Paul Vitányi. An Introduction to Kolmogorov Complexity and Its Applications. 4th edition. Springer, 2019.
[48] Dianbo Liu, Alex M Lamb, Kenji Kawaguchi, Anirudh Goyal, Chen Sun, Michael Curtis Mozer, and Yoshua Bengio. "Discrete-valued neural communication." NeurIPS. 2021.
[49] Ilya Loshchilov and Frank Hutter. "Decoupled Weight Decay Regularization." *ICLR*. 2019.
[50] Yuchen Lu, Soumye Singhal, Florian Strub, Aaron Courville, and Olivier Pietquin. "Countering language drift with seeded iterated learning." ICML. 2020.
[51] Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. Self-refine: Iterative refinement with self-feedback. 2023. arXiv: 2303.17651.
[52] Loic Matthey, Irina Higgins, Demis Hassabis, and Alexander Lerchner. dSprites: Disentanglement testing Sprites dataset. 2017. URL: https://github.com/deepmind/dSprites-dataset/.
[53] Hossein Mobahi, Mehrdad Farajtabar, and Peter Bartlett. "Self-distillation amplifies regularization in Hilbert space." NeurIPS. Volume 33. 2020, pages 3351-3361.
[54] Evgenii Nikishin, Max Schwarzer, Pierluca D'Oro, Pierre-Luc Bacon, and Aaron Courville. "The primacy bias in deep reinforcement learning." ICML. 2022.
[55] Judea Pearl and Dana Mackenzie. The Book of Why: The New Science of Cause and Effect. Basic Books, 2018.
[56] Aahlad Puli, Nitish Joshi, He He, and Rajesh Ranganath. "Nuisances via Negativa: Adjusting for Spurious Correlations via Data Augmentation" (2022). arXiv: 2210.01302.
[57] Jack Rae. Compression for AGI. Stanford MLSys Seminar. 2023. URL: https://www.youtube.com/watch?v=d04TPJkeaaU.
[58] Sai Rajeswar, Pau Rodriguez, Soumye Singhal, David Vazquez, and Aaron Courville. "Multi-label iterated learning for image classification with label ambiguity." CVPR. 2022.
[59] Ladislav Rampášek, Mikhail Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu, Guy Wolf, and Dominique Beaini. “Recipe for a General, Powerful, Scalable Graph Transformer.” NeurIPS. 2022.
[60] Yi Ren, Shangmin Guo, Matthieu Labeau, Shay B. Cohen, and Simon Kirby. "Compositional languages emerge in a neural iterated learning model." ICLR. 2020.
[61] Yi Ren, Shangmin Guo, and Danica J. Sutherland. "Better Supervisory Signals by Observing Learning Paths." *ICLR*. 2022.
[62] Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. "ImageNet Large Scale Visual Recognition Challenge." IJCV 115.3 (2015), pages 211-252.
[63] Sandro Salsa. Partial differential equations in action: from modeling to theory. Volume 99. Springer, 2016.
[64] Bernhard Schölkopf and Alexander J Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, 2002.
[65] Lukas Schott, Julius Von Kugelgen, Frederik Träuble, Peter Vincent Gehler, Chris Russell, Matthias Bethge, Bernhard Schölkopf, Francesco Locatello, and Wieland Brendel. "Visual Representation Learning Does Not Generalize Strongly Within the Same Domain." *ICLR*. 2022.
[66] Dino Sejdinovic, Bharath Striperumbudur, Arthur Gretton, and Kenji Fukumizu. "Equivalence of distance-based and RKHS-based statistics in hypothesis testing." The Annals of Statistics 41.5 (2013), pages 2263-2291.
[67] Yuge Shi, Imant Daunhawer, Julia E Vogt, Philip HS Torr, and Amartya Sanyal. "How robust are pre-trained models to distribution shift?" (2022). arXiv: 2206.08871.
[68] Rui Shu, Yining Chen, Abhishek Kumar, Stefano Ermon, and Ben Poole. "Weakly Supervised Disentanglement with Guarantees." ICLR. 2020.
[69] Ravid Shwartz-Ziv and Naftali Tishby. “Opening the black box of deep neural networks via information” (2017). arXiv: 1703.00810.