[79] L. F. R. Ribeiro, M. Schmitt, H. Schütze, and I. Gurevych. Investigating pretrained language models for graph-to-text generation. arXiv, 2020. (Cited on 22)
[80] D. W. Romero and S. Lohit. Learning partial equivariances from data. In NeurIPS, 2022. (Cited on 22)
[81] C. Rommel, T. Moreau, and A. Gramfort. Deep invariant networks with differentiable augmentation layers. In NeurIPS, 2022. (Cited on 22)
[82] D. Rothermel, M. Li, T. Rocktäschel, and J. Foerster. Don't sweep your learning rate under the rug: A closer look at cross-modal transfer of pretrained transformers. arXiv, 2021. (Cited on 22)
[83] A. Sannai, M. Kawano, and W. Kumagai. Equivariant and invariant reynolds networks. arXiv, 2021. (Cited on 2)
[84] V. G. Satorras, E. Hoogeboom, and M. Welling. E(n) equivariant graph neural networks. In ICML, 2021. (Cited on 8, 22, 23)
[85] J. Shen, L. Li, L. M. Dery, C. Staten, M. Khodak, G. Neubig, and A. Talwalkar. Cross-modal fine-tuning: Align then refine. arXiv, 2023. (Cited on 5, 22)
[86] W. Shi, J. Caballero, F. Huszar, J. Totz, A. P. Aitken, R. Bishop, D. Rueckert, and Z. Wang. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In CVPR, 2016. (Cited on 5)
[87] H. Shirzad, A. Velingker, B. Venkatachalam, D. J. Sutherland, and A. K. Sinop. Exphormer: Sparse transformers for graphs. arXiv, 2023. (Cited on 10)
[88] B. Srinivasan and B. Ribeiro. On the equivalence between positional node embeddings and structural graph representations. In ICLR, 2020. (Cited on 22, 31)
[89] A. Steiner, A. Kolesnikov, X. Zhai, R. Wightman, J. Uszkoreit, and L. Beyer. How to train your vit? data, augmentation, and regularization in vision transformers. arXiv, 2021. (Cited on 2, 9)
[90] E. H. Thiede, W. Zhou, and R. Kondor. Autobahn: Automorphism-based graph neural nets. In NeurIPS, 2021. (Cited on 30)
[91] N. Thomas, T. E. Smidt, S. Kearnes, L. Yang, L. Li, K. Kohlhoff, and P. Riley. Tensor field networks: Rotation- and translation-equivariant neural networks for 3d point clouds. arXiv, 2018. (Cited on 1, 8, 22)
[92] J. Topping, F. D. Giovanni, B. P. Chamberlain, X. Dong, and M. M. Bronstein. Understanding oversquashing and bottlenecks on graphs via curvature. In ICLR, 2022. (Cited on 22)
[93] T. F. A. van der Ouderaa and M. van der Wilk. Learning invariant weights in neural networks. In J. Cussens and K. Zhang, editors, UAI, 2022. (Cited on 22)
[94] E. van der Pol, D. E. Worrall, H. van Hoof, F. A. Oliehoek, and M. Welling. MDP homomorphic networks: Group symmetries in reinforcement learning. In NeurIPS, 2020. (Cited on 2, 22)
[95] M. van der Wilk, M. Bauer, S. T. John, and J. Hensman. Learning invariances using the marginal likelihood. In S. Bengio, H. M. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, NeurIPS, 2018. (Cited on 22)
[96] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin. Attention is all you need. In NeurIPS, 2017. (Cited on 22, 25)
[97] P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio. Graph attention networks. In ICLR, 2018. (Cited on 7, 9)
[98] R. Winter, F. Noé, and D. Clevert. Permutation-invariant variational autoencoder for graph-level representation learning. In NeurIPS, 2021. (Cited on 4, 17, 24)
[99] T. Wolf, L. Debut, V. Sanh, J. Chaumont, C. Delangue, A. Moi, P. Cistac, T. Rault, R. Louf, M. Funtowicz, and J. Brew. Huggingface's transformers: State-of-the-art natural language processing. arXiv, 2019. (Cited on 6, 25)
[100] R. Xiong, Y. Yang, D. He, K. Zheng, S. Zheng, C. Xing, H. Zhang, Y. Lan, L. Wang, and T. Liu. On layer normalization in the transformer architecture. In ICML, 2020. (Cited on 25)
[101] K. Xu, W. Hu, J. Leskovec, and S. Jegelka. How powerful are graph neural networks? In ICLR, 2019. (Cited on 1, 4, 6, 7, 9, 22, 23)
[102] D. Yarotsky. Universal approximations of invariant maps by neural networks. arXiv, 2018. (Cited on 1, 2, 6, 7, 15, 22)
[103] C. Ying, T. Cai, S. Luo, S. Zheng, G. Ke, D. He, Y. Shen, and T. Liu. Do transformers really perform bad for graph representation? In NeurIPS, 2021. (Cited on 22)
[104] C. Yun, S. Bhojanapalli, A. S. Rawat, S. J. Reddi, and S. Kumar. Are transformers universal approximators of sequence-to-sequence functions? In ICLR, 2020. (Cited on 2, 3, 6, 22)
[105] B. Zhang, S. Luo, L. Wang, and D. He. Rethinking the expressive power of gnns via graph biconnectivity. arXiv, 2023. (Cited on 1, 22)