[1] J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805, 2018.
[2] T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., "Language models are few-shot learners," Advances in Neural Information Processing Systems (NeurIPS), vol. 33, pp. 1877-1901, 2020.
[3] Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, "Swin transformer: Hierarchical vision transformer using shifted windows," in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2021, pp. 10012-10022.
[4] Z. Liu, H. Mao, C.-Y. Wu, C. Feichtenhofer, T. Darrell, and S. Xie, “A convnet for the 2020s,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 11976-11986.
[5] R. W. Gayler, "Vector symbolic architectures answer Jackendoff's challenges for cognitive neuroscience," in Joint International Conference on Cognitive Science (ICCS/ASCS), 2003.
[6] T. A. Plate, "Holographic reduced representations," IEEE Transactions on Neural Networks, vol. 6, no. 3, pp. 623-641, 1995.
[7] P. Kanerva, "Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors," Cognitive Computation, vol. 1, no. 2, pp. 139-159, 2009.
[8] J. Neumann, “Learning holistic transformation of HRR from examples,” in International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies (KES), 2000, pp. 557–560.
[9] ——, “Learning the systematic transformation of holographic reduced representations,” Cognitive Systems Research, vol. 3, no. 2, pp. 227–235, 2002.
[10] D. Kleyko, M. Davies, E. P. Frady, P. Kanerva, S. J. Kent, B. A. Olshausen, E. Osipov, J. M. Rabaey, D. A. Rachkovskij, A. Rahimi, and F. T. Sommer, "Vector symbolic architectures as a computing framework for emerging hardware," Proceedings of the IEEE, vol. 110, no. 10, pp. 1538-1571, 2022.
[11] S. Zagoruyko and N. Komodakis, "Wide residual networks," in Proceedings of the British Machine Vision Conference (BMVC). BMVA Press, September 2016, pp. 87.1-87.12.
[12] D. Y. Fu, T. Dao, K. K. Saab, A. W. Thomas, A. Rudra, and C. Re, “Hungry hungry hippos: Towards language modeling with state space models,” in The Eleventh International Conference on Learning Representations (ICLR), 2022.
[13] V. Murahari, C. Jimenez, R. Yang, and K. Narasimhan, "DataMUX: Data multiplexing for neural networks," Advances in Neural Information Processing Systems (NeurIPS), vol. 35, pp. 17515-17527, 2022.
[14] Y. Tay, M. Dehghani, S. Abnar, Y. Shen, D. Bahri, P. Pham, J. Rao, L. Yang, S. Ruder, and D. Metzler, “Long range arena: A benchmark for efficient transformers,” in International Conference on Learning Representations (ICLR), 2021.
[15] K. M. Choromanski, V. Likhosherstov, D. Dohan, X. Song, A. Gane, T. Sarlos, P. Hawkins, J. Q. Davis, A. Mohiuddin, L. Kaiser et al., "Rethinking attention with performers," in International Conference on Learning Representations (ICLR), 2020.
[16] S. I. Gallant and T. W. Okaywe, “Representing objects, relations, and sequences,” Neural Computation, vol. 25, no. 8, pp. 2038–2078, 2013.
[17] R. W. Gayler, “Multiplicative binding, representation operators & analogy,” in Advances in Analogy Research: Integration of Theory and Data from the Cognitive, Computational, and Neural Sciences, 1998.