[18] D. Kleyko, D. Rachkovskij, E. Osipov, and A. Rahimi, "A survey on hyperdimensional computing aka vector symbolic architectures, part I: Models and data transformations," ACM Computing Surveys, vol. 55, no. 6, 2022.
[19] M. Havasi, R. Jenatton, S. Fort, J. Z. Liu, J. Snoek, B. Lakshminarayanan, A. M. Dai, and D. Tran, “Training independent subnetworks for robust prediction,” in International Conference on Learning Representations (ICLR), 2021.
[20] A. Ramé, R. Sun, and M. Cord, "Mixmo: Mixing multiple inputs for multiple outputs via deep subnetworks," in Proceedings of the IEEE/CVF International Conference on Computer Vision (CVPR), 2021, pp. 823-833.
[21] A. Krizhevsky, “Learning multiple layers of features from tiny images,” University of Toronto, 2009.
[22] H. Qi, C. You, X. Wang, Y. Ma, and J. Malik, “Deep isometric learning for visual recognition,” in International Conference on Machine Learning (ICML). PMLR, 2020, pp. 7824–7835.
[23] K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing human-level performance on imagenet classification,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2015, pp. 1026–1034.
[24] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, "Attention is all you need," Advances in Neural Information Processing Systems (NeurIPS), vol. 30, 2017.
[25] I. Schlag, K. Irie, and J. Schmidhuber, “Linear transformers are secretly fast weight programmers,” in International Conference on Machine Learning (ICML). PMLR, 2021, pp. 9355–9366.
[26] J. R. Brown, Y. Zhao, I. Shumailov, and R. D. Mullins, "Wide attention is the way forward for transformers?" in NeurIPS '22 Workshop on All Things Attention: Bridging Different Perspectives on Attention, 2022.
[27] A. Gu, K. Goel, and C. Re, "Efficiently modeling long sequences with structured state spaces," in International Conference on Learning Representations (ICLR), 2022.
[28] B. Cheung, A. Terekhov, Y. Chen, P. Agrawal, and B. Olshausen, "Superposition of many models into one," Advances in Neural Information Processing Systems (NeurIPS), vol. 32, 2019.
[29] M. Hersche, P. Rupp, L. Benini, and A. Rahimi, "Compressing subject-specific brain-computer interface models into one model by superposition in hyperdimensional space," in 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 2020, pp. 246-251.
[30] M. Zeman, E. Osipov, and Z. Bosnic, "Compressed superposition of neural networks for deep learning in edge computing," in 2021 International Joint Conference on Neural Networks (IJCNN). IEEE, 2021, pp. 1-8.
[31] M. Wortsman, V. Ramanujan, R. Liu, A. Kembhavi, M. Rastegari, J. Yosinski, and A. Farhadi, "Supermasks in superposition," Advances in Neural Information Processing Systems (NeurIPS), vol. 33, pp. 15 173-15 184, 2020.
[32] M. Zeman, J. F. Pucer, I. Kononenko, and Z. Bosnic, "Superformer: Continual learning superposition method for text classification," Neural Networks, vol. 161, pp. 418-436, 2023.
[33] M. Hersche, M. Zeqiri, L. Benini, A. Sebastian, and A. Rahimi, “A neuro-vector-symbolic architecture for solving Raven's progressive matrices,” Nature Machine Intelligence, vol. 5, no. 4, pp. 363–375, 2023.
[34] M. M. Alam, E. Raff, T. Oates, and J. Holt, "Deploying convolutional networks on untrusted platforms using 2D holographic reduced representations," in International Conference on Machine Learning (ICML). PMLR, 2022, pp. 367-393.
[35] ——, "Recasting self-attention with holographic reduced representations," in Proceedings of 8TH SIGKDD International Workshop on Mining and Learning from Time Series - Deep Forecasting: Models, Interpretability, and Applications (MiLeTS 2022), 2022.
[36] V. Murahari, A. Deshpande, C. Jimenez, I. Shafran, M. Wang, Y. Cao, and K. Narasimhan, "Muxplms: Data multiplexing for high-throughput language models," in Findings of the Association for Computational Linguistics: EMNLP 2023, 2023, pp. 4540-4554.