[19] Ariel Goldstein, Zaid Zada, Eliav Buchnik, Mariano Schain, Amy Price, Bobbi Aubrey, Samuel A Nastase, Amir Feder, Dotan Emanuel, Alon Cohen, et al. Shared computational principles for language processing in humans and deep language models. Nature neuroscience, 25(3):369-380, 2022.
[20] Onur Güntürkün and Thomas Bugnyar. Cognition without cortex. Trends in cognitive sciences, 20(4):291-303, 2016.
[21] A Hassani, S Walton, N Shah, A AbuDuweili, J Li, and H Shi. Escaping the big data paradigm with compact transformers. arxiv 2021. arXiv preprint arXiv:2104.05704.
[22] Uri Hasson, Samuel A Nastase, and Ariel Goldstein. Direct fit to nature: an evolutionary perspective on biological and artificial neural networks. Neuron, 105(3):416-434, 2020.
[23] Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dólár, and Ross Girshick. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 16000-16009, 2022.
[24] David H. Hubel and Torsten N. Wiesel. Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology, 195(1):215-243, March 1968. doi: 10.1113/jphysiol.1968.sp008455.
[25] Erich D Jarvis, Onur Güntürkün, Laura Bruce, András Csillag, Harvey Karten, Wayne Kuenzel, Loreta Medina, George Paxinos, David J Perkel, Toru Shimizu, et al. Avian brains and a new understanding of vertebrate brain evolution. Nature Reviews Neuroscience, 6(2):151-159, 2005.
[26] Harvey J Karten. Neocortical evolution: neuronal circuits arise independently of lamination. Current Biology, 23(1):R12-R15, 2013.
[27] Salman Khan, Muzammal Naseer, Munawar Hayat, Syed Waqas Zamir, Fahad Shahbaz Khan, and Mubarak Shah. Transformers in vision: A survey. ACM computing surveys (CSUR), 54 (10s):1-41, 2022.
[28] Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning. nature, 521(7553):436-444, 2015.
[29] Donsuk Lee, Pranav Gujarathi, and Justin N Wood. Controlled-rearing studies of newborn chicks and deep neural networks. arXiv preprint arXiv:2112.06106, 2021.
[30] Donsuk Lee, Denizhan Pak, and Justin N Wood. Modeling object recognition in newborn chicks using deep neural networks. arXiv preprint arXiv:2106.07185, 2021.
[31] Nuo Li and James J DiCarlo. Unsupervised natural experience rapidly alters invariant object representation in visual cortex. science, 321(5895):1502-1507, 2008.
[32] Yahui Liu, Enver Sangineto, Wei Bi, Nicu Sebe, Bruno Lepri, and Marco Nadai. Efficient training of visual transformers with small datasets. Advances in Neural Information Processing Systems, 34:23818-23830, 2021.
[33] John Locke. An essay concerning human understanding, 1690. 1948.
[34] Artur Luczak, Bruce L McNaughton, and Kenneth D Harris. Packet-based communication in the cortex. Nature Reviews Neuroscience, 16(12):745-755, 2015.
[35] Jiawei Mao, Honggu Zhou, Xuesong Yin, Yuanqi Chang Xu, and Binling Nie Rui. Masked autoencoders is an effective solution to transformer data-hungry. arXiv preprint arXiv:2212.05677, 2022.
[36] Giulio Matteucci and Davide Zoccolan. Unsupervised experience with temporal continuity of the visual environment is causally involved in the development of v1 complex cells. Science Advances, 6(22):eaba3742, 2020.
[37] Travis Meyer and Carl R Olson. Statistical learning of visual transitions in monkey inferotemporal cortex. Proceedings of the National Academy of Sciences, 108(48):19401-19406, 2011.