[13] Dan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath, Frank Wang, Evan Dorundo, Rahul Desai, Tyler Zhu, Samyak Parajuli, Mike Guo, Dawn Song, Jacob Steinhardt, and Justin Gilmer. The many faces of robustness: A critical analysis of out-of-distribution generalization. In Proc. IEEE/CVF International Conference on Computer Vision, ICCV 2021, Montreal, QC, Canada, October 10-17, 2021, pages 8320-8329. IEEE, 2021. 21
[14] Dan Hendrycks, Kevin Zhao, Steven Basart, Jacob Steinhardt, and Dawn Song. Natural adversarial examples. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 15262-15271, June 2021. 21
[15] Guillaume Hocquet, Olivier Bichler, and Damien Querliox. OvA-INN: Continual learning with invertible neural networks. In Proc. International Joint Conference on Neural Networks (IJCNN), pages 1–7, 2020. 2
[16] Saihui Hou, Xinyu Pan, Chen Change Loy, Zilei Wang, and Dahua Lin. Learning a unified classifier incrementally via rebalancing. In Proc. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 831-839, 2019. 3
[17] Edward Hu, Yelong Shen, Phil Wallis, Zeyuan Allen-Zhu, Yuzhhi Li, Lu Wang, and Weizhu Chen. LoRA: Low-rank adaptation of large language models. arXiv:2106.09685 (ICLR 2022), 2021.3
[18] Guang-Bin Huang, Qin-Yu Zhu, and Chee-Kheong Siew. Extreme learning machine: Theory and applications. Neurocomputing, 70:489-501, 2006. 2, 3, 4, 6, 7
[19] Gabriel Ilharco, Mitchell Wortsman, Ross Wightman, Cade Gordon, Nicholas Carlini, Rohan Taori, Achal Dave, Vaishaal Shankar, Hongseok Namkoong, John Miller, Hannaneh Hajishirzi, Ali Farhadi, and Ludwig Schmidt. OpenCLIP, July 2021. URL https://doi.org/10.5281/ zenodo.5143773.29
[20] Paul Janson, Wenxuan Zhang, Rahaf Aljundi, and Mohamed Elhoseiny. A simple baseline that questions the use of pretrained-models in continual learning. arXiv: 2210.04428 (2022 NeurIPS Workshop on Distribution Shifts), 2023. 2, 3, 4, 9, 10, 16
[21] Menglin Jia, Luming Tang, Bor-Chun Chen, Claire Cardie, Serge Belongie, Bharath Hariharan, and Ser-Nam Lim. Visual prompt tuning. In Proc. European Conference on Computer Vision (ECCV), 2022. 2, 8, 20, 21
[22] Shibo Jie, Zhi-Hong Deng, and Ziheng Li. Alleviating representational shift for continual fine-tuning. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 3810-3819, June 2022. 2
[23] Agnan Kessy, Alex Lewin, and Korbinian Strimmer. Optimal whitening and decorrelation. The American Statistician, 72:309-314, 2018. 19
[24] Simon Kornblith, Jonathon Shlens, and Quoc V. Le. Do better imagenet models transfer better? In Proc. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, pages 2661-2671. Computer Vision Foundation / IEEE, 2019. 2
[25] Jonathan Krause, Michael Stark, Jia Deng, and Li Fei-Fei. 3D object representations for fine-grained categorization. In Proc. IEEE International Conference on Computer Vision Workshops, pages 554–561, 2013. 21
[26] Alex Krizhevsky. Learning multiple layers of features from tiny images. Master's thesis, Dept of CS, University of Toronto. See http://www.cs.toronto.edu/ kriz/cifar.html), 2009. 21
[27] Chuqiao Li, Zhiwu Huang, Danda Pani Paudel, Yabin Wang, Mohamad Shahbazi, Xiaopeng Hong, and Luc Van Gool. A continual deepfake detection benchmark: Dataset, methods, and essentials. arXiv:2205.05467, 2022. 9, 22