[1] L. Giambagli, L. Buffoni, T. Carletti, W. Nocentini, and D. Fanelli, "Machine learning in spectral domain," Nature Communications, vol. 12, Feb. 2021.
[2] Z. Liu, J. Li, Z. Shen, G. Huang, S. Yan, and C. Zhang, “Learning efficient convolutional networks through network slimming,” in ICCV, 2017.
[3] T. Liang, J. Glossner, L. Wang, S. Shi, and X. Zhang, “Pruning and quantization for deep neural network acceleration: A survey,” Neurocomputing, vol. 461, p. 370–403, Oct 2021.
[4] D. Elizondo and E. Fiesler, “A survey of partially connected neural networks,” International Journal of Neural Systems, vol. 08, p. 535–558, Oct 1997.
[5] J. Gou, B. Yu, S. J. Maybank, and D. Tao, “Knowledge distillation: A survey,” Int. J. Comput. Vision, vol. 129, p. 1789–1819, jun 2021.
[6] R. Yu, A. Li, C.-F. Chen, J.-H. Lai, V. I. Morariu, X. Han, M. Gao, C.-Y. Lin, and L. S. Davis, "Nisp: Pruning networks using neuron importance score propagation," Thecvf.com, p. 9194-9203, 2018.
[7] S. Scardapane, D. Comminiello, A. Hussain, and A. Uncini, "Group sparse regularization for deep neural networks," Neurocomputing, vol. 241, p. 81-89, Jun 2017.
[8] P. Molchanov, A. Mallya, S. Tyree, I. Frosio, and J. Kautz, "Importance estimation for neural network pruning," Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019.
[9] Y. LeCunn, J. Denker, and S. Solla, “Optimal brain damage,” Advances in Neural Information Processing Systems, 1989.
[10] Z. Liu, M. Sun, T. Zhou, G. Huang, and T. Darrell, “Rethinking the value of network pruning,” in International Conference on Learning Representations, 2019.
[11] I. J. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016. http://www.deeplearningbook.org.
[12] L. Chicchi, L. Giambagli, L. Buffoni, T. Carletti, M. Ciavarella, and D. Fanelli, “Training of sparse and dense deep neural networks: Fewer parameters, same performance,” Phys. Rev. E, vol. 104, p. 054312, Nov 2021.
[13] L. Chicchi, D. Fanelli, L. Giambagli, L. Buffoni, and T. Carletti, "Recurrent spectral network (rsn): Shaping a discrete map to reach automated classification," Chaos, Solitons & Fractals, vol. 168, p. 113128-113128, Mar 2023.
[14] L. Buffoni, E. Civitelli, L. Giambagli, L. Chicchi, and D. Fanelli, "Spectral pruning of fully connected layers," Scientific Reports, vol. 12, July 2022.
[15] N. Komodakis and S. Zagoruyko, “Paying more attention to attention: improving the performance of convolutional neural networks via attention transfer,” *Hal.science*, Jun 2017.
[16] W. Park, D. Kim, Y. Lu, and M. Cho, “Relational knowledge distillation,” Thecvf.com, p. 3967–3976, 2019.
[17] L. Beyer, X. Zhai, A. Royer, L. Markeeva, R. Anil, and A. Kolesnikov, Knowledge distillation: A good teacher is patient and consistent.
[18] S. Goldt, M. S. Advani, A. M. Saxe, F. Krzakala, and L. Zdeborova, "Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup*, Journal of Statistical Mechanics: Theory and Experiment, vol. 2020, p. 124010, Dec 2020.
[19] H. S. Seung, H. Sompolinsky, and N. Tishby, “Statistical mechanics of learning from examples,” vol. 45, p. 6056–6091, Apr 1992.
[20] F. Krzakala, F. Ricci-Tersenghi, L. Zdeborova, R. Zecchina, E. W. Tramel, and L. F. Cugliandolo, Statistical Physics, Optimization, Inference, and Message-Passing Algorithms. Dec 2015.
[21] G. Hinton, O. Vinyls, and J. Dean, "Distilling the knowledge in a neural network," 2015.
[22] D. Saad and S. A. Solla, "On-line learning in soft committee machines," *Physical Review E*, vol. 52, p. 4225-4243, Oct 1995.