# Federated Distillation Methodology for Label-Based Group Structures
## 3 Materials and Methods
### Clustered Federated Distillation
(2020) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] FedGroup: Efficient clustered federated learning via decomposed data-driven measure. _arXiv_ **2020**, arXiv:2010.06870. * [PERSON] et al. (2023) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Rethinking federated learning with domain shift: A prototype view. In Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) IEEE, Vancouver, BC, Canada, 8-22 June 2023; pp. 16312-16322. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON] [PERSON] Group knowledge transfer: Federated learning of large cnns at the edge. _Adv. Neural Inf. Process. Syst._**2020**, _33_, 14068-14080. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON] Ensemble distillation for robust model fusion in federated learning. _Adv. Neural Inf. Process. Syst._**2020**, _33_, 2351-2363. * [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON] One-shot federated learning. _arXiv_ **2019**, arXiv:1902.11175. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON] Practical one-shot federated learning for cross-silo setting. _arXiv_ **2020**, arXiv:2010.01017. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Distilled one-shot federated learning. _arXiv_ **2020**, arXiv:2009.07999. * [PERSON] (2023) [PERSON] The MNIST Database of Handwritten Digits. 1998. Available online: [[http://yann.lecun.com/exdb/mnist/](http://yann.lecun.com/exdb/mnist/)]([http://yann.lecun.com/exdb/mnist/](http://yann.lecun.com/exdb/mnist/)) (accessed on 21 March 2023). * [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Communication-efficient learning of deep networks from decentralized data. In Proceedings of the Artificial Intelligence and Statistics, PMLR, Fort Lauderdale, FL, USA, 20-22 April 2017; pp. 1273-1282. * [PERSON] (1971) [PERSON] Objective criteria for the evaluation of clustering methods. _J. Am. Stat. Assoc._**1971**, _66_, 846-850. [CrossRef]
* [PERSON] and Silhouettes (1987) [PERSON] Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. _J. Comput. Appl. Math._**1987**, _20_, 53-65. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Distillation-based semi-supervised federated learning for communication-efficient collaborative training with non-iid private data. _IEEE Trans. Mob. Comput._**2021**, _22_, 191-205. [CrossRef]
* [PERSON] (2009) [PERSON]; [PERSON] Learning multiple LAFERS of Features from Tiny Images. 2009. Available online: [[https://www.cs](https://www.cs)]([https://www.cs](https://www.cs)). toronto.edu/~kriz/learning-features-2009-TR.pdf (accessed on 21 March 2023). **Disclaimer/Publisher's Note:** The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.