Table 2: Personal and generic performance on SVHN, CIFAR10, and CIFAR100. We use Dir  $(\beta = 0.5)$  for medium heterogeneity and Dir  $(\beta = 0.1)$  or Dir  $(\beta = 0.2)$  for high-level heterogeneity. To verify the straggler situation, we split all datasets into 10 or 50 clients for full participation or partial participation, and in each round, 10 clients are selected in the federated training.
Dataset	Method	Full Participation (10, 10)	Partial Participation (50, 10)
#Partition	IID	β = 0.5	β = 0.1	IID	β = 0.5	β = 0.2
#Metric	PA	GA	PA	GA	PA	GA	PA	GA	PA	GA	PA	GA
SVHN	FedAvg	93.01	92.61	93.95	91.24	98.10	75.24	91.44	91.29	92.70	89.29	95.31	84.70
FedProx	93.12	93.12	93.71	92.15	97.98	75.13	91.67	91.66	92.71	89.98	95.13	85.68
MOON	93.16	93.16	92.98	92.46	98.06	76.21	93.49	91.41	91.86	90.20	95.78	86.22
FedRS	93.29	93.21	93.92	92.33	98.04	76.26	91.63	91.59	93.51	91.70	96.20	87.78
FedGen	94.02	93.99	94.47	92.66	98.22	76.51	91.47	91.33	93.67	91.35	95.77	87.59
FedLC	93.29	93.28	94.76	91.20	98.24	76.17	91.69	91.67	92.73	91.02	95.20	86.92
FedRep	93.01	92.61	94.77	91.24	97.87	68.52	91.77	89.20	93.14	80.94	95.38	67.77
FedProto	93.21	91.68	94.48	85.85	98.26	56.49	90.23	87.27	93.28	76.59	95.62	54.92
FedBABU	93.26	93.08	95.20	92.04	98.16	75.52	93.69	91.05	93.54	90.49	95.70	84.42
FedRod	93.50	93.22	95.47	92.09	98.06	76.24	92.04	91.65	93.96	91.20	95.68	86.98
FedGELA	94.84	94.66	96.27	93.66	98.52	78.88	94.68	93.59	95.54	93.29	96.85	89.58
CIFAR10	FedAvg	73.17	72.8	81.67	67.28	92.66	54.57	66.88	66.64	70.64	61.81	80.04	49.13
FedProx	73.69	73.69	81.95	67.53	92.94	56.13	67.67	67.27	73.62	60.80	80.66	50.82
MOON	73.29	73.29	82.27	68.34	92.90	55.61	67.58	67.58	74.64	61.81	83.42	52.19
FedRS	73.56	72.94	81.59	68.10	92.57	58.19	66.76	66.52	72.21	58.95	81.11	51.66
FedLC	73.05	73.00	81.99	67.97	92.48	57.02	67.46	67.13	72.57	61.31	82.14	55.15
FedGen	73.72	73.49	82.22	69.33	92.79	58.04	68.74	68.02	75.52	62.44	81.07	53.46
FedRep	73.42	73.23	83.30	47.96	92.92	38.32	67.85	67.74	77.28	42.64	84.52	33.22
FedProto	67.06	66.74	81.03	46.99	93.17	32.13	61.85	52.76	72.89	37.47	81.73	26.07
FedBABU	73.86	72.30	81.40	65.03	92.94	53.65	66.99	64.90	77.59	58.17	82.92	49.90
FedRod	74.24	73.76	82.34	70.74	92.27	58.86	70.09	70.04	78.23	64.13	84.63	58.86
FedGELA	75.02	74.07	84.52	72.73	94.28	61.57	72.33	72.04	80.96	65.08	86.55	60.52
CIFAR100	FedAvg	65.27	65.27	65.59	63.96	76.43	59.17	55.16	55.29	55.36	54.15	58.85	53.39
FedProx	65.71	65.71	65.31	64.18	75.95	59.93	56.86	56.89	56.89	56.08	59.27	55.25
MOON	65.33	65.33	65.23	64.79	75.45	60.12	56.91	56.86	56.72	56.14	59.51	55.53
FedRS	65.18	65.64	66.48	64.62	76.86	60.74	56.51	55.91	56.45	56.34	61.92	55.99
FedGen	65.74	65.75	66.72	64.33	76.92	60.43	56.77	56.74	57.43	56.27	60.09	55.27
FedLC	65.83	65.84	65.91	65.02	75.67	60.07	56.87	56.04	56.56	56.28	60.89	55.95
FedRep	61.21	59.21	67.87	52.51	77.81	42.77	53.41	51.44	55.60	48.67	67.70	33.10
FedProto	56.56	56.26	66.08	46.88	77.68	37.63	52.41	50.04	54.05	42.88	63.22	28.74
FedBABU	65.63	65.28	71.30	64.54	80.33	60.99	56.91	54.57	60.14	54.40	68.44	54.24
FedRod	66.17	66.17	72.05	65.19	80.46	61.01	57.76	57.01	63.90	56.53	72.37	54.67
FedGELA	67.28	68.07	72.61	66.94	82.79	63.13	61.70	59.29	64.37	58.60	72.93	58.53