Table 2: Results in downstream tasks over 10 runs on optimal  $m$  that is shown in the bracket. "Cla.", "Clu." and "Rec." are short for classification, clustering, and reconstruction, respectively.
Task	Dataset	CAE	DUFS	WAST	AEFS	LS	RSR	UDFS	Our	AllFea
Cla.(ACC↑)	Madelon	0.65 (15)	0.52 (20)	0.87 (15)	0.87 (10)	0.51 (20)	0.83 (10)	0.74 (20)	0.90 (20)	0.73
PCMAC	0.79 (50)	0.77 (300)	0.83 (300)	0.71 (300)	0.68 (300)	0.91 (300)	0.87 (300)	0.79 (300)	0.93
COIL-20	1.00 (300)	1.00 (300)	1.00 (200)	1.00 (300)	0.98 (300)	1.00 (200)	1.00 (300)	1.00 (200)	1.00
Yale	0.72 (300)	0.72 (300)	0.70 (200)	0.70 (150)	0.67 (300)	0.72 (200)	0.71 (200)	0.81 (300)	0.75
Jaffe	0.97 (50)	0.97 (50)	0.97 (25)	0.97 (100)	0.97 (300)	0.98 (300)	0.98 (75)	1.00 (150)	0.98
PIX10	0.99 (25)	0.98 (50)	0.99 (150)	0.98 (100)	0.97 (100)	0.97 (50)	0.97 (100)	1.00 (25)	0.97
warpPIE10P	0.96 (100)	0.96 (200)	0.95 (300)	0.98 (75)	0.96 (300)	0.98 (300)	0.97 (200)	0.99 (300)	0.98
GLIOMA	0.68 (200)	0.66 (300)	0.72 (100)	0.63 (300)	0.67 (200)	0.67 (300)	0.68 (75)	0.81 (300)	0.72
LUNG	0.86 (100)	0.87 (150)	0.87 (300)	0.87 (300)	0.92 (300)	0.93 (300)	0.91 (300)	0.94 (50)	0.90
PROSTATE	0.88 (300)	0.81 (150)	0.81 (300)	0.81 (150)	0.88 (300)	0.90 (150)	0.90 (300)	0.89 (300)	0.89
SRBCT	0.99 (300)	0.94 (150)	0.98 (300)	0.95 (200)	0.98 (300)	1.00 (200)	1.00 (150)	0.98 (150)	0.99
SMK	0.67 (200)	0.66 (50)	0.65 (50)	0.66 (150)	0.72 (300)	0.72 (75)	0.73 (100)	0.75 (200)	0.68
Average ranking	4.7	5.9	4.9	5.5	6.3	2.8	3.3	1.8	3.2
# Top-1	1	1	1	1	0	3	3	9	2
Cla.(ACC↑)	Madelon	0.60 (15)	0.52 (15)	0.52 (15)	0.55 (5)	0.52 (20)	0.61 (15)	0.57 (20)	0.60 (20)	0.58
PCMAC	0.52 (150)	0.51 (25)	0.51 (25)	0.51 (100)	0.52 (75)	0.51 (25)	0.51 (150)	0.53 (200)	0.51
COIL-20	0.69 (100)	0.59 (150)	0.65 (200)	0.60 (300)	0.53 (300)	0.59 (300)	0.6 (300)	0.66 (200)	0.63
Yale	0.55 (100)	0.55 (150)	0.56 (100)	0.54 (300)	0.58 (300)	0.60 (300)	0.58 (200)	0.62 (300)	0.61
Jaffe	0.85 (300)	0.80 (300)	0.83 (300)	0.80 (300)	0.76 (300)	0.83 (150)	0.83 (200)	0.87 (200)	0.82
PIX10	0.86 (200)	0.79 (150)	0.85 (150)	0.79 (300)	0.85 (75)	0.72 (300)	0.81 (200)	0.87 (300)	0.78
warpPIE10P	0.55 (75)	0.42 (300)	0.44 (50)	0.53 (25)	0.55 (200)	0.57 (75)	0.49 (25)	0.51 (25)	0.45
GLIOMA	0.69 (50)	0.65 (50)	0.65 (25)	0.62 (300)	0.63 (300)	0.65 (150)	0.68 (75)	0.75 (75)	0.62
LUNG	0.64 (150)	0.64 (100)	0.62 (75)	0.66 (150)	0.65 (200)	0.69 (300)	0.61 (300)	0.72 (150)	0.69
PROSTATE	0.64 (25)	0.59 (150)	0.58 (300)	0.59 (25)	0.71 (25)	0.63 (25)	0.69 (25)	0.68 (50)	0.64
SRBCT	0.76 (150)	0.54 (75)	0.56 (200)	0.57 (200)	0.56 (200)	0.60 (150)	0.59 (150)	0.63 (50)	0.52
SMK	0.60 (300)	0.58 (25)	0.58 (25)	0.58 (50)	0.59 (50)	0.59 (50)	0.61 (200)	0.64 (25)	0.60
Average ranking	2.8	6.6	5.7	6	5	4	4.3	1.8	5.1
# Top-1	2	0	0	0	1	2	0	7	0
Rec.(RMSE↓)	Madelon	0.99 (20)	0.99 (20)	0.98 (20)	0.98 (20)	0.99 (20)	0.98 (20)	0.98 (20)	0.98 (10)	0.28
PCMAC	1.14 (25)	1.03 (25)	1.05 (25)	1.05 (25)	1.04 (25)	1.17 (50)	1.07 (25)	1.30 (25)	0.78
COIL-20	0.48 (300)	0.41 (300)	0.43 (300)	0.41 (300)	0.48 (300)	0.45 (300)	0.41 (300)	0.38 (300)	0.27
Yale	0.63 (300)	0.56 (300)	0.56 (300)	0.56 (300)	0.78 (300)	0.57 (300)	0.60 (200)	0.54 (300)	0.50
Jaffe	0.31 (300)	0.25 (300)	0.26 (300)	0.25 (300)	0.33 (300)	0.26 (300)	0.25 (300)	0.22 (300)	0.23
PIX10	0.49 (300)	0.43 (300)	0.46 (300)	0.43 (300)	0.63 (50)	0.46 (300)	0.47 (300)	0.39 (300)	1.20
warpPIE10P	0.30 (300)	0.26 (300)	0.27 (300)	0.26 (300)	0.45 (300)	0.27 (300)	0.26 (300)	0.25 (300)	0.25
GLIOMA	0.74 (300)	0.71 (300)	0.71 (300)	0.72 (300)	0.71 (300)	0.72 (300)	0.72 (300)	0.69 (300)	1.86
LUNG	0.94 (300)	0.77 (300)	0.77 (300)	0.78 (300)	0.82 (300)	0.81 (300)	0.79 (300)	0.80 (300)	0.82
PROSTATE	1.00 (300)	0.78 (300)	0.77 (300)	0.77 (300)	0.72 (300)	0.74 (300)	0.71 (300)	0.73 (300)	1.48
SRBCT	0.84 (300)	0.77 (300)	0.77 (300)	0.78 (300)	0.80 (300)	0.79 (300)	0.78 (300)	0.75 (300)	0.83
SMK	0.98 (25)	0.68 (300)	0.68 (300)	0.68 (300)	0.78 (300)	0.78 (300)	0.73 (300)	0.69 (300)	4.32
Average ranking	7.9	3	3.5	3.2	6.4	5.5	4.1	2.7	4.8
# Top-1	0	2	2	1	0	0	1	5	5