Table 18: Complete results of long-term forecasting tasks for the in-domain setting. All the results of baseline are based on the unified channel-independent Transformer encoder. The past sequence length is set as 336. The unified channel-independent transformer model can perform the transfer experiment between datasets with different variables. The standard deviations of SimMTM are within 0.005 for MSE and within 0.004 for MAE.
ModelsMetric	SimMTM	Random init.	Ti-MAE [21]	TST [56]	LaST [42]	TF-C [57]	CoST [46]	TS2Vec [55]
MSE	MAE	MSE	MAE	MSE	MAE	MSE	MAE	MSE	MAE	MSE	MAE	MSE	MAE	MSE	MAE
ETTh2↓ETTh1	96	0.372	0.401	0.380	0.412	0.399	0.424	0.401	0.425	-	-	-	-	0.376	0.362	0.436	0.430
192	0.414	0.425	0.416	0.434	0.454	0.440	0.531	0.484	-	-	-	-	0.376	0.362	0.455	0.440
336	0.429	0.436	0.448	0.458	0.497	0.469	0.474	0.459	-	-	-	-	0.444	0.444	0.689	0.584
720	0.446	0.458	0.481	0.487	0.515	0.492	0.471	0.469	-	-	-	-	0.517	0.510	0.489	0.490
Avg	0.415	0.430	0.431	0.448	0.466	0.456	0.469	0.459	-	-	-	-	0.428	0.433	0.517	0.486
ETTm1↓ETTh1	96	0.367	0.398	0.380	0.412	0.400	0.418	0.443	0.440	-	-	-	-	0.465	0.456	0.413	0.443
192	0.396	0.421	0.416	0.434	0.434	0.445	0.471	0.455	-	-	-	-	0.722	0.588	0.459	0.465
336	0.471	0.437	0.448	0.458	0.510	0.467	0.462	0.455	-	-	-	-	0.712	0.586	0.614	0.554
720	0.454	0.463	0.481	0.487	0.636	0.544	0.525	0.503	-	-	-	-	0.581	0.533	0.450	0.464
Avg	0.422	0.430	0.431	0.448	0.495	0.469	0.475	0.463	-	-	-	-	0.620	0.541	0.484	0.482
ETTm2↓ETTh1	96	0.388	0.421	0.380	0.412	0.433	0.431	0.389	0.413	-	-	-	-	0.403	0.426	0.483	0.480
192	0.419	0.423	0.416	0.434	0.474	0.458	0.463	0.452	-	-	-	-	0.457	0.468	0.579	0.537
336	0.435	0.444	0.448	0.458	0.515	0.448	0.492	0.465	-	-	-	-	0.794	0.682	0.673	0.563
720	0.468	0.474	0.481	0.487	0.496	0.488	0.468	0.468	-	-	-	-	0.739	0.617	0.729	0.620
Avg	0.428	0.441	0.431	0.448	0.464	0.456	0.453	0.450	-	-	-	-	0.598	0.548	0.616	0.550
Weather↓ETTh1	96	0.477	0.444	0.380	0.412	0.397	0.440	0.428	0.429	-	-	-	-	0.421	0.410	0.393	0.410
192	0.454	0.522	0.416	0.434	0.458	0.466	0.461	0.451	-	-	-	-	0.539	0.503	0.440	0.437
336	0.424	0.434	0.448	0.458	0.479	0.458	0.463	0.456	-	-	-	-	0.568	0.514	0.450	0.451
720	0.468	0.469	0.481	0.487	0.515	0.492	0.507	0.489	-	-	-	-	0.544	0.522	0.567	0.541
Avg	0.456	0.467	0.431	0.448	0.462	0.464	0.465	0.456	-	-	-	-	0.518	0.487	0.463	0.460
ETTh1↓ETTh1	96	0.290	0.348	0.295	0.346	0.311	0.355	0.315	0.354	-	-	-	-	0.308	0.355	0.681	0.545
192	0.327	0.372	0.333	0.374	0.337	0.372	0.365	0.391	-	-	-	-	0.357	0.390	0.689	0.551
336	0.357	0.392	0.370	0.398	0.372	0.398	0.384	0.400	-	-	-	-	0.396	0.402	0.705	0.560
720	0.409	0.423	0.427	0.431	0.422	0.433	0.428	0.426	-	-	-	-	0.419	0.423	0.722	0.571
Avg	0.346	0.384	0.356	0.387	0.360	0.390	0.373	0.393	-	-	-	-	0.370	0.393	0.699	0.557
ETTh2↓ETTh1	96	0.322	0.347	0.295	0.346	0.323	0.362	0.338	0.383	-	-	-	-	0.322	0.351	0.679	0.546
192	0.332	0.372	0.333	0.374	0.370	0.395	0.394	0.408	-	-	-	-	0.331	0.373	0.673	0.551
336	0.394	0.391	0.370	0.398	0.397	0.413	0.401	0.412	-	-	-	-	0.382	0.397	0.703	0.557
720	0.411	0.424	0.427	0.431	0.442	0.439	0.434	0.432	-	-	-	-	0.417	0.428	0.722	0.573
Avg	0.365	0.384	0.356	0.387	0.383	0.402	0.391	0.409	-	-	-	-	0.363	0.387	0.694	0.557
ETTm2↓ETTh1	96	0.297	0.348	0.295	0.346	0.333	0.378	0.327	0.364	-	-	-	-	0.320	0.364	0.422	0.434
192	0.332	0.370	0.333	0.374	0.381	0.398	0.362	0.389	-	-	-	-	0.367	0.386	0.387	0.371
336	0.364	0.393	0.370	0.398	0.394	0.413	0.401	0.418	-	-	-	-	0.374	0.394	0.402	0.444
720	0.410	0.421	0.427	0.431	0.455	0.453	0.437	0.437	-	-	-	-	0.479	0.503	0.481	0.432
Avg	0.351	0.383	0.356	0.387	0.390	0.410	0.382	0.402	-	-	-	-	0.385	0.412	0.423	0.420
Weather↓ETTh1	96	0.294	0.354	0.295	0.346	0.338	0.380	0.324	0.366	-	-	-	-	0.324	0.360	0.329	0.359
192	0.318	0.355	0.333	0.374	0.473	0.457	0.349	0.377	-	-	-	-	0.359	0.387	0.392	0.392
336	0.361	0.397	0.370	0.398	0.402	0.415	0.378	0.398	-	-	-	-	0.395	0.399	0.372	0.400
720	0.427	0.426	0.427	0.431	0.432	0.438	0.422	0.427	-	-	-	-	0.450	0.467	0.434	0.429
Avg	0.350	0.383	0.356	0.387	0.411	0.423	0.368	0.392	-	-	-	-	0.382	0.403	0.382	0.395