SlowGuess/NeurIPS_2023_OCR huggingface dataset:
Table 24: In- and cross-domain settings of classification based on the unified 1-D ResNet encoder. For in-domain setting, we pre-train and fine-tune on the same dataset: Epilepsy. For cross-domain setting, we pre-train on SleepEEG and fine-tune on different domain datasets: Epilepsy, FD-B, Gesture, and EMG.
Scenarios	Models	Accuracy (%)	Precision (%)	Recall (%)	F1 (%)	Avg (%)
In-Domain	Epilepsy	Random init.	89.83	92.13	74.47	79.59	84.00
TS2vec [55]	92.33	94.53	81.11	86.33	88.58
CoST[46]	92.35	94.73	81.16	85.92	88.54
LaST [42]	-	-	-	-	-
TST [56]	80.89	90.38	51.73	48.01	67.75
Ti-MAE [21]	80.34	90.16	50.33	45.20	66.51
TF-C [57]	93.96	94.87	85.82	89.46	91.03
SimMTM	94.75	95.60	89.93	91.41	92.92
Cross-Domain	SleepEEG	Random init.	89.83	92.13	74.47	79.59	84.00
TS2vec [55]	94.46	91.99	90.28	91.10	91.95
CoST[46]	93.66	91.39	88.08	89.60	90.68
LaST [42]	-	-	-	-	-
TST [56]	82.89	86.15	79.02	80.44	82.13
Ti-MAE [21]	73.45	72.56	65.34	77.20	72.14
TF-C [57]	94.95	94.56	89.08	91.49	92.52
SimMTM	95.49	93.36	92.28	92.81	93.49
SleepEEG	Random init.	47.36	48.29	52.35	49.11	49.28
TS2vec [55]	60.74	59.60	64.27	61.07	61.42
CoST[46]	54.82	51.92	63.30	54.34	56.09
LaST [42]	-	-	-	-	-
TST [56]	65.57	70.05	67.57	64.41	66.90
Ti-MAE [21]	67.98	62.83	64.45	63.36	64.66
TF-C [57]	69.38	75.59	72.02	74.87	72.97
SimMTM	69.40	74.18	76.41	75.11	73.78
SleepEEG	Random Init.	42.19	47.51	49.63	48.86	47.05
TS2vec [55]	73.33	70.88	73.33	71.56	72.27
CoST[46]	73.33	74.37	73.33	71.16	73.04
LaST [42]	-	-	-	-	-
TST [56]	75.12	76.05	67.74	73.24	73.04
Ti-MAE [21]	75.54	69.32	72.42	69.32	71.65
TF-C [57]	76.42	77.31	74.29	75.72	75.94
SimMTM	80.00	79.03	80.00	78.67	79.43
SleepEEG	Random init.	77.80	59.09	66.67	62.38	66.49
TS2vec [55]	80.92	69.63	67.65	67.90	71.52
CoST[46]	73.17	70.47	69.84	70.00	70.87
LaST [42]	-	-	-	-	-
TST [56]	75.89	74.67	80.66	78.48	77.43
Ti-MAE [21]	63.52	67.77	70.55	58.32	65.04
TF-C [57]	81.71	72.65	81.59	76.83	78.20
SimMTM	97.56	98.33	98.04	98.14	98.02
Table 25: Full ablation studies for in-domain and cross-domain settings of classification. Under the Avg metric, the standard deviations of SimMTM are within  $0.2\%$  for Epilepsy, within  $0.5\%$  for FD-B, within  $0.6\%$  for Gesture, and within  $0.1\%$  for EMG.
Scenarios	Accuracy (%)	Precision (%)	Recall (%)	F1 (%)	Avg (%)
Epilepsy↓Epilepsy	Random init.	89.83	92.13	74.47	79.59	84.00
W/o Lreconstruction	93.80	96.11	86.11	89.45	91.37
W/o Lconstraint	90.99	92.81	79.86	84.13	86.95
SimMTM	94.75	95.60	89.93	91.41	92.92
SleepEEGLepilepsy	Random init.	89.83	92.13	74.47	79.59	84.00
W/o Lreconstruction	94.54	93.87	88.46	90.84	91.93
W/o Lconstraint	91.73	90.57	82.21	85.53	87.51
SimMTM	95.49	93.36	92.28	92.81	93.49
SleepEEGLD-B	Random init.	47.36	48.29	52.35	49.11	49.28
W/o Lreconstruction	66.11	67.97	74.70	70.01	69.70
W/o Lconstraint	53.71	69.48	62.67	50.86	59.18
SimMTM	69.40	74.18	76.41	75.11	73.78
SleepEEGLGesture	Random init.	42.19	47.51	49.63	48.86	47.05
W/o Lreconstruction	78.50	79.01	78.50	77.17	78.30
W/o Lconstraint	76.67	74.91	76.67	74.80	75.76
SimMTM	80.00	79.03	80.00	78.67	79.43
SleepEEGLDGEMG	Random init.	77.80	59.09	66.67	62.38	66.49
W/o Lreconstruction	90.24	94.20	78.04	81.53	86.00
W/o Lconstraint	85.37	89.97	69.62	70.74	78.93
SimMTM	97.56	98.33	98.04	98.14	98.02