SlowGuess/NeurIPS_2023_OCR huggingface dataset:
Table 20: Dataset metafeatures that are most correlated with the difference in normalized log loss between pairs of algorithms (the loss of Alg. 1 minus Alg. 2). Correlations are taken over all 10 splits of all 133 datasets in which CatBoost, XGBoost, ResNet, and SAINT ran successfully. The 10 dataset attributes with the largest absolute correlation are listed for each pair of algorithms. Attribute names correspond to the naming convention used by PyMFE.
Alg. 1	Alg. 2	Corr.	Attribute Name
CatBoost	ResNet	-0.14	Log of the size of the dataset.
CatBoost	ResNet	0.14	Log of the ratio of number of features to dataset size.
CatBoost	ResNet	-0.14	Log of the ratio of dataset size to number of features.
CatBoost	ResNet	0.06	Number of numerical features.
CatBoost	ResNet	0.06	Number of features.
CatBoost	ResNet	-0.06	Range of the relative frequency of each target class.
CatBoost	ResNet	-0.06	Log of the maximum frequency of any target class.
CatBoost	ResNet	-0.05	Interquartile range of the relative frequency of all target classes.
CatBoost	ResNet	-0.04	Maximum relative frequency of any target class.
CatBoost	SAINT	-0.19	Standard deviation of the relative frequency of all target classes.
CatBoost	SAINT	0.18	Kurtosis of the relative frequency of all target classes.
CatBoost	SAINT	-0.18	Maximum relative frequency of all target classes.
CatBoost	SAINT	-0.18	Mean relative frequency of all target classes.
CatBoost	SAINT	-0.17	Log of the median relative frequency of all target classes.
CatBoost	SAINT	0.16	Number of target classes.
CatBoost	SAINT	0.15	Skewness of the relative frequency of target classes.
XGBoost	ResNet	-0.20	Log of the dataset size.
XGBoost	ResNet	-0.20	Log of the ratio of dataset size to number of features.
XGBoost	ResNet	0.20	Log of the ratio of number of features to dataset size.
XGBoost	ResNet	0.11	Log of the minimum relative frequency of all target classes.
XGBoost	ResNet	0.08	Number of numerical features.
XGBoost	ResNet	0.08	Median relative frequency of all target classes.
XGBoost	ResNet	0.07	Minimum relative frequency of all target classes.
XGBoost	SAINT	-0.17	Standard deviation of the relative frequency of all target classes.
XGBoost	SAINT	-0.16	Log of the dataset size.
XGBoost	SAINT	-0.16	Interquartile range of the relative frequency of all target classes.
XGBoost	SAINT	0.15	Log of the ratio of dataset size to number of features.
XGBoost	SAINT	-0.15	Log of the ratio of number of features to dataset size.
XGBoost	SAINT	-0.15	Maximum relative frequency of all target classes.
XGBoost	SAINT	-0.13	Range of the relative frequency of all target classes.
XGBoost	SAINT	-0.13	Mean of the relative frequency of all target classes.
XGBoost	SAINT	-0.12	Median of the relative frequency of all target classes.