<table><caption>Table F.1: **Performance Per Dataset.** We show the average predictive performance per dataset with the standard deviation over folds. We show the performance for the default hyperparameter configuration (Default), for the model after tuning (Tuned), and for the ensemble after tuning (Tuned + Ens.). We highlight the best-performing methods with significance on three levels: (1) **Green**: The best performing method on average; (2) **Bold**: Methods that are not significantly worse than the best method on average, based on a Wilcoxon Signed-Rank test for paired samples with Holm-Bonferroni correction and $\alpha = 0.05$. (3) **Underlined**: Methods that are not significantly worse than the best method in the same pipeline regime (Default, Tuned, or Tuned + Ens.), based on a Wilcoxon Signed-Rank test for paired samples with Holm-Bonferroni correction and $\alpha = 0.05$. We exclude AutoGluon for significance tests in the Tuned + Ens. regime.</caption><thead><tr><th></th><th colspan="3">APSFailure (AUC ↑)</th><th colspan="3">Amazon_employee_access (AUC ↑)</th></tr><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.990 ± 0.002</td><td>0.990 ± 0.002</td><td>0.990 ± 0.002</td><td>0.839 ± 0.005</td><td>0.841 ± 0.005</td><td>0.849 ± 0.005</td></tr><tr><td>ExtraTrees</td><td>0.990 ± 0.002</td><td>0.990 ± 0.003</td><td>0.991 ± 0.002</td><td>0.833 ± 0.006</td><td>0.841 ± 0.007</td><td>0.845 ± 0.006</td></tr><tr><td>XGBoost</td><td><strong>0.992 ± 0.002</strong></td><td><strong>0.992 ± 0.002</strong></td><td><strong>0.992 ± 0.002</strong></td><td>0.834 ± 0.007</td><td>0.859 ± 0.008</td><td>0.862 ± 0.008</td></tr><tr><td>LightGBM</td><td>0.992 ± 0.002</td><td>0.992 ± 0.002</td><td>0.992 ± 0.002</td><td>0.843 ± 0.009</td><td>0.850 ± 0.007</td><td>0.858 ± 0.009</td></tr><tr><td>CatBoost</td><td><strong>0.992 ± 0.003</strong></td><td><strong>0.992 ± 0.002</strong></td><td><strong>0.992 ± 0.003</strong></td><td>0.882 ± 0.008</td><td><strong>0.883 ± 0.008</strong></td><td><strong>0.883 ± 0.007</strong></td></tr><tr><td>EBM</td><td>0.991 ± 0.002</td><td>0.991 ± 0.002</td><td>0.991 ± 0.002</td><td>0.839 ± 0.006</td><td>0.841 ± 0.007</td><td>0.842 ± 0.006</td></tr><tr><td>FastAIMLP</td><td>0.988 ± 0.003</td><td>0.989 ± 0.002</td><td>0.991 ± 0.002</td><td>0.854 ± 0.007</td><td>0.853 ± 0.008</td><td>0.866 ± 0.007</td></tr><tr><td>TorchMLP</td><td>0.990 ± 0.002</td><td>0.991 ± 0.002</td><td><strong>0.992 ± 0.001</strong></td><td>0.835 ± 0.007</td><td>0.838 ± 0.006</td><td>0.849 ± 0.007</td></tr><tr><td>RealMLP</td><td>0.991 ± 0.002</td><td>0.991 ± 0.002</td><td>0.992 ± 0.002</td><td>0.844 ± 0.007</td><td>0.846 ± 0.008</td><td>0.864 ± 0.008</td></tr><tr><td>TabM</td><td>0.992 ± 0.002</td><td>0.992 ± 0.002</td><td><strong>0.993 ± 0.002</strong></td><td>0.833 ± 0.009</td><td>0.842 ± 0.009</td><td>0.849 ± 0.009</td></tr><tr><td>MNCA</td><td>0.991 ± 0.003</td><td>0.991 ± 0.002</td><td><strong>0.993 ± 0.002</strong></td><td>0.846 ± 0.008</td><td>0.860 ± 0.008</td><td>0.869 ± 0.007</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td><td>TabPFNv2</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.990 ± 0.003</td><td>-</td><td>-</td><td>TabDPT</td><td>0.841 ± 0.006</td><td>-</td></tr><tr><td>TabICL</td><td><strong>0.993 ± 0.002</strong></td><td>-</td><td>-</td><td>TabICL</td><td>0.854 ± 0.006</td><td>-</td></tr><tr><td>Linear</td><td>0.988 ± 0.002</td><td>0.988 ± 0.002</td><td>0.990 ± 0.001</td><td>Linear</td><td>0.848 ± 0.009</td><td>0.850 ± 0.008</td></tr><tr><td>KNN</td><td>0.960 ± 0.005</td><td>0.985 ± 0.002</td><td>0.990 ± 0.002</td><td>KNN</td><td>0.750 ± 0.006</td><td>0.817 ± 0.006</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.993 ± 0.002</strong></td><td>AutoGluon</td><td>-</td><td><strong>0.882 ± 0.005</strong></td></tr></tbody></table><table><thead><tr><th></th><th colspan="3">Another-Dataset-on-used-Fiat-500 (rmse ↓)</th><th colspan="3">Bank_Customer_Churn (AUC ↑)</th></tr><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>750.8 ± 28.4</td><td><strong>736.5 ± 24.8</strong></td><td>735.4 ± 25.3</td><td>0.851 ± 0.008</td><td>0.857 ± 0.008</td><td>0.858 ± 0.008</td></tr><tr><td>ExtraTrees</td><td>744.2 ± 29.5</td><td><strong>735.8 ± 26.5</strong></td><td>735.1 ± 26.7</td><td>0.851 ± 0.006</td><td>0.860 ± 0.007</td><td>0.861 ± 0.007</td></tr><tr><td>XGBoost</td><td>754.6 ± 23.0</td><td><strong>741.4 ± 22.2</strong></td><td>737.1 ± 22.6</td><td>0.864 ± 0.009</td><td>0.866 ± 0.010</td><td>0.866 ± 0.010</td></tr><tr><td>LightGBM</td><td>746.0 ± 22.4</td><td><strong>740.4 ± 24.6</strong></td><td><strong>729.4 ± 22.7</strong></td><td>0.864 ± 0.009</td><td>0.866 ± 0.009</td><td>0.867 ± 0.009</td></tr><tr><td>CatBoost</td><td>738.1 ± 20.8</td><td><strong>736.3 ± 21.8</strong></td><td>732.9 ± 21.9</td><td>0.870 ± 0.009</td><td>0.870 ± 0.009</td><td>0.870 ± 0.009</td></tr><tr><td>EBM</td><td>749.9 ± 22.9</td><td>750.0 ± 24.1</td><td>745.7 ± 23.6</td><td>0.862 ± 0.010</td><td>0.864 ± 0.010</td><td>0.864 ± 0.010</td></tr><tr><td>FastAIMLP</td><td>760.5 ± 17.6</td><td>761.2 ± 21.6</td><td>756.3 ± 21.4</td><td>0.859 ± 0.009</td><td>0.863 ± 0.007</td><td>0.864 ± 0.008</td></tr><tr><td>TorchMLP</td><td>775.0 ± 26.3</td><td>769.8 ± 25.0</td><td>765.0 ± 24.7</td><td>0.860 ± 0.008</td><td>0.866 ± 0.008</td><td>0.866 ± 0.008</td></tr><tr><td>RealMLP</td><td>757.4 ± 23.8</td><td>756.0 ± 22.4</td><td><strong>726.6 ± 24.0</strong></td><td>0.866 ± 0.009</td><td>0.870 ± 0.009</td><td>0.871 ± 0.009</td></tr><tr><td>TabM</td><td>752.1 ± 23.3</td><td>755.0 ± 25.0</td><td><strong>748.0 ± 22.8</strong></td><td>0.869 ± 0.010</td><td>0.871 ± 0.010</td><td>0.871 ± 0.010</td></tr><tr><td>MNCA</td><td>753.7 ± 27.0</td><td>748.2 ± 27.6</td><td><strong>731.1 ± 28.2</strong></td><td>0.864 ± 0.008</td><td>0.869 ± 0.008</td><td>0.869 ± 0.008</td></tr><tr><td>TabPFNv2</td><td>727.7 ± 23.8</td><td><strong>733.2 ± 27.2</strong></td><td><strong>727.4 ± 26.0</strong></td><td>0.872 ± 0.009</td><td><strong>0.874 ± 0.009</strong></td><td><strong>0.874 ± 0.008</strong></td></tr><tr><td>TabDPT</td><td><strong>724.0 ± 22.1</strong></td><td>-</td><td>-</td><td>TabDPT</td><td>0.859 ± 0.008</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td><td>TabICL</td><td>0.868 ± 0.009</td><td>-</td></tr><tr><td>Linear</td><td>793.8 ± 25.4</td><td>764.2 ± 19.2</td><td>764.4 ± 19.3</td><td>Linear</td><td>0.772 ± 0.010</td><td>0.773 ± 0.010</td></tr><tr><td>KNN</td><td>823.7 ± 28.9</td><td>801.5 ± 29.5</td><td>782.2 ± 27.7</td><td>KNN</td><td>0.814 ± 0.010</td><td>0.839 ± 0.007</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>729.6 ± 24.6</td><td>AutoGluon</td><td>-</td><td>0.869 ± 0.009</td></tr></tbody></table><table><thead><tr><th></th><th colspan="3">Bioresponse (AUC ↑)</th><th colspan="3">Diabetes130US (AUC ↑)</th></tr><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.873 ± 0.007</td><td>0.873 ± 0.007</td><td>0.876 ± 0.006</td><td>0.631 ± 0.006</td><td>0.656 ± 0.008</td><td>0.657 ± 0.008</td></tr><tr><td>ExtraTrees</td><td>0.867 ± 0.008</td><td>0.868 ± 0.009</td><td>0.871 ± 0.008</td><td>0.623 ± 0.009</td><td>0.651 ± 0.007</td><td>0.653 ± 0.008</td></tr><tr><td>XGBoost</td><td>0.873 ± 0.008</td><td>0.875 ± 0.008</td><td><strong>0.876 ± 0.008</strong></td><td>0.662 ± 0.008</td><td>0.668 ± 0.008</td><td>0.670 ± 0.008</td></tr><tr><td>LightGBM</td><td><strong>0.872 ± 0.008</strong></td><td><strong>0.874 ± 0.007</strong></td><td><strong>0.875 ± 0.008</strong></td><td>0.648 ± 0.008</td><td>0.668 ± 0.007</td><td><strong>0.672 ± 0.008</strong></td></tr><tr><td>CatBoost</td><td><strong>0.872 ± 0.009</strong></td><td><strong>0.875 ± 0.008</strong></td><td><strong>0.874 ± 0.008</strong></td><td>0.671 ± 0.008</td><td>0.671 ± 0.008</td><td>0.672 ± 0.008</td></tr><tr><td>EBM</td><td>0.852 ± 0.009</td><td>0.863 ± 0.008</td><td>0.866 ± 0.008</td><td>0.659 ± 0.008</td><td>0.662 ± 0.007</td><td>0.665 ± 0.008</td></tr><tr><td>FastAIMLP</td><td>0.850 ± 0.011</td><td>0.857 ± 0.010</td><td>0.860 ± 0.010</td><td>0.647 ± 0.007</td><td>0.656 ± 0.008</td><td>0.662 ± 0.008</td></tr><tr><td>TorchMLP</td><td>0.846 ± 0.008</td><td>0.856 ± 0.009</td><td>0.863 ± 0.008</td><td>0.655 ± 0.007</td><td>0.663 ± 0.009</td><td>0.667 ± 0.009</td></tr><tr><td>RealMLP</td><td>0.858 ± 0.009</td><td>0.864 ± 0.008</td><td><strong>0.875 ± 0.008</strong></td><td>0.659 ± 0.005</td><td>0.662 ± 0.008</td><td>0.669 ± 0.008</td></tr><tr><td>TabM</td><td>0.863 ± 0.005</td><td><strong>0.871 ± 0.007</strong></td><td><strong>0.873 ± 0.007</strong></td><td>0.660 ± 0.007</td><td>0.662 ± 0.008</td><td>0.663 ± 0.008</td></tr><tr><td>MNCA</td><td>0.860 ± 0.010</td><td>0.865 ± 0.007</td><td><strong>0.874 ± 0.008</strong></td><td>0.658 ± 0.008</td><td>0.662 ± 0.008</td><td>0.666 ± 0.008</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td><td>TabPFNv2</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.862 ± 0.010</td><td>-</td><td>-</td><td>TabDPT</td><td>0.609 ± 0.008</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td><td>TabICL</td><td>0.647 ± 0.008</td><td>-</td></tr><tr><td>Linear</td><td>0.789 ± 0.011</td><td>0.810 ± 0.009</td><td>0.817 ± 0.009</td><td>Linear</td><td>0.648 ± 0.008</td><td>0.658 ± 0.008</td></tr><tr><td>KNN</td><td>0.818 ± 0.015</td><td>0.837 ± 0.011</td><td>0.846 ± 0.010</td><td>KNN</td><td>0.542 ± 0.006</td><td>0.633 ± 0.005</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.878 ± 0.007</strong></td><td>AutoGluon</td><td>-</td><td><strong>0.673 ± 0.008</strong></td></tr></tbody></table>
E-CommereShippingData (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.739 ± 0.005</td><td><strong>0.740 ± 0.006</strong></td><td><strong>0.741 ± 0.005</strong></td></tr><tr><td>ExtraTrees</td><td>0.737 ± 0.006</td><td><strong>0.741 ± 0.006</strong></td><td><strong>0.740 ± 0.005</strong></td></tr><tr><td>XGBoost</td><td>0.740 ± 0.006</td><td><strong>0.742 ± 0.007</strong></td><td><strong>0.742 ± 0.006</strong></td></tr><tr><td>LightGBM</td><td>0.739 ± 0.006</td><td><strong>0.740 ± 0.005</strong></td><td><strong>0.741 ± 0.006</strong></td></tr><tr><td>CatBoost</td><td><strong>0.744 ± 0.006</strong></td><td><strong>0.742 ± 0.007</strong></td><td>0.741 ± 0.007</td></tr><tr><td>EBM</td><td><strong>0.744 ± 0.004</strong></td><td><strong>0.743 ± 0.005</strong></td><td><strong>0.743 ± 0.004</strong></td></tr><tr><td>FastAIMLP</td><td>0.737 ± 0.005</td><td><strong>0.741 ± 0.007</strong></td><td><strong>0.741 ± 0.007</strong></td></tr><tr><td>TorchMLP</td><td>0.737 ± 0.008</td><td><strong>0.740 ± 0.007</strong></td><td><strong>0.741 ± 0.007</strong></td></tr><tr><td>RealMLP</td><td><strong>0.741 ± 0.007</strong></td><td><strong>0.742 ± 0.007</strong></td><td><strong>0.742 ± 0.007</strong></td></tr><tr><td>TabM</td><td><strong>0.744 ± 0.008</strong></td><td><strong>0.740 ± 0.005</strong></td><td><strong>0.743 ± 0.006</strong></td></tr><tr><td>MNCA</td><td><strong>0.741 ± 0.010</strong></td><td><strong>0.741 ± 0.006</strong></td><td><strong>0.741 ± 0.004</strong></td></tr><tr><td>TabPFNv2</td><td><strong>0.744 ± 0.007</strong></td><td><strong>0.744 ± 0.007</strong></td><td><strong>0.744 ± 0.006</strong></td></tr><tr><td>TabDPT</td><td>0.735 ± 0.007</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><strong>0.743 ± 0.006</strong></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.704 ± 0.006</td><td>0.722 ± 0.008</td><td>0.722 ± 0.008</td></tr><tr><td>KNN</td><td>0.703 ± 0.006</td><td>0.736 ± 0.008</td><td>0.733 ± 0.005</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.738 ± 0.005</strong></td></tr></tbody></table>

Fitness.Club (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.775 ± 0.018</td><td>0.801 ± 0.015</td><td>0.800 ± 0.015</td></tr><tr><td>ExtraTrees</td><td>0.769 ± 0.018</td><td>0.816 ± 0.013</td><td>0.815 ± 0.014</td></tr><tr><td>XGBoost</td><td>0.798 ± 0.015</td><td>0.808 ± 0.015</td><td>0.808 ± 0.015</td></tr><tr><td>LightGBM</td><td>0.795 ± 0.015</td><td>0.815 ± 0.015</td><td>0.814 ± 0.015</td></tr><tr><td>CatBoost</td><td>0.814 ± 0.014</td><td>0.812 ± 0.015</td><td>0.811 ± 0.015</td></tr><tr><td>EBM</td><td>0.813 ± 0.015</td><td>0.810 ± 0.015</td><td>0.812 ± 0.015</td></tr><tr><td>FastAIMLP</td><td>0.806 ± 0.013</td><td>0.814 ± 0.013</td><td>0.814 ± 0.014</td></tr><tr><td>TorchMLP</td><td>0.813 ± 0.016</td><td>0.813 ± 0.017</td><td>0.814 ± 0.016</td></tr><tr><td>RealMLP</td><td>0.812 ± 0.015</td><td>0.814 ± 0.015</td><td>0.816 ± 0.014</td></tr><tr><td>TabM</td><td>0.818 ± 0.014</td><td>0.818 ± 0.014</td><td>0.818 ± 0.014</td></tr><tr><td>MNCA</td><td>0.817 ± 0.014</td><td>0.814 ± 0.015</td><td>0.801 ± 0.017</td></tr><tr><td>TabPFNv2</td><td><strong>0.822 ± 0.012</strong></td><td><strong>0.820 ± 0.013</strong></td><td><strong>0.817 ± 0.013</strong></td></tr><tr><td>TabDPT</td><td>0.818 ± 0.014</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.819 ± 0.013</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.819 ± 0.014</td><td>0.819 ± 0.015</td><td>0.819 ± 0.015</td></tr><tr><td>KNN</td><td>0.722 ± 0.026</td><td>0.786 ± 0.016</td><td>0.798 ± 0.016</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.811 ± 0.012</td></tr></tbody></table>

Food_Delivery_Time (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>7.855 ± 0.041</td><td>7.587 ± 0.046</td><td>7.588 ± 0.046</td></tr><tr><td>ExtraTrees</td><td>8.179 ± 0.045</td><td>7.753 ± 0.053</td><td>7.749 ± 0.053</td></tr><tr><td>XGBoost</td><td>7.397 ± 0.055</td><td>7.397 ± 0.055</td><td>7.400 ± 0.055</td></tr><tr><td>LightGBM</td><td>7.616 ± 0.053</td><td>7.378 ± 0.054</td><td>7.374 ± 0.053</td></tr><tr><td>CatBoost</td><td>7.379 ± 0.051</td><td><strong>7.367 ± 0.051</strong></td><td><strong>7.368 ± 0.051</strong></td></tr><tr><td>EBM</td><td>7.433 ± 0.040</td><td>7.424 ± 0.051</td><td>7.412 ± 0.044</td></tr><tr><td>FastAIMLP</td><td>8.188 ± 0.053</td><td>8.085 ± 0.056</td><td>8.060 ± 0.052</td></tr><tr><td>TorchMLP</td><td>7.735 ± 0.059</td><td>7.579 ± 0.049</td><td>7.559 ± 0.052</td></tr><tr><td>RealMLP</td><td>7.926 ± 0.053</td><td>7.453 ± 0.051</td><td>7.414 ± 0.046</td></tr><tr><td>TabM</td><td>7.760 ± 0.050</td><td>7.651 ± 0.053</td><td>7.651 ± 0.052</td></tr><tr><td>MNCA</td><td>7.486 ± 0.044</td><td>7.421 ± 0.045</td><td>7.379 ± 0.047</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>7.551 ± 0.042</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>8.564 ± 0.047</td><td>8.340 ± 0.063</td><td>8.277 ± 0.055</td></tr><tr><td>KNN</td><td>8.563 ± 0.042</td><td>8.042 ± 0.048</td><td>7.909 ± 0.049</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>7.362 ± 0.051</strong></td></tr></tbody></table>

GiveMeSomeCredit (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.846 ± 0.003</td><td>0.862 ± 0.003</td><td>0.863 ± 0.003</td></tr><tr><td>ExtraTrees</td><td>0.840 ± 0.003</td><td>0.857 ± 0.002</td><td>0.857 ± 0.003</td></tr><tr><td>XGBoost</td><td>0.865 ± 0.002</td><td>0.866 ± 0.002</td><td>0.866 ± 0.002</td></tr><tr><td>LightGBM</td><td>0.865 ± 0.002</td><td>0.866 ± 0.002</td><td>0.867 ± 0.002</td></tr><tr><td>CatBoost</td><td>0.866 ± 0.002</td><td>0.867 ± 0.002</td><td>0.867 ± 0.002</td></tr><tr><td>EBM</td><td>0.864 ± 0.002</td><td>0.865 ± 0.002</td><td>0.865 ± 0.002</td></tr><tr><td>FastAIMLP</td><td>0.829 ± 0.004</td><td>0.843 ± 0.005</td><td>0.847 ± 0.003</td></tr><tr><td>TorchMLP</td><td>0.863 ± 0.002</td><td>0.864 ± 0.002</td><td>0.865 ± 0.002</td></tr><tr><td>RealMLP</td><td>0.865 ± 0.002</td><td>0.866 ± 0.002</td><td>0.866 ± 0.002</td></tr><tr><td>TabM</td><td>0.866 ± 0.002</td><td><strong>0.867 ± 0.002</strong></td><td><strong>0.867 ± 0.002</strong></td></tr><tr><td>MNCA</td><td>0.866 ± 0.002</td><td>0.866 ± 0.002</td><td>0.867 ± 0.002</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.842 ± 0.003</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.866 ± 0.002</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.841 ± 0.002</td><td>0.841 ± 0.002</td><td>0.841 ± 0.002</td></tr><tr><td>KNN</td><td>0.747 ± 0.004</td><td>0.858 ± 0.002</td><td>0.859 ± 0.002</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.867 ± 0.002</td></tr></tbody></table>

HR_Analytics_Job_Change (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.789 ± 0.006</td><td><strong>0.802 ± 0.006</strong></td><td><strong>0.802 ± 0.006</strong></td></tr><tr><td>ExtraTrees</td><td>0.784 ± 0.007</td><td><strong>0.800 ± 0.007</strong></td><td><strong>0.801 ± 0.007</strong></td></tr><tr><td>XGBoost</td><td><strong>0.805 ± 0.006</strong></td><td><strong>0.803 ± 0.005</strong></td><td><strong>0.805 ± 0.006</strong></td></tr><tr><td>LightGBM</td><td>0.802 ± 0.007</td><td><strong>0.803 ± 0.007</strong></td><td><strong>0.804 ± 0.006</strong></td></tr><tr><td>CatBoost</td><td><strong>0.804 ± 0.006</strong></td><td><strong>0.804 ± 0.006</strong></td><td><strong>0.804 ± 0.006</strong></td></tr><tr><td>EBM</td><td>0.800 ± 0.006</td><td><strong>0.800 ± 0.006</strong></td><td><strong>0.801 ± 0.006</strong></td></tr><tr><td>FastAIMLP</td><td>0.801 ± 0.005</td><td><strong>0.801 ± 0.007</strong></td><td><strong>0.803 ± 0.007</strong></td></tr><tr><td>TorchMLP</td><td>0.801 ± 0.006</td><td><strong>0.801 ± 0.006</strong></td><td><strong>0.803 ± 0.006</strong></td></tr><tr><td>RealMLP</td><td>0.801 ± 0.007</td><td><strong>0.801 ± 0.006</strong></td><td><strong>0.803 ± 0.006</strong></td></tr><tr><td>TabM</td><td>0.801 ± 0.007</td><td><strong>0.803 ± 0.006</strong></td><td><strong>0.803 ± 0.006</strong></td></tr><tr><td>MNCA</td><td>0.801 ± 0.006</td><td><strong>0.802 ± 0.007</strong></td><td><strong>0.803 ± 0.007</strong></td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.801 ± 0.006</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><strong>0.805 ± 0.006</strong></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.796 ± 0.006</td><td>0.798 ± 0.005</td><td>0.797 ± 0.005</td></tr><tr><td>KNN</td><td>0.745 ± 0.007</td><td>0.789 ± 0.007</td><td>0.798 ± 0.007</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.805 ± 0.007</strong></td></tr></tbody></table>

Is-this-a-good-customer (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.721 ± 0.020</td><td>0.727 ± 0.018</td><td>0.729 ± 0.020</td></tr><tr><td>ExtraTrees</td><td>0.695 ± 0.021</td><td>0.713 ± 0.022</td><td>0.718 ± 0.024</td></tr><tr><td>XGBoost</td><td>0.723 ± 0.021</td><td><strong>0.742 ± 0.023</strong></td><td><strong>0.744 ± 0.022</strong></td></tr><tr><td>LightGBM</td><td>0.724 ± 0.020</td><td><strong>0.741 ± 0.022</strong></td><td><strong><u>0.746 ± 0.020</u></strong></td></tr><tr><td>CatBoost</td><td><strong>0.748 ± 0.020</strong></td><td><strong>0.743 ± 0.019</strong></td><td><strong>0.744 ± 0.019</strong></td></tr><tr><td>EBM</td><td><strong>0.751 ± 0.019</strong></td><td><strong>0.745 ± 0.018</strong></td><td><strong>0.748 ± 0.018</strong></td></tr><tr><td>FastAIMLP</td><td>0.711 ± 0.018</td><td><strong>0.742 ± 0.025</strong></td><td><strong>0.745 ± 0.017</strong></td></tr><tr><td>TorchMLP</td><td>0.728 ± 0.020</td><td><strong>0.727 ± 0.023</strong></td><td><strong>0.733 ± 0.018</strong></td></tr><tr><td>RealMLP</td><td>0.732 ± 0.023</td><td><strong>0.731 ± 0.025</strong></td><td><strong>0.742 ± 0.020</strong></td></tr><tr><td>TabM</td><td>0.744 ± 0.022</td><td><strong>0.743 ± 0.019</strong></td><td><strong>0.744 ± 0.019</strong></td></tr><tr><td>MNCA</td><td>0.738 ± 0.024</td><td><strong>0.732 ± 0.020</strong></td><td><strong>0.705 ± 0.024</strong></td></tr><tr><td>TabPFNv2</td><td><strong>0.746 ± 0.019</strong></td><td><strong>0.735 ± 0.022</strong></td><td><strong>0.743 ± 0.018</strong></td></tr><tr><td>TabDPT</td><td>0.742 ± 0.016</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.744 ± 0.019</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.738 ± 0.021</td><td>0.735 ± 0.020</td><td>0.738 ± 0.021</td></tr><tr><td>KNN</td><td>0.652 ± 0.037</td><td><strong>0.741 ± 0.024</strong></td><td><strong>0.730 ± 0.023</strong></td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.745 ± 0.019</td></tr></tbody></table>
MIC (logloss ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.513 ± 0.031</td><td>0.485 ± 0.023</td><td>0.474 ± 0.019</td></tr><tr><td>ExtraTrees</td><td>0.521 ± 0.030</td><td>0.482 ± 0.020</td><td>0.470 ± 0.018</td></tr><tr><td>XGBoost</td><td>0.470 ± 0.020</td><td>0.440 ± 0.019</td><td>0.440 ± 0.019</td></tr><tr><td>LightGBM</td><td>0.503 ± 0.019</td><td>0.453 ± 0.020</td><td>0.453 ± 0.019</td></tr><tr><td>CatBoost</td><td>0.455 ± 0.020</td><td>0.453 ± 0.019</td><td>0.451 ± 0.018</td></tr><tr><td>EBM</td><td>0.475 ± 0.018</td><td>0.446 ± 0.016</td><td>0.445 ± 0.016</td></tr><tr><td>FastAIMLP</td><td>0.506 ± 0.024</td><td>0.465 ± 0.023</td><td>0.450 ± 0.020</td></tr><tr><td>TorchMLP</td><td>0.473 ± 0.019</td><td>0.465 ± 0.024</td><td>0.453 ± 0.017</td></tr><tr><td>RealMLP</td><td>0.492 ± 0.027</td><td>0.439 ± 0.021</td><td>0.434 ± 0.017</td></tr><tr><td>TabM</td><td>0.432 ± 0.017</td><td><strong>0.431 ± 0.017</strong></td><td><strong>0.430 ± 0.016</strong></td></tr><tr><td>MNCA</td><td>0.465 ± 0.019</td><td>0.455 ± 0.020</td><td>0.451 ± 0.018</td></tr><tr><td>TabPFNv2</td><td>0.468 ± 0.043</td><td>0.440 ± 0.022</td><td><strong>0.433 ± 0.022</strong></td></tr><tr><td>TabDPT</td><td>0.481 ± 0.021</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.465 ± 0.022</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.589 ± 0.035</td><td>0.469 ± 0.021</td><td>0.468 ± 0.021</td></tr><tr><td>KNN</td><td>1.477 ± 0.096</td><td>0.657 ± 0.025</td><td>0.583 ± 0.019</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.445 ± 0.018</td></tr></tbody></table>

Marketing_Campaign (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.883 ± 0.015</td><td>0.881 ± 0.016</td><td>0.882 ± 0.015</td></tr><tr><td>ExtraTrees</td><td>0.884 ± 0.015</td><td>0.886 ± 0.015</td><td>0.888 ± 0.015</td></tr><tr><td>XGBoost</td><td>0.897 ± 0.015</td><td>0.903 ± 0.016</td><td>0.904 ± 0.015</td></tr><tr><td>LightGBM</td><td>0.901 ± 0.014</td><td>0.911 ± 0.015</td><td>0.911 ± 0.014</td></tr><tr><td>CatBoost</td><td>0.907 ± 0.015</td><td>0.904 ± 0.014</td><td>0.903 ± 0.015</td></tr><tr><td>EBM</td><td>0.903 ± 0.015</td><td>0.905 ± 0.015</td><td>0.906 ± 0.016</td></tr><tr><td>FastAIMLP</td><td>0.890 ± 0.017</td><td>0.905 ± 0.015</td><td>0.909 ± 0.014</td></tr><tr><td>TorchMLP</td><td>0.898 ± 0.015</td><td>0.910 ± 0.014</td><td>0.915 ± 0.013</td></tr><tr><td>RealMLP</td><td>0.906 ± 0.015</td><td>0.907 ± 0.014</td><td>0.911 ± 0.014</td></tr><tr><td>TabM</td><td>0.901 ± 0.016</td><td>0.916 ± 0.013</td><td>0.916 ± 0.014</td></tr><tr><td>MNCA</td><td>0.909 ± 0.016</td><td>0.912 ± 0.016</td><td>0.909 ± 0.015</td></tr><tr><td>TabPFNv2</td><td>0.915 ± 0.015</td><td>0.915 ± 0.013</td><td><strong>0.919 ± 0.013</strong></td></tr><tr><td>TabDPT</td><td>0.896 ± 0.016</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.911 ± 0.013</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.906 ± 0.013</td><td>0.905 ± 0.013</td><td>0.905 ± 0.013</td></tr><tr><td>KNN</td><td>0.834 ± 0.018</td><td>0.854 ± 0.018</td><td>0.875 ± 0.014</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.915 ± 0.013</td></tr></tbody></table>

NATICUSdroid (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.977 ± 0.002</td><td>0.981 ± 0.003</td><td>0.981 ± 0.003</td></tr><tr><td>ExtraTrees</td><td>0.977 ± 0.002</td><td>0.982 ± 0.002</td><td>0.982 ± 0.002</td></tr><tr><td>XGBoost</td><td>0.985 ± 0.002</td><td>0.985 ± 0.002</td><td>0.985 ± 0.002</td></tr><tr><td>LightGBM</td><td>0.985 ± 0.002</td><td>0.986 ± 0.002</td><td>0.986 ± 0.002</td></tr><tr><td>CatBoost</td><td>0.986 ± 0.002</td><td>0.986 ± 0.002</td><td>0.986 ± 0.002</td></tr><tr><td>EBM</td><td>0.984 ± 0.002</td><td>0.985 ± 0.001</td><td>0.985 ± 0.001</td></tr><tr><td>FastAIMLP</td><td>0.985 ± 0.002</td><td>0.985 ± 0.001</td><td>0.986 ± 0.001</td></tr><tr><td>TorchMLP</td><td>0.985 ± 0.002</td><td>0.985 ± 0.001</td><td>0.986 ± 0.002</td></tr><tr><td>RealMLP</td><td>0.985 ± 0.002</td><td>0.986 ± 0.001</td><td>0.986 ± 0.001</td></tr><tr><td>TabM</td><td>0.986 ± 0.001</td><td>0.986 ± 0.001</td><td>0.986 ± 0.001</td></tr><tr><td>MNCA</td><td>0.983 ± 0.002</td><td>0.984 ± 0.002</td><td>0.985 ± 0.002</td></tr><tr><td>TabPFNv2</td><td>0.983 ± 0.002</td><td>0.984 ± 0.003</td><td>0.985 ± 0.002</td></tr><tr><td>TabDPT</td><td>0.987 ± 0.001</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.981 ± 0.002</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.984 ± 0.004</td><td>0.981 ± 0.002</td><td>0.981 ± 0.002</td></tr><tr><td>KNN</td><td>-</td><td>0.978 ± 0.003</td><td>0.980 ± 0.003</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.987 ± 0.002</td></tr></tbody></table>

QSAR-TID-11 (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.806 ± 0.047</td><td>0.805 ± 0.048</td><td>0.796 ± 0.046</td></tr><tr><td>ExtraTrees</td><td>0.806 ± 0.046</td><td>0.802 ± 0.046</td><td>0.791 ± 0.046</td></tr><tr><td>XGBoost</td><td>0.786 ± 0.049</td><td>0.761 ± 0.047</td><td>0.760 ± 0.048</td></tr><tr><td>LightGBM</td><td>0.772 ± 0.050</td><td>0.758 ± 0.049</td><td>0.756 ± 0.048</td></tr><tr><td>CatBoost</td><td>0.774 ± 0.049</td><td>0.773 ± 0.048</td><td>0.771 ± 0.049</td></tr><tr><td>EBM</td><td>0.872 ± 0.039</td><td>0.859 ± 0.042</td><td>0.853 ± 0.042</td></tr><tr><td>FastAIMLP</td><td>0.776 ± 0.045</td><td>0.766 ± 0.049</td><td>0.761 ± 0.050</td></tr><tr><td>TorchMLP</td><td>0.774 ± 0.052</td><td>0.762 ± 0.049</td><td>0.748 ± 0.054</td></tr><tr><td>RealMLP</td><td>0.763 ± 0.047</td><td>0.764 ± 0.049</td><td>0.754 ± 0.050</td></tr><tr><td>TabM</td><td>0.761 ± 0.050</td><td>0.758 ± 0.050</td><td>0.755 ± 0.049</td></tr><tr><td>MNCA</td><td>0.771 ± 0.045</td><td>0.744 ± 0.044</td><td><strong>0.734 ± 0.043</strong></td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.773 ± 0.046</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>1.020 ± 0.032</td><td>0.940 ± 0.040</td><td>0.938 ± 0.039</td></tr><tr><td>KNN</td><td>1.003 ± 0.043</td><td>0.888 ± 0.046</td><td>0.859 ± 0.047</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.747 ± 0.049</td></tr></tbody></table>

QSAR_fish_toxicity (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.907 ± 0.047</td><td>0.885 ± 0.050</td><td>0.884 ± 0.049</td></tr><tr><td>ExtraTrees</td><td>0.880 ± 0.052</td><td><strong>0.873 ± 0.055</strong></td><td>0.870 ± 0.052</td></tr><tr><td>XGBoost</td><td>0.905 ± 0.050</td><td>0.881 ± 0.043</td><td>0.879 ± 0.042</td></tr><tr><td>LightGBM</td><td>0.894 ± 0.043</td><td>0.889 ± 0.045</td><td>0.883 ± 0.044</td></tr><tr><td>CatBoost</td><td>0.877 ± 0.049</td><td>0.875 ± 0.045</td><td>0.874 ± 0.047</td></tr><tr><td>EBM</td><td>0.905 ± 0.050</td><td>0.904 ± 0.048</td><td>0.898 ± 0.047</td></tr><tr><td>FastAIMLP</td><td>0.908 ± 0.048</td><td>0.909 ± 0.046</td><td>0.897 ± 0.048</td></tr><tr><td>TorchMLP</td><td>0.906 ± 0.055</td><td>0.89 ± 0.055</td><td>0.890 ± 0.055</td></tr><tr><td>RealMLP</td><td>0.878 ± 0.054</td><td>0.884 ± 0.058</td><td>0.865 ± 0.052</td></tr><tr><td>TabM</td><td>0.910 ± 0.047</td><td>0.898 ± 0.051</td><td>0.887 ± 0.048</td></tr><tr><td>MNCA</td><td>0.882 ± 0.053</td><td>0.882 ± 0.053</td><td>0.873 ± 0.053</td></tr><tr><td>TabPFNv2</td><td>0.868 ± 0.047</td><td><strong>0.873 ± 0.051</strong></td><td><strong>0.860 ± 0.049</strong></td></tr><tr><td>TabDPT</td><td><strong>0.859 ± 0.049</strong></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.950 ± 0.056</td><td>0.949 ± 0.056</td><td>0.950 ± 0.056</td></tr><tr><td>KNN</td><td>0.896 ± 0.057</td><td>0.890 ± 0.052</td><td>0.880 ± 0.054</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.880 ± 0.054</td></tr></tbody></table>

SDSS17 (logloss ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.085 ± 0.002</td><td><strong>0.073 ± 0.002</strong></td><td>0.072 ± 0.002</td></tr><tr><td>ExtraTrees</td><td>0.131 ± 0.002</td><td>0.080 ± 0.002</td><td>0.078 ± 0.002</td></tr><tr><td>XGBoost</td><td><strong>0.074 ± 0.002</strong></td><td>0.074 ± 0.002</td><td>0.074 ± 0.002</td></tr><tr><td>LightGBM</td><td>0.087 ± 0.002</td><td><strong>0.073 ± 0.003</strong></td><td>0.073 ± 0.002</td></tr><tr><td>CatBoost</td><td>0.075 ± 0.002</td><td>0.074 ± 0.003</td><td>0.074 ± 0.003</td></tr><tr><td>EBM</td><td>0.087 ± 0.002</td><td>0.081 ± 0.002</td><td>0.081 ± 0.002</td></tr><tr><td>FastAIMLP</td><td>0.134 ± 0.004</td><td>0.111 ± 0.004</td><td>0.112 ± 0.003</td></tr><tr><td>TorchMLP</td><td>0.094 ± 0.003</td><td>0.081 ± 0.002</td><td>0.080 ± 0.002</td></tr><tr><td>RealMLP</td><td>0.103 ± 0.002</td><td>0.089 ± 0.002</td><td>0.087 ± 0.002</td></tr><tr><td>TabM</td><td>0.097 ± 0.002</td><td>0.083 ± 0.002</td><td>0.083 ± 0.002</td></tr><tr><td>MNCA</td><td>0.082 ± 0.002</td><td>0.076 ± 0.002</td><td>0.075 ± 0.002</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.088 ± 0.001</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.076 ± 0.002</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.146 ± 0.003</td><td>0.145 ± 0.002</td><td>0.135 ± 0.002</td></tr><tr><td>KNN</td><td>0.380 ± 0.030</td><td>0.224 ± 0.003</td><td>0.153 ± 0.003</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.067 ± 0.002</strong></td></tr></tbody></table>
airfoilallel noise (rmse ↓)

<table>
  <thead>
    <tr>
      <th></th>
      <th>Default</th>
      <th>Tuned</th>
      <th>Tuned + Ens.</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>RF</td>
      <td>1.898 ± 0.095</td>
      <td>1.891 ± 0.101</td>
      <td>1.851 ± 0.096</td>
    </tr>
    <tr>
      <td>ExtraTrees</td>
      <td>1.822 ± 0.094</td>
      <td>1.676 ± 0.106</td>
      <td>1.683 ± 0.105</td>
    </tr>
    <tr>
      <td>XGBoost</td>
      <td>1.549 ± 0.104</td>
      <td>1.439 ± 0.104</td>
      <td>1.443 ± 0.104</td>
    </tr>
    <tr>
      <td>LightGBM</td>
      <td>1.554 ± 0.093</td>
      <td>1.480 ± 0.108</td>
      <td>1.451 ± 0.108</td>
    </tr>
    <tr>
      <td>CatBoost</td>
      <td>1.583 ± 0.096</td>
      <td>1.327 ± 0.101</td>
      <td>1.330 ± 0.105</td>
    </tr>
    <tr>
      <td>EBM</td>
      <td>2.010 ± 0.117</td>
      <td>1.955 ± 0.104</td>
      <td>1.935 ± 0.113</td>
    </tr>
    <tr>
      <td>FastAIMLP</td>
      <td>2.32 ± 0.141</td>
      <td>1.624 ± 0.100</td>
      <td>1.646 ± 0.105</td>
    </tr>
    <tr>
      <td>TorchMLP</td>
      <td>1.493 ± 0.113</td>
      <td>1.372 ± 0.105</td>
      <td>1.374 ± 0.098</td>
    </tr>
    <tr>
      <td>RealMLP</td>
      <td>1.179 ± 0.085</td>
      <td>1.146 ± 0.078</td>
      <td>1.109 ± 0.081</td>
    </tr>
    <tr>
      <td>TabM</td>
      <td>1.249 ± 0.099</td>
      <td>1.149 ± 0.092</td>
      <td>1.140 ± 0.088</td>
    </tr>
    <tr>
      <td>MNCA</td>
      <td>1.539 ± 0.095</td>
      <td>1.523 ± 0.137</td>
      <td>1.452 ± 0.099</td>
    </tr>
    <tr>
      <td>TabPFNv2</td>
      <td>1.119 ± 0.088</td>
      <td>1.112 ± 0.102</td>
      <td><u>1.074 ± 0.094</u></td>
    </tr>
    <tr>
      <td>TabDPT</td>
      <td>1.203 ± 0.084</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabICL</td>
      <td>-</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>Linear</td>
      <td>5.344 ± 0.199</td>
      <td>4.752 ± 0.141</td>
      <td>4.732 ± 0.144</td>
    </tr>
    <tr>
      <td>KNN</td>
      <td>3.369 ± 0.113</td>
      <td>2.599 ± 0.154</td>
      <td>2.221 ± 0.122</td>
    </tr>
    <tr>
      <td>AutoGluon</td>
      <td>-</td>
      <td>-</td>
      <td>1.269 ± 0.090</td>
    </tr>
  </tbody>
</table>

anneal (logloss ↓)

<table>
  <thead>
    <tr>
      <th></th>
      <th>Default</th>
      <th>Tuned</th>
      <th>Tuned + Ens.</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>RF</td>
      <td>0.046 ± 0.010</td>
      <td>0.028 ± 0.025</td>
      <td>0.023 ± 0.013</td>
    </tr>
    <tr>
      <td>ExtraTrees</td>
      <td>0.064 ± 0.012</td>
      <td>0.028 ± 0.022</td>
      <td>0.026 ± 0.022</td>
    </tr>
    <tr>
      <td>XGBoost</td>
      <td>0.039 ± 0.025</td>
      <td>0.031 ± 0.025</td>
      <td>0.031 ± 0.025</td>
    </tr>
    <tr>
      <td>LightGBM</td>
      <td>0.055 ± 0.026</td>
      <td>0.033 ± 0.019</td>
      <td>0.034 ± 0.019</td>
    </tr>
    <tr>
      <td>CatBoost</td>
      <td>0.040 ± 0.022</td>
      <td>0.022 ± 0.021</td>
      <td>0.021 ± 0.021</td>
    </tr>
    <tr>
      <td>EBM</td>
      <td>0.043 ± 0.025</td>
      <td>0.036 ± 0.033</td>
      <td>0.034 ± 0.032</td>
    </tr>
    <tr>
      <td>FastAIMLP</td>
      <td>0.085 ± 0.029</td>
      <td>0.056 ± 0.022</td>
      <td>0.054 ± 0.021</td>
    </tr>
    <tr>
      <td>TorchMLP</td>
      <td>0.040 ± 0.034</td>
      <td>0.052 ± 0.044</td>
      <td>0.040 ± 0.038</td>
    </tr>
    <tr>
      <td>RealMLP</td>
      <td>0.039 ± 0.031</td>
      <td>0.029 ± 0.032</td>
      <td>0.024 ± 0.026</td>
    </tr>
    <tr>
      <td>TabM</td>
      <td>0.036 ± 0.026</td>
      <td>0.029 ± 0.027</td>
      <td>0.028 ± 0.025</td>
    </tr>
    <tr>
      <td>MNCA</td>
      <td>0.043 ± 0.031</td>
      <td>0.032 ± 0.038</td>
      <td>0.033 ± 0.039</td>
    </tr>
    <tr>
      <td>TabPFNv2</td>
      <td><u>0.016 ± 0.014</u></td>
      <td><u>0.023 ± 0.019</u></td>
      <td><u>0.019 ± 0.014</u></td>
    </tr>
    <tr>
      <td>TabDPT</td>
      <td>0.058 ± 0.022</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabICL</td>
      <td>0.028 ± 0.014</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>Linear</td>
      <td>0.090 ± 0.028</td>
      <td>0.046 ± 0.032</td>
      <td>0.037 ± 0.024</td>
    </tr>
    <tr>
      <td>KNN</td>
      <td>0.151 ± 0.043</td>
      <td>0.080 ± 0.046</td>
      <td>0.062 ± 0.040</td>
    </tr>
    <tr>
      <td>AutoGluon</td>
      <td>-</td>
      <td>-</td>
      <td>0.037 ± 0.059</td>
    </tr>
  </tbody>
</table>

bank-marketing (AUC ↑)

<table>
  <thead>
    <tr>
      <th></th>
      <th>Default</th>
      <th>Tuned</th>
      <th>Tuned + Ens.</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>RF</td>
      <td>0.726 ± 0.006</td>
      <td>0.761 ± 0.005</td>
      <td>0.761 ± 0.005</td>
    </tr>
    <tr>
      <td>ExtraTrees</td>
      <td>0.721 ± 0.004</td>
      <td>0.758 ± 0.005</td>
      <td>0.758 ± 0.005</td>
    </tr>
    <tr>
      <td>XGBoost</td>
      <td>0.763 ± 0.005</td>
      <td><strong>0.765 ± 0.006</strong></td>
      <td><strong>0.765 ± 0.005</strong></td>
    </tr>
    <tr>
      <td>LightGBM</td>
      <td>0.763 ± 0.005</td>
      <td><strong>0.765 ± 0.005</strong></td>
      <td><strong>0.766 ± 0.005</strong></td>
    </tr>
    <tr>
      <td>CatBoost</td>
      <td><strong>0.766 ± 0.005</strong></td>
      <td><strong>0.766 ± 0.005</strong></td>
      <td><strong>0.765 ± 0.005</strong></td>
    </tr>
    <tr>
      <td>EBM</td>
      <td>0.762 ± 0.005</td>
      <td>0.763 ± 0.005</td>
      <td>0.763 ± 0.005</td>
    </tr>
    <tr>
      <td>FastAIMLP</td>
      <td>0.759 ± 0.005</td>
      <td>0.760 ± 0.006</td>
      <td>0.761 ± 0.005</td>
    </tr>
    <tr>
      <td>TorchMLP</td>
      <td>0.757 ± 0.006</td>
      <td>0.758 ± 0.006</td>
      <td>0.759 ± 0.006</td>
    </tr>
    <tr>
      <td>RealMLP</td>
      <td>0.761 ± 0.005</td>
      <td>0.763 ± 0.005</td>
      <td>0.765 ± 0.005</td>
    </tr>
    <tr>
      <td>TabM</td>
      <td>0.764 ± 0.006</td>
      <td>0.764 ± 0.005</td>
      <td><strong>0.765 ± 0.005</strong></td>
    </tr>
    <tr>
      <td>MNCA</td>
      <td>0.762 ± 0.005</td>
      <td>0.764 ± 0.006</td>
      <td>0.764 ± 0.005</td>
    </tr>
    <tr>
      <td>TabPFNv2</td>
      <td>-</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabDPT</td>
      <td>0.761 ± 0.005</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabICL</td>
      <td>0.764 ± 0.005</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>Linear</td>
      <td>0.748 ± 0.004</td>
      <td>0.748 ± 0.004</td>
      <td>0.748 ± 0.004</td>
    </tr>
    <tr>
      <td>KNN</td>
      <td>0.712 ± 0.005</td>
      <td>0.749 ± 0.006</td>
      <td>0.756 ± 0.005</td>
    </tr>
    <tr>
      <td>AutoGluon</td>
      <td>-</td>
      <td>-</td>
      <td><strong>0.765 ± 0.006</strong></td>
    </tr>
  </tbody>
</table>

blood-transfusion-service-center (AUC ↑)

<table>
  <thead>
    <tr>
      <th></th>
      <th>Default</th>
      <th>Tuned</th>
      <th>Tuned + Ens.</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>RF</td>
      <td>0.682 ± 0.026</td>
      <td>0.714 ± 0.029</td>
      <td>0.713 ± 0.029</td>
    </tr>
    <tr>
      <td>ExtraTrees</td>
      <td>0.689 ± 0.025</td>
      <td>0.728 ± 0.033</td>
      <td>0.727 ± 0.031</td>
    </tr>
    <tr>
      <td>XGBoost</td>
      <td>0.708 ± 0.030</td>
      <td>0.733 ± 0.031</td>
      <td>0.731 ± 0.031</td>
    </tr>
    <tr>
      <td>LightGBM</td>
      <td>0.726 ± 0.033</td>
      <td>0.743 ± 0.033</td>
      <td>0.743 ± 0.031</td>
    </tr>
    <tr>
      <td>CatBoost</td>
      <td>0.738 ± 0.029</td>
      <td>0.737 ± 0.031</td>
      <td>0.736 ± 0.031</td>
    </tr>
    <tr>
      <td>EBM</td>
      <td>0.742 ± 0.032</td>
      <td>0.743 ± 0.033</td>
      <td>0.743 ± 0.033</td>
    </tr>
    <tr>
      <td>FastAIMLP</td>
      <td>0.743 ± 0.030</td>
      <td><strong>0.754 ± 0.030</strong></td>
      <td><strong>0.756 ± 0.030</strong></td>
    </tr>
    <tr>
      <td>TorchMLP</td>
      <td>0.749 ± 0.032</td>
      <td>0.747 ± 0.030</td>
      <td>0.748 ± 0.030</td>
    </tr>
    <tr>
      <td>RealMLP</td>
      <td>0.750 ± 0.030</td>
      <td>0.737 ± 0.029</td>
      <td>0.742 ± 0.027</td>
    </tr>
    <tr>
      <td>TabM</td>
      <td>0.741 ± 0.029</td>
      <td>0.737 ± 0.031</td>
      <td>0.741 ± 0.029</td>
    </tr>
    <tr>
      <td>MNCA</td>
      <td><strong>0.756 ± 0.030</strong></td>
      <td>0.737 ± 0.032</td>
      <td>0.715 ± 0.030</td>
    </tr>
    <tr>
      <td>TabPFNv2</td>
      <td><strong>0.755 ± 0.029</strong></td>
      <td>0.748 ± 0.034</td>
      <td>0.746 ± 0.030</td>
    </tr>
    <tr>
      <td>TabDPT</td>
      <td>0.751 ± 0.030</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabICL</td>
      <td>0.737 ± 0.031</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>Linear</td>
      <td>0.731 ± 0.032</td>
      <td>0.749 ± 0.029</td>
      <td><strong>0.754 ± 0.026</strong></td>
    </tr>
    <tr>
      <td>KNN</td>
      <td>0.688 ± 0.023</td>
      <td>0.727 ± 0.033</td>
      <td>0.736 ± 0.034</td>
    </tr>
    <tr>
      <td>AutoGluon</td>
      <td>-</td>
      <td>-</td>
      <td>0.748 ± 0.032</td>
    </tr>
  </tbody>
</table>

churn (AUC ↑)

<table>
  <thead>
    <tr>
      <th></th>
      <th>Default</th>
      <th>Tuned</th>
      <th>Tuned + Ens.</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>RF</td>
      <td>0.915 ± 0.009</td>
      <td>0.913 ± 0.012</td>
      <td>0.913 ± 0.011</td>
    </tr>
    <tr>
      <td>ExtraTrees</td>
      <td>0.917 ± 0.011</td>
      <td>0.919 ± 0.011</td>
      <td>0.921 ± 0.011</td>
    </tr>
    <tr>
      <td>XGBoost</td>
      <td>0.923 ± 0.009</td>
      <td>0.921 ± 0.011</td>
      <td>0.920 ± 0.011</td>
    </tr>
    <tr>
      <td>LightGBM</td>
      <td>0.916 ± 0.011</td>
      <td>0.920 ± 0.011</td>
      <td>0.920 ± 0.011</td>
    </tr>
    <tr>
      <td>CatBoost</td>
      <td>0.924 ± 0.011</td>
      <td>0.920 ± 0.012</td>
      <td>0.922 ± 0.011</td>
    </tr>
    <tr>
      <td>EBM</td>
      <td><u>0.922 ± 0.014</u></td>
      <td>0.924 ± 0.011</td>
      <td>0.924 ± 0.011</td>
    </tr>
    <tr>
      <td>FastAIMLP</td>
      <td><u>0.918 ± 0.011</u></td>
      <td>0.921 ± 0.009</td>
      <td>0.921 ± 0.010</td>
    </tr>
    <tr>
      <td>TorchMLP</td>
      <td>0.888 ± 0.009</td>
      <td>0.918 ± 0.010</td>
      <td>0.918 ± 0.011</td>
    </tr>
    <tr>
      <td>RealMLP</td>
      <td>0.920 ± 0.010</td>
      <td>0.924 ± 0.012</td>
      <td>0.927 ± 0.011</td>
    </tr>
    <tr>
      <td>TabM</td>
      <td>0.925 ± 0.011</td>
      <td>0.923 ± 0.010</td>
      <td>0.923 ± 0.010</td>
    </tr>
    <tr>
      <td>MNCA</td>
      <td>0.903 ± 0.013</td>
      <td><u>0.932 ± 0.013</u></td>
      <td><u>0.931 ± 0.013</u></td>
    </tr>
    <tr>
      <td>TabPFNv2</td>
      <td><strong>0.928 ± 0.011</strong></td>
      <td><strong>0.925 ± 0.008</strong></td>
      <td><strong>0.924 ± 0.010</strong></td>
    </tr>
    <tr>
      <td>TabDPT</td>
      <td>0.926 ± 0.009</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabICL</td>
      <td>0.924 ± 0.011</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>Linear</td>
      <td>0.777 ± 0.018</td>
      <td>0.825 ± 0.008</td>
      <td>0.825 ± 0.008</td>
    </tr>
    <tr>
      <td>KNN</td>
      <td>0.866 ± 0.004</td>
      <td>0.892 ± 0.010</td>
      <td>0.899 ± 0.010</td>
    </tr>
    <tr>
      <td>AutoGluon</td>
      <td>-</td>
      <td>-</td>
      <td>0.922 ± 0.011</td>
    </tr>
  </tbody>
</table>

coil2000_insurance_policies (AUC ↑)

<table>
  <thead>
    <tr>
      <th></th>
      <th>Default</th>
      <th>Tuned</th>
      <th>Tuned + Ens.</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>RF</td>
      <td>0.697 ± 0.014</td>
      <td>0.741 ± 0.017</td>
      <td>0.742 ± 0.016</td>
    </tr>
    <tr>
      <td>ExtraTrees</td>
      <td>0.696 ± 0.016</td>
      <td>0.744 ± 0.016</td>
      <td>0.748 ± 0.017</td>
    </tr>
    <tr>
      <td>XGBoost</td>
      <td><u>0.757 ± 0.015</u></td>
      <td><u>0.757 ± 0.016</u></td>
      <td><u>0.758 ± 0.014</u></td>
    </tr>
    <tr>
      <td>LightGBM</td>
      <td>0.752 ± 0.014</td>
      <td>0.759 ± 0.015</td>
      <td>0.761 ± 0.015</td>
    </tr>
    <tr>
      <td>CatBoost</td>
      <td>0.757 ± 0.014</td>
      <td>0.758 ± 0.013</td>
      <td>0.759 ± 0.012</td>
    </tr>
    <tr>
      <td>EBM</td>
      <td>0.754 ± 0.014</td>
      <td>0.757 ± 0.013</td>
      <td>0.761 ± 0.013</td>
    </tr>
    <tr>
      <td>FastAIMLP</td>
      <td>0.719 ± 0.010</td>
      <td>0.749 ± 0.013</td>
      <td>0.747 ± 0.013</td>
    </tr>
    <tr>
      <td>TorchMLP</td>
      <td>0.740 ± 0.011</td>
      <td>0.747 ± 0.015</td>
      <td>0.752 ± 0.014</td>
    </tr>
    <tr>
      <td>RealMLP</td>
      <td>0.742 ± 0.012</td>
      <td>0.755 ± 0.011</td>
      <td>0.763 ± 0.013</td>
    </tr>
    <tr>
      <td>TabM</td>
      <td>0.761 ± 0.012</td>
      <td>0.763 ± 0.012</td>
      <td>0.766 ± 0.012</td>
    </tr>
    <tr>
      <td>MNCA</td>
      <td>0.753 ± 0.013</td>
      <td>0.757 ± 0.015</td>
      <td><strong>0.767 ± 0.012</strong></td>
    </tr>
    <tr>
      <td>TabPFNv2</td>
      <td>0.753 ± 0.015</td>
      <td><strong>0.773 ± 0.015</strong></td>
      <td><strong>0.773 ± 0.014</strong></td>
    </tr>
    <tr>
      <td>TabDPT</td>
      <td>0.725 ± 0.010</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>TabICL</td>
      <td>0.756 ± 0.012</td>
      <td>-</td>
      <td>-</td>
    </tr>
    <tr>
      <td>Linear</td>
      <td>0.737 ± 0.012</td>
      <td>0.739 ± 0.011</td>
      <td>0.740 ± 0.012</td>
    </tr>
    <tr>
      <td>KNN</td>
      <td>0.657 ± 0.020</td>
      <td>0.718 ± 0.015</td>
      <td>0.732 ± 0.014</td>
    </tr>
    <tr>
      <td>AutoGluon</td>
      <td>-</td>
      <td>-</td>
      <td>0.759 ± 0.016</td>
    </tr>
  </tbody>
</table>
concrete_compressive_strength (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>5.261 ± 0.336</td><td>5.189 ± 0.366</td><td>5.106 ± 0.352</td></tr><tr><td>ExtraTrees</td><td>5.139 ± 0.341</td><td>5.073 ± 0.333</td><td>5.048 ± 0.348</td></tr><tr><td>XGBoost</td><td>4.755 ± 0.387</td><td>4.236 ± 0.373</td><td>4.222 ± 0.384</td></tr><tr><td>LightGBM</td><td>4.484 ± 0.388</td><td>4.235 ± 0.395</td><td>4.212 ± 0.396</td></tr><tr><td>CatBoost</td><td>4.214 ± 0.413</td><td>4.231 ± 0.415</td><td>4.209 ± 0.411</td></tr><tr><td>EBM</td><td>4.442 ± 0.295</td><td>4.429 ± 0.331</td><td>4.371 ± 0.308</td></tr><tr><td>FastAIMLP</td><td>6.369 ± 0.379</td><td>5.181 ± 0.355</td><td>5.272 ± 0.360</td></tr><tr><td>TorchMLP</td><td>4.817 ± 0.354</td><td>4.715 ± 0.350</td><td>4.654 ± 0.334</td></tr><tr><td>RealMLP</td><td>4.688 ± 0.364</td><td>4.344 ± 0.289</td><td><strong>4.133 ± 0.329</strong></td></tr><tr><td>TabM</td><td>4.271 ± 0.385</td><td>4.269 ± 0.496</td><td><strong>4.146 ± 0.409</strong></td></tr><tr><td>MNCA</td><td>4.940 ± 0.309</td><td>4.749 ± 0.424</td><td>4.487 ± 0.388</td></tr><tr><td>TabPFNv2</td><td>4.259 ± 0.379</td><td>4.171 ± 0.439</td><td><strong>4.118 ± 0.409</strong></td></tr><tr><td>TabDPT</td><td>4.267 ± 0.422</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>8.228 ± 0.359</td><td>8.160 ± 0.362</td><td>8.153 ± 0.354</td></tr><tr><td>KNN</td><td>8.972 ± 0.464</td><td>6.762 ± 0.565</td><td>6.548 ± 0.555</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>4.165 ± 0.389</strong></td></tr></tbody></table>

credit-g (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.783 ± 0.017</td><td>0.781 ± 0.019</td><td>0.782 ± 0.019</td></tr><tr><td>ExtraTrees</td><td>0.779 ± 0.019</td><td>0.781 ± 0.018</td><td>0.782 ± 0.018</td></tr><tr><td>XGBoost</td><td>0.783 ± 0.021</td><td>0.792 ± 0.021</td><td>0.793 ± 0.021</td></tr><tr><td>LightGBM</td><td>0.771 ± 0.019</td><td>0.792 ± 0.020</td><td><strong>0.796 ± 0.020</strong></td></tr><tr><td>CatBoost</td><td>0.789 ± 0.017</td><td><strong>0.795 ± 0.020</strong></td><td><strong>0.795 ± 0.017</strong></td></tr><tr><td>EBM</td><td>0.790 ± 0.021</td><td>0.782 ± 0.025</td><td>0.787 ± 0.023</td></tr><tr><td>FastAIMLP</td><td>0.783 ± 0.029</td><td>0.784 ± 0.025</td><td><strong>0.793 ± 0.023</strong></td></tr><tr><td>TorchMLP</td><td>0.772 ± 0.017</td><td>0.782 ± 0.020</td><td>0.788 ± 0.020</td></tr><tr><td>RealMLP</td><td>0.785 ± 0.022</td><td>0.784 ± 0.023</td><td>0.791 ± 0.020</td></tr><tr><td>TabM</td><td>0.793 ± 0.022</td><td>0.790 ± 0.020</td><td><strong>0.795 ± 0.020</strong></td></tr><tr><td>MNCA</td><td>0.783 ± 0.020</td><td>0.783 ± 0.020</td><td>0.775 ± 0.021</td></tr><tr><td>TabPFNv2</td><td>0.776 ± 0.019</td><td>0.773 ± 0.020</td><td>0.792 ± 0.020</td></tr><tr><td>TabDPT</td><td>0.780 ± 0.019</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.790 ± 0.017</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.781 ± 0.021</td><td>0.787 ± 0.021</td><td>0.787 ± 0.021</td></tr><tr><td>KNN</td><td>0.756 ± 0.031</td><td>0.778 ± 0.022</td><td>0.784 ± 0.022</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.794 ± 0.020</strong></td></tr></tbody></table>

credit Card_clients_default (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.765 ± 0.005</td><td>0.780 ± 0.004</td><td>0.780 ± 0.004</td></tr><tr><td>ExtraTrees</td><td>0.766 ± 0.004</td><td>0.781 ± 0.004</td><td>0.782 ± 0.004</td></tr><tr><td>XGBoost</td><td>0.783 ± 0.004</td><td>0.785 ± 0.004</td><td>0.785 ± 0.004</td></tr><tr><td>LightGBM</td><td>0.784 ± 0.004</td><td>0.785 ± 0.004</td><td>0.785 ± 0.004</td></tr><tr><td>CatBoost</td><td>0.784 ± 0.004</td><td>0.785 ± 0.004</td><td>0.785 ± 0.004</td></tr><tr><td>EBM</td><td>0.783 ± 0.004</td><td>0.783 ± 0.004</td><td>0.784 ± 0.004</td></tr><tr><td>FastAIMLP</td><td>0.781 ± 0.005</td><td>0.783 ± 0.005</td><td>0.783 ± 0.005</td></tr><tr><td>TorchMLP</td><td>0.779 ± 0.003</td><td>0.783 ± 0.003</td><td>0.785 ± 0.003</td></tr><tr><td>RealMLP</td><td>0.785 ± 0.004</td><td>0.785 ± 0.005</td><td>0.786 ± 0.004</td></tr><tr><td>TabM</td><td>0.784 ± 0.004</td><td><strong>0.788 ± 0.004</strong></td><td><strong>0.788 ± 0.004</strong></td></tr><tr><td>MNCA</td><td>0.781 ± 0.004</td><td>0.787 ± 0.003</td><td><strong>0.787 ± 0.004</strong></td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.780 ± 0.004</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><strong>0.788 ± 0.004</strong></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.745 ± 0.004</td><td>0.745 ± 0.004</td><td>0.745 ± 0.004</td></tr><tr><td>KNN</td><td>0.736 ± 0.004</td><td>0.758 ± 0.004</td><td>0.769 ± 0.004</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.787 ± 0.004</strong></td></tr></tbody></table>

customer_satisfaction_in_airline (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.993 ± 0.000</td><td>0.993 ± 0.000</td><td>0.993 ± 0.000</td></tr><tr><td>ExtraTrees</td><td>0.992 ± 0.000</td><td>0.994 ± 0.000</td><td>0.994 ± 0.000</td></tr><tr><td>XGBoost</td><td>0.994 ± 0.000</td><td>0.994 ± 0.000</td><td>0.994 ± 0.000</td></tr><tr><td>LightGBM</td><td>0.994 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>CatBoost</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>EBM</td><td>0.985 ± 0.000</td><td>0.986 ± 0.001</td><td>0.986 ± 0.001</td></tr><tr><td>FastAIMLP</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>TorchMLP</td><td>0.993 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>RealMLP</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>TabM</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>MNCA</td><td>0.993 ± 0.000</td><td>0.995 ± 0.000</td><td>0.995 ± 0.000</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.994 ± 0.000</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.995 ± 0.000</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.964 ± 0.001</td><td>0.964 ± 0.001</td><td>0.965 ± 0.001</td></tr><tr><td>KNN</td><td>0.985 ± 0.000</td><td>0.985 ± 0.000</td><td>0.988 ± 0.000</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.996 ± 0.000</strong></td></tr></tbody></table>

diabetes (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.825 ± 0.023</td><td>0.830 ± 0.025</td><td>0.830 ± 0.024</td></tr><tr><td>ExtraTrees</td><td>0.826 ± 0.022</td><td>0.837 ± 0.021</td><td><strong>0.837 ± 0.021</strong></td></tr><tr><td>XGBoost</td><td>0.824 ± 0.024</td><td>0.830 ± 0.024</td><td>0.832 ± 0.024</td></tr><tr><td>LightGBM</td><td>0.829 ± 0.025</td><td>0.838 ± 0.026</td><td>0.837 ± 0.025</td></tr><tr><td>CatBoost</td><td>0.833 ± 0.025</td><td>0.834 ± 0.025</td><td>0.835 ± 0.024</td></tr><tr><td>EBM</td><td>0.840 ± 0.025</td><td>0.839 ± 0.023</td><td>0.840 ± 0.023</td></tr><tr><td>FastAIMLP</td><td>0.826 ± 0.024</td><td>0.832 ± 0.023</td><td>0.835 ± 0.023</td></tr><tr><td>TorchMLP</td><td>0.821 ± 0.024</td><td>0.825 ± 0.026</td><td>0.827 ± 0.025</td></tr><tr><td>RealMLP</td><td>0.833 ± 0.023</td><td>0.832 ± 0.022</td><td>0.836 ± 0.024</td></tr><tr><td>TabM</td><td>0.832 ± 0.024</td><td>0.830 ± 0.024</td><td>0.834 ± 0.024</td></tr><tr><td>MNCA</td><td>0.839 ± 0.024</td><td>0.834 ± 0.024</td><td>0.813 ± 0.022</td></tr><tr><td>TabPFNv2</td><td><strong>0.844 ± 0.023</strong></td><td><strong>0.842 ± 0.024</strong></td><td><strong>0.839 ± 0.024</strong></td></tr><tr><td>TabDPT</td><td>0.840 ± 0.023</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.837 ± 0.023</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.832 ± 0.024</td><td>0.830 ± 0.023</td><td>0.831 ± 0.023</td></tr><tr><td>KNN</td><td>0.811 ± 0.023</td><td>0.823 ± 0.025</td><td>0.823 ± 0.025</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.835 ± 0.023</td></tr></tbody></table>

diamonds (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>549.9 ± 8.3</td><td>549.9 ± 8.3</td><td>547.2 ± 9.3</td></tr><tr><td>ExtraTrees</td><td>536.6 ± 8.7</td><td>536.3 ± 9.1</td><td>534.6 ± 8.9</td></tr><tr><td>XGBoost</td><td>539.0 ± 10.0</td><td>530.1 ± 10.0</td><td>528.2 ± 10.9</td></tr><tr><td>LightGBM</td><td>532.1 ± 9.1</td><td>524.9 ± 9.7</td><td>519.0 ± 9.4</td></tr><tr><td>CatBoost</td><td>520.7 ± 12.0</td><td>520.7 ± 12.0</td><td>520.8 ± 11.8</td></tr><tr><td>EBM</td><td>618.2 ± 14.5</td><td>613.7 ± 11.9</td><td>612.4 ± 13.9</td></tr><tr><td>FastAIMLP</td><td>563.1 ± 15.0</td><td>559.4 ± 9.4</td><td>550.0 ± 8.9</td></tr><tr><td>TorchMLP</td><td>627.3 ± 25.8</td><td>550.5 ± 16.6</td><td>542.6 ± 15.2</td></tr><tr><td>RealMLP</td><td>529.6 ± 8.1</td><td>521.5 ± 7.6</td><td>513.7 ± 7.3</td></tr><tr><td>TabM</td><td>522.5 ± 8.9</td><td>521.5 ± 8.1</td><td>518.9 ± 8.8</td></tr><tr><td>MNCA</td><td>524.7 ± 8.7</td><td>521.1 ± 7.5</td><td><strong>510.3 ± 8.1</strong></td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>535.4 ± 13.1</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>1652.8 ± 179.7</td><td>1139.6 ± 27.1</td><td>1140.3 ± 28.0</td></tr><tr><td>KNN</td><td>957.3 ± 22.1</td><td>706.9 ± 15.5</td><td>668.3 ± 14.2</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>510.5 ± 9.5</strong></td></tr></tbody></table>
hazelnut-spread-contaminant-detection (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.958 ± 0.006</td><td>0.959 ± 0.006</td><td>0.960 ± 0.006</td></tr><tr><td>ExtraTrees</td><td>0.955 ± 0.006</td><td>0.964 ± 0.005</td><td>0.964 ± 0.005</td></tr><tr><td>XGBoost</td><td>0.973 ± 0.005</td><td>0.975 ± 0.004</td><td>0.975 ± 0.004</td></tr><tr><td>LightGBM</td><td>0.973 ± 0.005</td><td>0.978 ± 0.004</td><td>0.978 ± 0.004</td></tr><tr><td>CatBoost</td><td>0.974 ± 0.004</td><td>0.975 ± 0.004</td><td>0.974 ± 0.004</td></tr><tr><td>EBM</td><td>0.971 ± 0.005</td><td>0.975 ± 0.004</td><td>0.976 ± 0.004</td></tr><tr><td>FastAIMLP</td><td>0.983 ± 0.003</td><td>0.986 ± 0.003</td><td>0.986 ± 0.003</td></tr><tr><td>TorchMLP</td><td>0.983 ± 0.003</td><td>0.987 ± 0.003</td><td>0.987 ± 0.003</td></tr><tr><td>RealMLP</td><td>0.984 ± 0.003</td><td>0.986 ± 0.003</td><td>0.986 ± 0.003</td></tr><tr><td>TabM</td><td>0.967 ± 0.005</td><td>0.984 ± 0.003</td><td>0.985 ± 0.003</td></tr><tr><td>MNCA</td><td>0.986 ± 0.003</td><td><u>0.988 ± 0.003</u></td><td>0.988 ± 0.003</td></tr><tr><td>TabPFNv2</td><td>0.988 ± 0.003</td><td><u>0.989 ± 0.003</u></td><td><u>0.989 ± 0.003</u></td></tr><tr><td>TabDPT</td><td><u>0.992 ± 0.002</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.992 ± 0.002</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.948 ± 0.006</td><td>0.952 ± 0.006</td><td>0.953 ± 0.006</td></tr><tr><td>KNN</td><td>0.914 ± 0.009</td><td>0.934 ± 0.009</td><td>0.943 ± 0.008</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.987 ± 0.003</td></tr></tbody></table>

healthcare_insurance_expenses (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>4888.5 ± 289.2</td><td>4641.1 ± 303.6</td><td>4629.6 ± 302.9</td></tr><tr><td>ExtraTrees</td><td>4844.9 ± 274.8</td><td>4607.0 ± 324.0</td><td>4609.9 ± 323.0</td></tr><tr><td>XGBoost</td><td>4672.0 ± 306.3</td><td>4523.3 ± 319.7</td><td>4519.6 ± 320.2</td></tr><tr><td>LightGBM</td><td>4610.4 ± 313.8</td><td>4525.1 ± 329.2</td><td>4511.9 ± 325.5</td></tr><tr><td>CatBoost</td><td>4535.4 ± 328.8</td><td>4518.2 ± 321.8</td><td>4519.2 ± 321.1</td></tr><tr><td>EBM</td><td>4549.2 ± 318.8</td><td><u>4499.7 ± 333.4</u></td><td><u>4499.3 ± 325.7</u></td></tr><tr><td>FastAIMLP</td><td>4720.2 ± 313.1</td><td>4633.9 ± 317.7</td><td>4624.2 ± 311.0</td></tr><tr><td>TorchMLP</td><td>4661.1 ± 342.8</td><td>4526.1 ± 328.6</td><td>4534.0 ± 333.3</td></tr><tr><td>RealMLP</td><td>4579.2 ± 313.2</td><td>4570.6 ± 323.5</td><td>4534.8 ± 323.1</td></tr><tr><td>TabM</td><td>4513.7 ± 323.4</td><td>4530.0 ± 323.1</td><td>4510.9 ± 325.7</td></tr><tr><td>MNCA</td><td>4605.4 ± 332.0</td><td>4614.4 ± 330.3</td><td>4589.2 ± 331.3</td></tr><tr><td>TabPFNv2</td><td>4694.7 ± 302.6</td><td>4650.3 ± 336.9</td><td>4567.7 ± 318.7</td></tr><tr><td>TabDPT</td><td><u>4508.4 ± 295.4</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>6083.4 ± 275.9</td><td>6085.5 ± 275.8</td><td>6084.5 ± 276.6</td></tr><tr><td>KNN</td><td>5797.5 ± 392.9</td><td>5058.7 ± 315.5</td><td>5024.4 ± 319.8</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><u>4490.4 ± 331.9</u></td></tr></tbody></table>

heloc (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.791 ± 0.005</td><td>0.792 ± 0.006</td><td>0.793 ± 0.005</td></tr><tr><td>ExtraTrees</td><td>0.790 ± 0.005</td><td>0.793 ± 0.005</td><td>0.793 ± 0.005</td></tr><tr><td>XGBoost</td><td>0.794 ± 0.005</td><td>0.797 ± 0.005</td><td>0.797 ± 0.005</td></tr><tr><td>LightGBM</td><td>0.794 ± 0.005</td><td>0.799 ± 0.005</td><td>0.799 ± 0.005</td></tr><tr><td>CatBoost</td><td>0.798 ± 0.004</td><td>0.798 ± 0.005</td><td>0.798 ± 0.004</td></tr><tr><td>EBM</td><td>0.799 ± 0.005</td><td>0.799 ± 0.005</td><td>0.799 ± 0.005</td></tr><tr><td>FastAIMLP</td><td>0.791 ± 0.004</td><td>0.794 ± 0.005</td><td>0.795 ± 0.005</td></tr><tr><td>TorchMLP</td><td>0.791 ± 0.004</td><td>0.795 ± 0.004</td><td>0.796 ± 0.004</td></tr><tr><td>RealMLP</td><td>0.798 ± 0.004</td><td>0.798 ± 0.004</td><td>0.800 ± 0.004</td></tr><tr><td>TabM</td><td>0.797 ± 0.004</td><td>0.799 ± 0.004</td><td>0.799 ± 0.004</td></tr><tr><td>MNCA</td><td>0.799 ± 0.004</td><td><u>0.801 ± 0.005</u></td><td>0.799 ± 0.005</td></tr><tr><td>TabPFNv2</td><td><u>0.801 ± 0.003</u></td><td><u>0.801 ± 0.004</u></td><td><u>0.801 ± 0.003</u></td></tr><tr><td>TabDPT</td><td>0.794 ± 0.004</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.800 ± 0.004</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.786 ± 0.005</td><td>0.786 ± 0.005</td><td>0.786 ± 0.005</td></tr><tr><td>KNN</td><td>0.743 ± 0.004</td><td>0.788 ± 0.005</td><td>0.788 ± 0.004</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.798 ± 0.005</td></tr></tbody></table>

hiva_agnostic (logloss ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.263 ± 0.025</td><td><u>0.174 ± 0.001</u></td><td><u>0.174 ± 0.001</u></td></tr><tr><td>ExtraTrees</td><td>0.268 ± 0.027</td><td><u>0.174 ± 0.000</u></td><td><u>0.174 ± 0.000</u></td></tr><tr><td>XGBoost</td><td>0.182 ± 0.002</td><td>0.179 ± 0.002</td><td>0.179 ± 0.002</td></tr><tr><td>LightGBM</td><td>0.175 ± 0.001</td><td>0.175 ± 0.001</td><td>0.175 ± 0.001</td></tr><tr><td>CatBoost</td><td>0.176 ± 0.001</td><td>0.177 ± 0.002</td><td>0.177 ± 0.002</td></tr><tr><td>EBM</td><td><u>0.174 ± 0.001</u></td><td>0.176 ± 0.001</td><td>0.175 ± 0.001</td></tr><tr><td>FastAIMLP</td><td>0.213 ± 0.010</td><td>0.183 ± 0.008</td><td>0.183 ± 0.004</td></tr><tr><td>TorchMLP</td><td>0.183 ± 0.005</td><td>0.176 ± 0.001</td><td>0.178 ± 0.003</td></tr><tr><td>RealMLP</td><td>0.196 ± 0.007</td><td>0.176 ± 0.002</td><td>0.179 ± 0.002</td></tr><tr><td>TabM</td><td>0.177 ± 0.001</td><td>0.175 ± 0.001</td><td>0.175 ± 0.001</td></tr><tr><td>MNCA</td><td>0.224 ± 0.012</td><td>0.176 ± 0.002</td><td>0.179 ± 0.002</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.181 ± 0.004</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.448 ± 0.024</td><td>0.335 ± 0.019</td><td>0.335 ± 0.019</td></tr><tr><td>KNN</td><td>0.468 ± 0.017</td><td>0.176 ± 0.003</td><td>0.176 ± 0.003</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.193 ± 0.027</td></tr></tbody></table>

houses (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.231 ± 0.002</td><td>0.231 ± 0.002</td><td>0.230 ± 0.002</td></tr><tr><td>ExtraTrees</td><td>0.243 ± 0.002</td><td>0.238 ± 0.002</td><td>0.238 ± 0.002</td></tr><tr><td>XGBoost</td><td>0.215 ± 0.003</td><td>0.215 ± 0.002</td><td>0.215 ± 0.002</td></tr><tr><td>LightGBM</td><td>0.217 ± 0.002</td><td>0.212 ± 0.002</td><td>0.211 ± 0.002</td></tr><tr><td>CatBoost</td><td>0.211 ± 0.002</td><td>0.211 ± 0.002</td><td>0.211 ± 0.002</td></tr><tr><td>EBM</td><td>0.231 ± 0.003</td><td>0.229 ± 0.003</td><td>0.228 ± 0.003</td></tr><tr><td>FastAIMLP</td><td>0.244 ± 0.001</td><td>0.236 ± 0.002</td><td>0.235 ± 0.001</td></tr><tr><td>TorchMLP</td><td>0.233 ± 0.003</td><td>0.228 ± 0.003</td><td>0.226 ± 0.002</td></tr><tr><td>RealMLP</td><td>0.223 ± 0.002</td><td>0.211 ± 0.003</td><td>0.203 ± 0.003</td></tr><tr><td>TabM</td><td>0.212 ± 0.002</td><td>0.208 ± 0.002</td><td>0.205 ± 0.002</td></tr><tr><td>MNCA</td><td>0.204 ± 0.003</td><td><u>0.203 ± 0.003</u></td><td><u>0.199 ± 0.002</u></td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.209 ± 0.003</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.325 ± 0.003</td><td>0.325 ± 0.003</td><td>0.323 ± 0.003</td></tr><tr><td>KNN</td><td>0.290 ± 0.002</td><td>0.282 ± 0.002</td><td>0.273 ± 0.002</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.204 ± 0.002</td></tr></tbody></table>

inVehicle_coupon_re recommendation (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.812 ± 0.007</td><td>0.817 ± 0.008</td><td>0.822 ± 0.008</td></tr><tr><td>ExtraTrees</td><td>0.798 ± 0.007</td><td>0.804 ± 0.008</td><td>0.811 ± 0.008</td></tr><tr><td>XGBoost</td><td>0.832 ± 0.004</td><td>0.842 ± 0.005</td><td>0.843 ± 0.005</td></tr><tr><td>LightGBM</td><td>0.836 ± 0.005</td><td>0.844 ± 0.005</td><td>0.845 ± 0.005</td></tr><tr><td>CatBoost</td><td>0.840 ± 0.006</td><td>0.843 ± 0.005</td><td>0.844 ± 0.006</td></tr><tr><td>EBM</td><td>0.802 ± 0.006</td><td>0.807 ± 0.006</td><td>0.807 ± 0.006</td></tr><tr><td>FastAIMLP</td><td>0.810 ± 0.007</td><td>0.823 ± 0.007</td><td>0.826 ± 0.006</td></tr><tr><td>TorchMLP</td><td>0.825 ± 0.004</td><td>0.833 ± 0.008</td><td>0.841 ± 0.006</td></tr><tr><td>RealMLP</td><td>0.837 ± 0.006</td><td>0.839 ± 0.006</td><td>0.849 ± 0.006</td></tr><tr><td>TabM</td><td>0.848 ± 0.005</td><td>0.851 ± 0.006</td><td><u>0.852 ± 0.006</u></td></tr><tr><td>MNCA</td><td>0.812 ± 0.006</td><td>0.842 ± 0.006</td><td>0.849 ± 0.006</td></tr><tr><td>TabPFNv2</td><td>0.789 ± 0.008</td><td>0.806 ± 0.008</td><td>0.837 ± 0.007</td></tr><tr><td>TabDPT</td><td>0.798 ± 0.005</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.846 ± 0.006</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.735 ± 0.007</td><td>0.735 ± 0.007</td><td>0.735 ± 0.007</td></tr><tr><td>KNN</td><td>0.728 ± 0.009</td><td>0.778 ± 0.007</td><td>0.807 ± 0.006</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.847 ± 0.006</td></tr></tbody></table>
jm1 (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.752 ± 0.008</td><td>0.752 ± 0.008</td><td>0.761 ± 0.007</td></tr><tr><td>ExtraTrees</td><td>0.756 ± 0.007</td><td>0.758 ± 0.008</td><td>0.765 ± 0.006</td></tr><tr><td>XGBoost</td><td>0.748 ± 0.007</td><td>0.749 ± 0.007</td><td>0.752 ± 0.006</td></tr><tr><td>LightGBM</td><td>0.748 ± 0.006</td><td>0.751 ± 0.006</td><td>0.753 ± 0.006</td></tr><tr><td>CatBoost</td><td>0.744 ± 0.005</td><td>0.751 ± 0.005</td><td>0.749 ± 0.005</td></tr><tr><td>EBM</td><td>0.735 ± 0.006</td><td>0.734 ± 0.007</td><td>0.736 ± 0.007</td></tr><tr><td>FastAIMLP</td><td>0.728 ± 0.007</td><td>0.728 ± 0.007</td><td>0.733 ± 0.006</td></tr><tr><td>TorchMLP</td><td>0.728 ± 0.005</td><td>0.734 ± 0.005</td><td>0.736 ± 0.005</td></tr><tr><td>RealMLP</td><td>0.731 ± 0.007</td><td>0.735 ± 0.007</td><td>0.749 ± 0.007</td></tr><tr><td>TabM</td><td>0.733 ± 0.007</td><td>0.738 ± 0.004</td><td>0.746 ± 0.006</td></tr><tr><td>MNCA</td><td>0.762 ± 0.003</td><td>0.761 ± 0.006</td><td>0.769 ± 0.006</td></tr><tr><td>TabPFNv2</td><td>0.732 ± 0.008</td><td>0.755 ± 0.007</td><td>0.773 ± 0.006</td></tr><tr><td>TabDPT</td><td>0.771 ± 0.005</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.776 ± 0.005</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.724 ± 0.006</td><td>0.723 ± 0.006</td><td>0.724 ± 0.006</td></tr><tr><td>KNN</td><td>0.740 ± 0.007</td><td>0.750 ± 0.007</td><td>0.761 ± 0.007</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.760 ± 0.007</td></tr></tbody></table>

kddcup09_appetency (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.772 ± 0.016</td><td>0.822 ± 0.011</td><td>0.821 ± 0.010</td></tr><tr><td>ExtraTrees</td><td>0.771 ± 0.012</td><td>0.819 ± 0.012</td><td>0.821 ± 0.009</td></tr><tr><td>XGBoost</td><td>0.830 ± 0.012</td><td>0.833 ± 0.009</td><td>0.837 ± 0.010</td></tr><tr><td>LightGBM</td><td>0.798 ± 0.009</td><td>0.821 ± 0.009</td><td>0.829 ± 0.010</td></tr><tr><td>CatBoost</td><td><u>0.846 ± 0.008</u></td><td><u>0.845 ± 0.008</u></td><td><u>0.845 ± 0.008</u></td></tr><tr><td>EBM</td><td>0.826 ± 0.009</td><td>0.831 ± 0.010</td><td>0.833 ± 0.010</td></tr><tr><td>FastAIMLP</td><td>0.749 ± 0.023</td><td>0.795 ± 0.013</td><td>0.804 ± 0.014</td></tr><tr><td>TorchMLP</td><td>0.819 ± 0.012</td><td>0.826 ± 0.012</td><td>0.831 ± 0.013</td></tr><tr><td>RealMLP</td><td>0.820 ± 0.011</td><td>0.822 ± 0.011</td><td>0.832 ± 0.011</td></tr><tr><td>TabM</td><td>0.806 ± 0.011</td><td>0.821 ± 0.010</td><td>0.821 ± 0.010</td></tr><tr><td>MNCA</td><td>0.797 ± 0.010</td><td>0.814 ± 0.012</td><td>0.803 ± 0.015</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td>0.742 ± 0.009</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.811 ± 0.014</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.797 ± 0.013</td><td>0.820 ± 0.014</td><td>0.821 ± 0.014</td></tr><tr><td>KNN</td><td>0.605 ± 0.010</td><td>0.760 ± 0.012</td><td>0.776 ± 0.013</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><u>0.846 ± 0.009</u></td></tr></tbody></table>

maternal_health_risk (logloss ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.479 ± 0.071</td><td>0.470 ± 0.053</td><td>0.448 ± 0.054</td></tr><tr><td>ExtraTrees</td><td>0.478 ± 0.069</td><td>0.453 ± 0.055</td><td>0.443 ± 0.055</td></tr><tr><td>XGBoost</td><td>0.470 ± 0.051</td><td>0.459 ± 0.051</td><td>0.462 ± 0.050</td></tr><tr><td>LightGBM</td><td>0.488 ± 0.052</td><td>0.462 ± 0.049</td><td>0.461 ± 0.045</td></tr><tr><td>CatBoost</td><td>0.478 ± 0.055</td><td>0.463 ± 0.053</td><td>0.459 ± 0.049</td></tr><tr><td>EBM</td><td>0.569 ± 0.038</td><td>0.562 ± 0.042</td><td>0.557 ± 0.040</td></tr><tr><td>FastAIMLP</td><td>0.650 ± 0.044</td><td>0.617 ± 0.040</td><td>0.611 ± 0.039</td></tr><tr><td>TorchMLP</td><td>0.606 ± 0.054</td><td>0.566 ± 0.053</td><td>0.554 ± 0.046</td></tr><tr><td>RealMLP</td><td>0.558 ± 0.056</td><td>0.463 ± 0.058</td><td>0.436 ± 0.049</td></tr><tr><td>TabM</td><td>0.513 ± 0.045</td><td>0.484 ± 0.057</td><td>0.469 ± 0.051</td></tr><tr><td>MNCA</td><td>0.453 ± 0.042</td><td>0.442 ± 0.047</td><td>0.428 ± 0.050</td></tr><tr><td>TabPFNv2</td><td>0.451 ± 0.047</td><td>0.439 ± 0.057</td><td>0.437 ± 0.057</td></tr><tr><td>TabDPT</td><td><u>0.405 ± 0.062</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.410 ± 0.058</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.796 ± 0.037</td><td>0.793 ± 0.038</td><td>0.784 ± 0.037</td></tr><tr><td>KNN</td><td>0.938 ± 0.236</td><td>0.810 ± 0.126</td><td>0.464 ± 0.062</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.462 ± 0.061</td></tr></tbody></table>

miami_housing (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>9676 ± 592</td><td>9332 ± 503</td><td>9302 ± 500</td></tr><tr><td>ExtraTrees</td><td>9482 ± 400</td><td>9195 ± 395</td><td>9166 ± 409</td></tr><tr><td>XGBoost</td><td>8650 ± 447</td><td>8062 ± 361</td><td>8042 ± 357</td></tr><tr><td>LightGBM</td><td>8563 ± 463</td><td>8124 ± 410</td><td>7961 ± 354</td></tr><tr><td>CatBoost</td><td>7985 ± 315</td><td>7836 ± 342</td><td><u>7847 ± 329</u></td></tr><tr><td>EBM</td><td>10420 ± 365</td><td>9882 ± 466</td><td>9823 ± 438</td></tr><tr><td>FastAIMLP</td><td>9034 ± 512</td><td>8855 ± 535</td><td>8664 ± 483</td></tr><tr><td>TorchMLP</td><td>9265 ± 455</td><td>8631 ± 511</td><td>8528 ± 466</td></tr><tr><td>RealMLP</td><td>8605 ± 402</td><td>8337 ± 457</td><td>8018 ± 399</td></tr><tr><td>TabM</td><td>8307 ± 486</td><td>8115 ± 449</td><td>8023 ± 428</td></tr><tr><td>MNCA</td><td>8813 ± 434</td><td>8307 ± 380</td><td>8015 ± 409</td></tr><tr><td>TabPFNv2</td><td>8579 ± 447</td><td>7829 ± 457</td><td><u>7711 ± 442</u></td></tr><tr><td>TabDPT</td><td>8213 ± 497</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>19126 ± 458</td><td>17557 ± 366</td><td>17556 ± 367</td></tr><tr><td>KNN</td><td>11957 ± 565</td><td>10441 ± 503</td><td>10134 ± 548</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>7873 ± 429</td></tr></tbody></table>

online_shoppers_intention (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.926 ± 0.004</td><td>0.931 ± 0.004</td><td>0.932 ± 0.003</td></tr><tr><td>ExtraTrees</td><td>0.918 ± 0.005</td><td>0.931 ± 0.004</td><td>0.931 ± 0.004</td></tr><tr><td>XGBoost</td><td>0.935 ± 0.004</td><td>0.934 ± 0.003</td><td>0.936 ± 0.003</td></tr><tr><td>LightGBM</td><td>0.934 ± 0.003</td><td>0.935 ± 0.004</td><td>0.935 ± 0.003</td></tr><tr><td>CatBoost</td><td>0.934 ± 0.003</td><td>0.933 ± 0.004</td><td>0.934 ± 0.004</td></tr><tr><td>EBM</td><td>0.931 ± 0.003</td><td>0.931 ± 0.003</td><td>0.931 ± 0.003</td></tr><tr><td>FastAIMLP</td><td>0.926 ± 0.004</td><td>0.931 ± 0.005</td><td>0.932 ± 0.004</td></tr><tr><td>TorchMLP</td><td>0.930 ± 0.004</td><td>0.935 ± 0.004</td><td>0.936 ± 0.003</td></tr><tr><td>RealMLP</td><td>0.929 ± 0.004</td><td>0.933 ± 0.003</td><td>0.934 ± 0.004</td></tr><tr><td>TabM</td><td>0.935 ± 0.003</td><td>0.936 ± 0.003</td><td>0.936 ± 0.004</td></tr><tr><td>MNCA</td><td>0.934 ± 0.003</td><td>0.935 ± 0.003</td><td>0.936 ± 0.003</td></tr><tr><td>TabPFNv2</td><td>0.934 ± 0.004</td><td>0.937 ± 0.003</td><td><u>0.937 ± 0.003</u></td></tr><tr><td>TabDPT</td><td>0.926 ± 0.005</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.937 ± 0.003</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.913 ± 0.007</td><td>0.913 ± 0.007</td><td>0.918 ± 0.006</td></tr><tr><td>KNN</td><td>0.795 ± 0.005</td><td>0.897 ± 0.007</td><td>0.922 ± 0.004</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.936 ± 0.003</td></tr></tbody></table>

physiochemical_protein (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>3.565 ± 0.021</td><td>3.463 ± 0.021</td><td>3.471 ± 0.021</td></tr><tr><td>ExtraTrees</td><td>3.548 ± 0.022</td><td>3.466 ± 0.022</td><td>3.474 ± 0.021</td></tr><tr><td>XGBoost</td><td>3.513 ± 0.024</td><td>3.390 ± 0.024</td><td>3.390 ± 0.024</td></tr><tr><td>LightGBM</td><td>3.477 ± 0.026</td><td>3.381 ± 0.027</td><td>3.384 ± 0.027</td></tr><tr><td>CatBoost</td><td>3.522 ± 0.026</td><td>3.395 ± 0.029</td><td>3.383 ± 0.027</td></tr><tr><td>EBM</td><td>4.241 ± 0.020</td><td>4.234 ± 0.019</td><td>4.226 ± 0.020</td></tr><tr><td>FastAIMLP</td><td>4.014 ± 0.027</td><td>3.675 ± 0.031</td><td>3.683 ± 0.034</td></tr><tr><td>TorchMLP</td><td>3.388 ± 0.021</td><td>3.289 ± 0.028</td><td>3.228 ± 0.018</td></tr><tr><td>RealMLP</td><td>3.466 ± 0.042</td><td>3.284 ± 0.029</td><td>3.125 ± 0.028</td></tr><tr><td>TabM</td><td>3.426 ± 0.027</td><td>3.273 ± 0.031</td><td>3.212 ± 0.032</td></tr><tr><td>MNCA</td><td>3.170 ± 0.040</td><td>3.056 ± 0.034</td><td>2.985 ± 0.038</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td><u>2.912 ± 0.033</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>5.194 ± 0.024</td><td>5.188 ± 0.022</td><td>5.142 ± 0.023</td></tr><tr><td>KNN</td><td>3.909 ± 0.032</td><td>3.688 ± 0.042</td><td>3.586 ± 0.041</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>3.107 ± 0.026</td></tr></tbody></table>
polish_companies_bankruptcy (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.927 ± 0.007</td><td>0.935 ± 0.008</td><td>0.938 ± 0.007</td></tr><tr><td>ExtraTrees</td><td>0.874 ± 0.013</td><td>0.891 ± 0.013</td><td>0.893 ± 0.011</td></tr><tr><td>XGBoost</td><td>0.958 ± 0.007</td><td>0.957 ± 0.007</td><td>0.957 ± 0.008</td></tr><tr><td>LightGBM</td><td>0.954 ± 0.007</td><td>0.955 ± 0.008</td><td>0.957 ± 0.007</td></tr><tr><td>CatBoost</td><td>0.961 ± 0.008</td><td>0.961 ± 0.008</td><td>0.960 ± 0.008</td></tr><tr><td>EBM</td><td>0.962 ± 0.009</td><td>0.962 ± 0.010</td><td>0.964 ± 0.009</td></tr><tr><td>FastAIMLP</td><td>0.841 ± 0.026</td><td>0.852 ± 0.034</td><td>0.862 ± 0.022</td></tr><tr><td>TorchMLP</td><td>0.903 ± 0.006</td><td>0.955 ± 0.006</td><td>0.957 ± 0.005</td></tr><tr><td>RealMLP</td><td>0.962 ± 0.004</td><td>0.957 ± 0.006</td><td>0.963 ± 0.006</td></tr><tr><td>TabM</td><td>0.951 ± 0.009</td><td>0.969 ± 0.005</td><td>0.970 ± 0.004</td></tr><tr><td>MNCA</td><td>0.962 ± 0.008</td><td>0.965 ± 0.009</td><td>0.968 ± 0.006</td></tr><tr><td>TabPFNv2</td><td>0.959 ± 0.006</td><td>0.979 ± 0.003</td><td><u>0.981 ± 0.002</u></td></tr><tr><td>TabDPT</td><td>0.958 ± 0.009</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.974 ± 0.002</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.867 ± 0.016</td><td>0.887 ± 0.011</td><td>0.896 ± 0.010</td></tr><tr><td>KNN</td><td>0.775 ± 0.029</td><td>0.840 ± 0.008</td><td>0.852 ± 0.011</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.969 ± 0.005</td></tr></tbody></table>

qsar-biodeg (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.930 ± 0.013</td><td>0.929 ± 0.013</td><td>0.929 ± 0.013</td></tr><tr><td>ExtraTrees</td><td>0.932 ± 0.013</td><td><u>0.932 ± 0.013</u></td><td>0.934 ± 0.013</td></tr><tr><td>XGBoost</td><td>0.926 ± 0.013</td><td><u>0.931 ± 0.012</u></td><td>0.931 ± 0.012</td></tr><tr><td>LightGBM</td><td>0.927 ± 0.012</td><td><u>0.933 ± 0.012</u></td><td>0.933 ± 0.012</td></tr><tr><td>CatBoost</td><td>0.930 ± 0.012</td><td><u>0.931 ± 0.012</u></td><td>0.932 ± 0.011</td></tr><tr><td>EBM</td><td>0.931 ± 0.011</td><td><u>0.931 ± 0.011</u></td><td>0.933 ± 0.011</td></tr><tr><td>FastAIMLP</td><td>0.932 ± 0.013</td><td><u>0.932 ± 0.014</u></td><td>0.934 ± 0.013</td></tr><tr><td>TorchMLP</td><td>0.924 ± 0.014</td><td><u>0.923 ± 0.014</u></td><td>0.927 ± 0.014</td></tr><tr><td>RealMLP</td><td>0.927 ± 0.013</td><td><u>0.926 ± 0.015</u></td><td>0.934 ± 0.012</td></tr><tr><td>TabM</td><td>0.931 ± 0.011</td><td><u>0.934 ± 0.013</u></td><td>0.936 ± 0.012</td></tr><tr><td>MNCA</td><td>0.928 ± 0.012</td><td><u>0.928 ± 0.012</u></td><td>0.931 ± 0.012</td></tr><tr><td>TabPFNv2</td><td>0.936 ± 0.011</td><td><u>0.932 ± 0.013</u></td><td>0.936 ± 0.012</td></tr><tr><td>TabDPT</td><td>0.934 ± 0.012</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.938 ± 0.012</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.910 ± 0.016</td><td>0.923 ± 0.014</td><td>0.923 ± 0.014</td></tr><tr><td>KNN</td><td>0.907 ± 0.017</td><td>0.914 ± 0.015</td><td>0.923 ± 0.014</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.934 ± 0.013</td></tr></tbody></table>

seismic-bumps (AUC ↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.747 ± 0.021</td><td><u>0.767 ± 0.022</u></td><td><u>0.765 ± 0.026</u></td></tr><tr><td>ExtraTrees</td><td>0.734 ± 0.024</td><td><u>0.767 ± 0.029</u></td><td><u>0.771 ± 0.025</u></td></tr><tr><td>XGBoost</td><td>0.759 ± 0.022</td><td><u>0.768 ± 0.024</u></td><td><u>0.771 ± 0.025</u></td></tr><tr><td>LightGBM</td><td>0.752 ± 0.027</td><td><u>0.770 ± 0.027</u></td><td><u>0.771 ± 0.026</u></td></tr><tr><td>CatBoost</td><td><u>0.776 ± 0.027</u></td><td><u>0.772 ± 0.026</u></td><td><u>0.767 ± 0.028</u></td></tr><tr><td>EBM</td><td>0.770 ± 0.026</td><td><u>0.763 ± 0.026</u></td><td><u>0.767 ± 0.025</u></td></tr><tr><td>FastAIMLP</td><td>0.728 ± 0.034</td><td><u>0.759 ± 0.033</u></td><td><u>0.761 ± 0.028</u></td></tr><tr><td>TorchMLP</td><td>0.763 ± 0.026</td><td><u>0.758 ± 0.026</u></td><td><u>0.762 ± 0.025</u></td></tr><tr><td>RealMLP</td><td>0.760 ± 0.030</td><td><u>0.761 ± 0.027</u></td><td><u>0.766 ± 0.027</u></td></tr><tr><td>TabM</td><td>0.769 ± 0.024</td><td><u>0.768 ± 0.026</u></td><td><u>0.770 ± 0.026</u></td></tr><tr><td>MNCA</td><td><u>0.771 ± 0.023</u></td><td><u>0.763 ± 0.027</u></td><td><u>0.734 ± 0.026</u></td></tr><tr><td>TabPFNv2</td><td>0.777 ± 0.025</td><td><u>0.766 ± 0.023</u></td><td><u>0.769 ± 0.024</u></td></tr><tr><td>TabDPT</td><td><u>0.774 ± 0.022</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td><u>0.783 ± 0.024</u></td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.759 ± 0.024</td><td><u>0.761 ± 0.023</u></td><td><u>0.763 ± 0.025</u></td></tr><tr><td>KNN</td><td>0.685 ± 0.034</td><td><u>0.764 ± 0.028</u></td><td><u>0.760 ± 0.022</u></td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.758 ± 0.032</td></tr></tbody></table>

splice (logloss ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.317 ± 0.005</td><td>0.180 ± 0.015</td><td>0.178 ± 0.014</td></tr><tr><td>ExtraTrees</td><td>0.393 ± 0.007</td><td>0.175 ± 0.015</td><td>0.173 ± 0.013</td></tr><tr><td>XGBoost</td><td>0.119 ± 0.020</td><td>0.109 ± 0.018</td><td>0.109 ± 0.018</td></tr><tr><td>LightGBM</td><td>0.111 ± 0.016</td><td>0.103 ± 0.016</td><td>0.102 ± 0.015</td></tr><tr><td>CatBoost</td><td>0.110 ± 0.017</td><td>0.115 ± 0.020</td><td>0.111 ± 0.018</td></tr><tr><td>EBM</td><td>0.118 ± 0.013</td><td>0.119 ± 0.012</td><td>0.117 ± 0.012</td></tr><tr><td>FastAIMLP</td><td>0.118 ± 0.013</td><td><u>0.105 ± 0.013</u></td><td><u>0.103 ± 0.014</u></td></tr><tr><td>TorchMLP</td><td>0.157 ± 0.022</td><td>0.127 ± 0.017</td><td>0.116 ± 0.014</td></tr><tr><td>RealMLP</td><td>0.126 ± 0.014</td><td>0.110 ± 0.014</td><td>0.106 ± 0.013</td></tr><tr><td>TabM</td><td>0.110 ± 0.016</td><td>0.112 ± 0.019</td><td>0.110 ± 0.017</td></tr><tr><td>MNCA</td><td>0.144 ± 0.013</td><td>0.120 ± 0.011</td><td>0.122 ± 0.014</td></tr><tr><td>TabPFNv2</td><td>0.107 ± 0.015</td><td>0.113 ± 0.019</td><td><u>0.099 ± 0.015</u></td></tr><tr><td>TabDPT</td><td>0.267 ± 0.010</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.148 ± 0.020</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.167 ± 0.019</td><td>0.148 ± 0.012</td><td>0.148 ± 0.012</td></tr><tr><td>KNN</td><td>0.551 ± 0.017</td><td>0.485 ± 0.024</td><td>0.447 ± 0.025</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><u>0.100 ± 0.017</u></td></tr></tbody></table>

students_dropout_and_academic_success (logloss ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.584 ± 0.011</td><td>0.576 ± 0.014</td><td>0.574 ± 0.013</td></tr><tr><td>ExtraTrees</td><td>0.591 ± 0.012</td><td>0.570 ± 0.011</td><td>0.566 ± 0.013</td></tr><tr><td>XGBoost</td><td>0.554 ± 0.016</td><td>0.545 ± 0.015</td><td>0.546 ± 0.014</td></tr><tr><td>LightGBM</td><td>0.555 ± 0.015</td><td>0.543 ± 0.016</td><td>0.542 ± 0.015</td></tr><tr><td>CatBoost</td><td>0.552 ± 0.016</td><td>0.543 ± 0.017</td><td>0.541 ± 0.016</td></tr><tr><td>EBM</td><td>0.565 ± 0.014</td><td>0.561 ± 0.013</td><td>0.560 ± 0.014</td></tr><tr><td>FastAIMLP</td><td>0.565 ± 0.021</td><td>0.549 ± 0.015</td><td>0.540 ± 0.015</td></tr><tr><td>TorchMLP</td><td>0.581 ± 0.018</td><td>0.559 ± 0.016</td><td>0.552 ± 0.014</td></tr><tr><td>RealMLP</td><td>0.556 ± 0.015</td><td>0.553 ± 0.013</td><td>0.542 ± 0.014</td></tr><tr><td>TabM</td><td>0.543 ± 0.013</td><td>0.541 ± 0.014</td><td>0.538 ± 0.014</td></tr><tr><td>MNCA</td><td>0.555 ± 0.015</td><td>0.554 ± 0.012</td><td>0.546 ± 0.013</td></tr><tr><td>TabPFNv2</td><td><u>0.534 ± 0.012</u></td><td><u>0.529 ± 0.015</u></td><td><u>0.527 ± 0.015</u></td></tr><tr><td>TabDPT</td><td>0.561 ± 0.018</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.550 ± 0.014</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.571 ± 0.017</td><td>0.562 ± 0.013</td><td>0.561 ± 0.013</td></tr><tr><td>KNN</td><td>0.829 ± 0.047</td><td>0.705 ± 0.018</td><td>0.663 ± 0.017</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.536 ± 0.015</td></tr></tbody></table>

superconductivity (rmse ↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>9.63 ± 0.19</td><td>9.62 ± 0.19</td><td>9.53 ± 0.19</td></tr><tr><td>ExtraTrees</td><td>9.43 ± 0.18</td><td>9.43 ± 0.18</td><td>9.39 ± 0.18</td></tr><tr><td>XGBoost</td><td>9.45 ± 0.18</td><td>9.35 ± 0.21</td><td>9.34 ± 0.20</td></tr><tr><td>LightGBM</td><td>9.41 ± 0.21</td><td>9.28 ± 0.22</td><td>9.26 ± 0.20</td></tr><tr><td>CatBoost</td><td>9.36 ± 0.19</td><td>9.34 ± 0.21</td><td>9.34 ± 0.20</td></tr><tr><td>EBM</td><td>10.53 ± 0.23</td><td>10.43 ± 0.22</td><td>10.21 ± 0.18</td></tr><tr><td>FastAIMLP</td><td>11.51 ± 0.10</td><td>10.59 ± 0.10</td><td>10.55 ± 0.12</td></tr><tr><td>TorchMLP</td><td>9.95 ± 0.21</td><td>9.66 ± 0.16</td><td>9.56 ± 0.16</td></tr><tr><td>RealMLP</td><td>9.57 ± 0.29</td><td>9.44 ± 0.23</td><td>9.22 ± 0.21</td></tr><tr><td>TabM</td><td>9.51 ± 0.21</td><td>9.31 ± 0.21</td><td>9.24 ± 0.20</td></tr><tr><td>MNCA</td><td>9.56 ± 0.16</td><td>9.50 ± 0.14</td><td>9.28 ± 0.19</td></tr><tr><td>TabPFNv2</td><td>-</td><td>-</td><td>-</td></tr><tr><td>TabDPT</td><td><u>9.08 ± 0.20</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>17.43 ± 0.10</td><td>17.42 ± 0.09</td><td>17.26 ± 0.10</td></tr><tr><td>KNN</td><td>11.10 ± 0.16</td><td>10.25 ± 0.26</td><td>9.95 ± 0.22</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>9.22 ± 0.16</td></tr></tbody></table>
taiwanese_bankruptcyærntry (AUC↑)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.933 ± 0.011</td><td>0.932 ± 0.011</td><td>0.932 ± 0.012</td></tr><tr><td>ExtraTrees</td><td>0.937 ± 0.011</td><td>0.937 ± 0.008</td><td>0.938 ± 0.008</td></tr><tr><td>XGBoost</td><td>0.941 ± 0.008</td><td><strong>0.943 ± 0.008</strong></td><td><strong>0.944 ± 0.008</strong></td></tr><tr><td>LightGBM</td><td>0.938 ± 0.008</td><td><strong>0.943 ± 0.008</strong></td><td><strong>0.944 ± 0.007</strong></td></tr><tr><td>CatBoost</td><td><strong>0.944 ± 0.006</strong></td><td>0.944 ± 0.007</td><td>0.943 ± 0.006</td></tr><tr><td>EBM</td><td><u>0.942 ± 0.005</u></td><td><u>0.940 ± 0.005</u></td><td>0.941 ± 0.004</td></tr><tr><td>FastAIMLP</td><td>0.914 ± 0.022</td><td>0.923 ± 0.009</td><td>0.927 ± 0.010</td></tr><tr><td>TorchMLP</td><td>0.925 ± 0.009</td><td><u>0.940 ± 0.007</u></td><td><strong>0.943 ± 0.007</strong></td></tr><tr><td>RealMLP</td><td>0.941 ± 0.006</td><td>0.941 ± 0.007</td><td><strong>0.945 ± 0.006</strong></td></tr><tr><td>TabM</td><td>0.941 ± 0.004</td><td>0.942 ± 0.004</td><td>0.943 ± 0.004</td></tr><tr><td>MNCA</td><td>0.940 ± 0.006</td><td><u>0.939 ± 0.010</u></td><td>0.932 ± 0.013</td></tr><tr><td>TabPFNv2</td><td><u>0.942 ± 0.005</u></td><td><u>0.943 ± 0.007</u></td><td><strong>0.945 ± 0.008</strong></td></tr><tr><td>TabDPT</td><td>0.937 ± 0.008</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.944 ± 0.006</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.936 ± 0.005</td><td>0.938 ± 0.003</td><td>0.938 ± 0.003</td></tr><tr><td>KNN</td><td>0.870 ± 0.017</td><td>0.925 ± 0.014</td><td>0.936 ± 0.007</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td><strong>0.946 ± 0.006</strong></td></tr></tbody></table>

websitephishing (logloss↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.312 ± 0.037</td><td>0.262 ± 0.019</td><td>0.257 ± 0.019</td></tr><tr><td>ExtraTrees</td><td>0.312 ± 0.036</td><td>0.258 ± 0.020</td><td>0.250 ± 0.019</td></tr><tr><td>XGBoost</td><td>0.260 ± 0.027</td><td>0.251 ± 0.022</td><td>0.251 ± 0.023</td></tr><tr><td>LightGBM</td><td>0.255 ± 0.021</td><td>0.249 ± 0.021</td><td>0.247 ± 0.021</td></tr><tr><td>CatBoost</td><td>0.252 ± 0.022</td><td>0.239 ± 0.022</td><td>0.239 ± 0.021</td></tr><tr><td>EBM</td><td>0.357 ± 0.021</td><td>0.357 ± 0.020</td><td>0.357 ± 0.020</td></tr><tr><td>FastAIMLP</td><td>0.334 ± 0.023</td><td>0.245 ± 0.022</td><td>0.241 ± 0.021</td></tr><tr><td>TorchMLP</td><td>0.289 ± 0.035</td><td>0.237 ± 0.020</td><td>0.230 ± 0.019</td></tr><tr><td>RealMLP</td><td>0.256 ± 0.026</td><td>0.236 ± 0.026</td><td>0.232 ± 0.021</td></tr><tr><td>TabM</td><td>0.246 ± 0.026</td><td>0.238 ± 0.027</td><td>0.236 ± 0.025</td></tr><tr><td>MNCA</td><td>0.261 ± 0.023</td><td>0.243 ± 0.025</td><td>0.239 ± 0.022</td></tr><tr><td>TabPFNv2</td><td>0.229 ± 0.025</td><td><strong>0.223 ± 0.027</strong></td><td><strong>0.222 ± 0.025</strong></td></tr><tr><td>TabDPT</td><td>0.228 ± 0.027</td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>0.228 ± 0.026</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.360 ± 0.021</td><td>0.359 ± 0.023</td><td>0.358 ± 0.022</td></tr><tr><td>KNN</td><td>0.938 ± 0.142</td><td>0.385 ± 0.048</td><td>0.299 ± 0.033</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.233 ± 0.021</td></tr></tbody></table>

wine quality (rmse↓)

<table><thead><tr><th></th><th>Default</th><th>Tuned</th><th>Tuned + Ens.</th></tr></thead><tbody><tr><td>RF</td><td>0.620 ± 0.021</td><td>0.616 ± 0.021</td><td>0.611 ± 0.021</td></tr><tr><td>ExtraTrees</td><td>0.613 ± 0.021</td><td><u>0.606 ± 0.025</u></td><td>0.603 ± 0.021</td></tr><tr><td>XGBoost</td><td>0.621 ± 0.021</td><td>0.610 ± 0.019</td><td>0.610 ± 0.020</td></tr><tr><td>LightGBM</td><td>0.628 ± 0.019</td><td>0.607 ± 0.019</td><td>0.608 ± 0.019</td></tr><tr><td>CatBoost</td><td>0.621 ± 0.019</td><td><u>0.605 ± 0.020</u></td><td>0.605 ± 0.020</td></tr><tr><td>EBM</td><td>0.679 ± 0.015</td><td>0.678 ± 0.016</td><td>0.675 ± 0.016</td></tr><tr><td>FastAIMLP</td><td>0.669 ± 0.019</td><td>0.668 ± 0.018</td><td>0.657 ± 0.019</td></tr><tr><td>TorchMLP</td><td>0.691 ± 0.019</td><td>0.653 ± 0.018</td><td>0.650 ± 0.015</td></tr><tr><td>RealMLP</td><td>0.625 ± 0.018</td><td>0.618 ± 0.019</td><td><u>0.603 ± 0.020</u></td></tr><tr><td>TabM</td><td>0.637 ± 0.020</td><td>0.620 ± 0.020</td><td>0.612 ± 0.020</td></tr><tr><td>MNCA</td><td>0.610 ± 0.020</td><td><u>0.606 ± 0.019</u></td><td><u>0.601 ± 0.020</u></td></tr><tr><td>TabPFNv2</td><td>0.692 ± 0.012</td><td>0.639 ± 0.017</td><td>0.610 ± 0.020</td></tr><tr><td>TabDPT</td><td><u>0.590 ± 0.018</u></td><td>-</td><td>-</td></tr><tr><td>TabICL</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Linear</td><td>0.731 ± 0.017</td><td>0.731 ± 0.017</td><td>0.730 ± 0.016</td></tr><tr><td>KNN</td><td>0.627 ± 0.023</td><td>0.627 ± 0.022</td><td>0.617 ± 0.021</td></tr><tr><td>AutoGluon</td><td>-</td><td>-</td><td>0.599 ± 0.020</td></tr></tbody></table>