## 4 Experiments
### Performance Evaluation
#### 4.2.1 HPO for XGBoost
\begin{table}
\begin{tabular}{l c c c c c c c} \hline \hline
**Data Set** & **RS** & \multicolumn{2}{c}{**TPE**} & \multicolumn{2}{c}{**Hyperband**} & \multicolumn{2}{c}{**BOHB**} \\ \hline  & **Acc (\%)** & **Time (s)** & **Acc (\%)** & **Time (s)** & **Acc (\%)** & **Time (s)** & **Acc (\%)** & **Time (s)** \\ \hline winequality\_white & \(64.86\pm 2.12\) & \(479\pm 16\) & \(66.35\pm 0.75\) & \(518\pm 101\) & \(67.10\pm 0.51\) & \(137\pm 7\) & \(62.24\pm 0.40\) & **124**\(\pm\) 5 \\ optdigits & \(97.79\pm 0.33\) & \(506\pm 12\) & \(97.85\pm 0.34\) & \(493\pm 65\) & \(98.17\pm 0.37\) & \(129\pm 7\) & \(98.10\pm 0.13\) & **120**\(\pm\) 3 \\ Turkive\_Student\_Evaluation & \(85.46\pm 0.94\) & \(313\pm 15\) & \(86.67\pm 0.33\) & \(315\pm 79\) & \(86.92\pm 0.52\) & \(73\pm 3\) & \(87.03\pm 0.38\) & **72**\(\pm\) 2 \\ balance\_scale & \(89.92\pm 1.18\) & \(48\pm 1\) & \(91.52\pm 0.64\) & \(57\pm 9\) & \(91.04\pm 0.93\) & \(17\pm 0\) & \(92.48\pm 0.96\) & \(20\pm 0\) \\ Cardiotocography & \(88.45\pm 1.65\) & \(263\pm 7\) & \(87.09\pm 0.42\) & \(273\pm 33\) & \(87.32\pm 0.15\) & \(80\pm 2\) & \(88.03\pm 0.66\) & **63**\(\pm\) 1 \\ monks\_1 & \(96.07\pm 1.84\) & \(20\pm 0\) & \(95.54\pm 1.69\) & \(26\pm 2\) & \(97.32\pm 0.00\) & \(9\pm 1\) & \(90.36\pm 6.79\) & \(9\pm 0\) \\ DR\_Debrecen & \(70.04\pm 2.81\) & \(41\pm 1\) & \(70.13\pm 1.52\) & \(45\pm 5\) & \(69.18\pm 0.50\) & \(14\pm 1\) & \(71.26\pm 0.89\) & **13**\(\pm\) 0 \\ churn & \(95.58\pm 0.89\) & \(89\pm 3\) & \(94.60\pm 0.23\) & \(106\pm 8\) & \(96.08\pm 0.07\) & \(25\pm 1\) & \(95.86\pm 0.29\) & \(27\pm 0\) \\ socomb & \(93.71\pm 1.11\) & \(22\pm 0\) & \(93.62\pm 0.74\) & \(28\pm 3\) & \(92.07\pm 0.58\) & \(9\pm 1\) & \(94.31\pm 1.37\) & \(5\pm 0\) \\ \hline Average values & \(86.88\pm 1.43\) & \(198\pm 6\) & \(87.04\pm 0.74\) & \(236\pm 34\) & \(87.24\pm 0.40\) & \(55\pm 2\) & \(86.63\pm 1.32\) & **50**\(\pm\) 1 \\ \hline
**Data Set** & \multicolumn{2}{c}{**MBRL-SDP**} & \multicolumn{2}{c}{**RFEPPO (Our Method)**} & \multicolumn{2}{c}{**Baseline**} \\ \hline  & **Acc (\%)** & **Time (s)** & **Acc (\%)** & **Time (s)** & **Acc (\%)** & **Time (s)** & \\ \hline winequality\_white & \(65.40\pm 0.87\) & \(397\pm 44\) & \(67.84\pm 0.40\) & \(420\pm 187\) & \(65.25\pm 1.29\) & - & \\ optdigits & \(97.44\pm 0.69\) & \(370\pm 169\) & \(98.35\pm 0.18\) & \(408\pm 146\) & \(97.59\pm 0.39\) & - & \\ Turkive\_Student\_Evaluation & \(85.98\pm 0.80\) & \(298\pm 9\) & \(\mathbf{87.87}\pm 0.37\) & \(253\pm 81\) & \(84.69\pm 1.44\) & - & \\ balance\_scale & \(90.88\pm 1.09\) & \(143\pm 9\) & \(\mathbf{92.67}\pm 0.64\) & \(150\pm 2\) & \(86.24\pm 0.93\) & - & \\ Cardiotocography & \(87.42\pm 1.25\) & \(223\pm 35\) & \(\mathbf{89.39}\pm 0.27\) & \(252\pm 70\) & \(86.99\pm 0.19\) & - & \\ monks\_1 & \(96.25\pm 1.64\) & \(139\pm 5\) & \(\mathbf{98.57}\pm 0.44\) & \(136\pm 6\) & \(98.39\pm 0.87\) & - & \\ DR\_Debrecen & \(67.00\pm 3.48\) & \(142\pm 4\) & \(\mathbf{74.72}\pm 1.49\) & \(152\pm 15\) & \(68.13\pm 2.85\) & - & \\ churn & \(95.58\pm 0.40\) & \(163\pm 17\) & \(\mathbf{96.38}\pm 0.30\) & \(169\pm 6\) & \(95.83\pm 0.71\) & - & \\ socomb & \(93.88\pm 0.57\) & \(136\pm 6\) & \(\mathbf{96.55}\pm 0.39\) & \(137\pm 5\) & \(93.87\pm 1.03\) & - & \\ \hline Average values & \(86.65\pm 1.20\) & \(223\pm 43\) & \(\mathbf{89.15}\pm 0.50\) & \(228\pm 58\) & \(86.33\pm 1.08\) & - & \\ \hline \hline \end{tabular}
\end{table} 
Table 3: The performance (mean \(\pm\) std) of our method and other conventional algorithms on nine tabular datasets.