RiteeshGrandhi/sciclaimeval-shared-task huggingface dataset:
\begin{table}
\centering
\begin{adjustbox}{max width=\textwidth}
    \begin{tabular}{c|cccc}
    \toprule
\textbf{Method}   & \textbf{GSM8K}     & \textbf{StrategyQA}     & \textbf{MBPP}      & \textbf{HumanEval} \\
\midrule
SCMoE & 66.94     & 76.29  & 48.80     & 41.46     \\    
\midrule
SCMoE w/ ideal strong activations & \textbf{68.92}     & \textbf{76.42}     & \textbf{50.60}     & 41.46     \\    
\bottomrule
\end{tabular}
\end{adjustbox}
\caption{Table 2: Experimental results of different strong activations.
    We set the weak activation with rank-$2$ routing.
    For each benchmark, 
we select the top-$k$ routing yielding the best performance in Figure~fig:figure1 as the ideal strong activation.
The specific hyperparameter settings can be found in Table~tab:a:strong.}
\end{table}