RiteeshGrandhi/sciclaimeval-shared-task huggingface dataset:
\begin{table}
\centering
\begin{adjustbox}{max width=\textwidth}
\begin{tabular}{c|ccccccc}
\toprule
\textbf{Method} & \textbf{Greedy} & \textbf{Ensemble} & \textbf{Dynamic} & \textbf{CS} & \textbf{DoLa} & \textbf{CD} & \textbf{SCMoE}        \\
\midrule
Latency (s / 512 tokens) & 50.32 & 59.82 & 54.85 & 81.73 & 53.30 & 72.04 & 65.47 \\
Latency Ratio & x1.00 & x1.19 & x1.09 & x1.62 & x1.06 & x1.43 & x1.30 \\
\bottomrule
\end{tabular}
\end{adjustbox}
\caption{Table 3: Averaged decoding latency for each method. CS is short for contrastive search and CD is short for contrastive decoding. We set $k$ = 3 for ensemble routing, while for dynamic routing we set threshold = 0.5. The speeds are tested on 4 A100 40G with batch size = 1.}
\end{table}