RiteeshGrandhi/sciclaimeval-shared-task huggingface dataset:
\begin{table}
\centering
\begin{adjustbox}{max width=\textwidth}
\begin{tabular}{p{1.52cm}|p{0.7cm}p{0.8cm}p{1.0cm}p{0.7cm}p{0.7cm}p{0.8cm}p{0.7cm}p{0.8cm}p{0.86cm}|p{0.6cm}|p{1.4cm}}
\toprule
Model & Ambig. Filter Criteria & Ambig. SELECT Column & Ambig. Values Within Column & Ambig. WHERE Column & Nonexist. Filter Value & Nonexist. SELECT Column & Nonexist. WHERE Column & Unsupported Join & Answerable & Average & Avg. Excluding Answerable\\
\midrule
Claude 3.5 Sonnet & \textbf{77.23\%} & 67.25\% & 68.03\% & \textbf{77.14\%} & \textbf{74.12\%} & 64.73\% & 65.11\% & 76.53\% & \textbf{79.21\%} & 72.15\% & 71.27\%\\
Claude 3 Sonnet & 61.72\% & 58.48\% & 53.28\% & 59.05\% & 64.71\% & 55.19\% & 51.06\% & \textbf{77.46\%} & 64.12\% & 60.56\% & 60.12\%\\
Llama-3.1 70B & 68.65\% & 71.35\% & 63.11\% & 71.43\% & 65.88\% & \textbf{67.01\%} & \textbf{69.36\%} & 63.85\% & 76.31\% & 68.55\% & 67.58\%\\
Llama-3.1 8B & 48.84\% & 55.56\% & 45.90\% & 59.05\% & 54.71\% & 48.76\% & 46.81\% & 56.34\% & 56.58\% & 52.50\% & 52.00\%\\
Mixtral-large-v2 & 75.91\% & \textbf{74.27\%} & \textbf{69.67\%} & 75.24\% & 71.76\% & 66.18\% & 65.53\% & 77.00\% & 78.72\% & \textbf{72.70\%} & \textbf{71.95\%} \\
\bottomrule
\end{tabular}
\end{adjustbox}
\caption{Table 5: Execution accuracy of SQLs predicted with DIN-SQL using different LLMs on various categories of ambiguous, unanswerable, and answerable questions. The "All" column shows the overall average accuracy across all categories, while the "Avg. Excluding Answerable" column shows the average accuracy excluding the answerable questions from the Spider dataset.}
\end{table}