# Large Language Model-Powered Automated Assessment: A Systematic Review
## 3 Results
### Details of LLMPAA Research
#### 3.2.2 Languages, Question Types, Sizes, and Additional Info  
The studies classified question types into three groups: essay (n = 30), short-answer (n = 16), and open-ended (n = 3). Essay questions were particularly prevalent in high school and university studies. This format was preferred for assessing students' critical thinking and writing skills in depth. investigated the writing proficiency of high school students using a corpus of 28,989 essays. A comprehensive analysis conducted in study [19] \begin{table}
\begin{tabular}{c c c c c c c} \hline \hline
**References** & **Domains** & **Datasets** & **Languages** & \
\begin{tabular}{c} **Question** \\ **Types** \\ \end{tabular} & **Sizes** &
\begin{tabular}{c} **Additional Info** \\ \end{tabular} \\ \hline
[52] & \
\begin{tabular}{c} Computer \\ Science \\ \end{tabular} & SELF & Indonesian & Short-answer & 480 &
\begin{tabular}{c} Collected from foreign learners at the \\ Intermediate 1 level. \\ \end{tabular} \\ \hline
[53] & RC, CT, AT & ASAP-AES & English & Essay & 5152 &
\begin{tabular}{c} Essays collected from students in grades \\ 7–10 in the USA. \\ \end{tabular} \\ \hline
[54] & \begin{tabular}{c} Computer \\ Science \\ \end{tabular} & \
\begin{tabular}{c} MOHLER, \\ SemEval-2013 \\ \end{tabular} & English & Short-answer & 13,077 &
\begin{tabular}{c} Collected from 15 diverse science \\ domains and the University of North \\ Texas. \\ \end{tabular} \\ \hline
[55] & \begin{tabular}{c} RC, CT, AT, \\ Language \\ Education \\ \end{tabular} & \
\begin{tabular}{c} ASAP-AES, \\ CELA \\ \end{tabular} & Chinese & Essay & 13,122 &
\begin{tabular}{c} Collected engineering faculty students. \\ \end{tabular} \\ \hline
[56] & \begin{tabular}{c} Language \\ Education \\ \end{tabular} & \
\begin{tabular}{c} ICNALE- \\ GRA \\ \end{tabular} & English & Essay & 136 &
\begin{tabular}{c} Collected from language, history, and \\ writing courses. \\ \end{tabular} \\ \hline
[57] &
\begin{tabular}{c} Language \\ Education \\ \end{tabular} & SELF & English & Essay & 3 & Rated by 15 human raters. \\ \hline \hline \end{tabular}
\end{table} 
Table 4: _Cont._investigated the writing proficiency of high school students using a corpus of 28,989 essays. Short-answer questions have been more commonly used in university-level studies and scientific fields. This question type was preferred to assess students' ability to provide concise and clear answers. One study [20] evaluated student performance in university entrance examinations by analyzing a dataset of 37,346 short-answer responses. Open-ended questions, although less commonly used, have been preferred particularly in studies at the elementary and middle school levels. This question type was used to assess students' creativity and open-ended thinking skills. A study [2] examined elementary school students' writing skills using 677 open-ended responses. When examining the language of the datasets used in the studies, it was found that 67% of the studies used English, while 33% used other languages (Spanish, Japanese, Arabic, Chinese, Indonesian, German, Italian, Czech). This heavy reliance on English raises concerns about applicability in multilingual contexts and may disadvantage non-native English speakers [58]. A study [33] assessed a dataset consisting of 1400 essays written in Japanese by students with 12 different native languages to investigate the impact of the native language on the language learning process. Similarly, [PERSON] and colleagues [22] used the MERLIN dataset, which contains a total of 2267 essays written in German, Italian, and Czech, to compare students' writing skills in multilingual education systems. Furthermore, studies using languages such as Arabic and Chinese have focused on the teaching and learning of these languages. In study [37], students' understanding of history and cybercrime was assessed using Arabic short-answer questions. When examining the dataset sizes in the studies, it was found that the dataset sizes used in the 49 studies varied between 3 and 37,346.