# Towards Harnessing the Most of ChatGPT for Korean Grammatical Error Correction
## 3 ChatGPT for K-GEC
### Validation Design  
The K-GEC task necessitates an understanding of sentence structure and grammar, as well as the capability to generate appropriate corrective words. The outcomes of grammatical correction can serve as inputs for various downstream tasks, potentially influencing the model's efficacy and user satisfaction. Given its significance, we aim to conduct a comprehensive evaluation of ChatGPT's performance on the K-GEC task, focusing on 21 error categories. For this analysis, we consider two dimensions of ChatGPT's capabilities: explicit example information and temperature. The number of shots, or the provision of explicit examples for a given task, has been observed to have a significant impact on the performance of language models like ChatGPT. Specifically, providing a few examples (few-shot learning) has been shown to enhance the \begin{table}
\begin{tabular}{l l l} \hline \hline \multicolumn{2}{c}{**Error Type**} & \multicolumn{1}{c}{**Explanation**} \\ \hline Spacing Error & & Violating the spacing rules \\ \hline \multirow{4}{*}{Punctuation Error} & & Punctuation marks are not attached in \\  & & Korean sentences or are attached in the wrong position \\ \hline \multirow{2}{*}{Numerical Error} & & Cardinal number indicating quantity and \\  & & the ordinal number indicating the order are in error \\ \hline \multirow{6}{*}{P Primary Error} & \multirow{3}{*}{Monolingual Error} & Remove Error & Some words are not recognized, or endings \\  & & & or suffices are omitted \\ \cline{3-3}  & & \multirow{3}{*}{Addition Error} & Same word is repeated, or an unused \\  & & & postposition or ending is added \\ \cline{3-3}  & & \multirow{3}{*}{Replace Error} & Word \\  & & replace & Word is replaced by another word \\ \cline{3-3}  & & & Rotation \\  & & replace & a one phrase \\ \cline{3-3}  & & Separation Error & Separating consonants and vowels in characters \\ \cline{3-3}  & & Typing language Error & Typing while the keyboard is not in Korean mode \\ \cline{3-3}  & & Foreign word & Writing differently from the standard foreign \\ \cline{3-3}  & & conversion Error & language pronunciation \\ \hline \multirow{6}{*}{Selling and Grammatical Error} & \multirow{3}{*}{Spelling Error} & Consonant vowel \\  & & conversion error & Spelling error in non-speaking alphabet units \\ \cline{3-3}  & & Grapheme-to-phoneme(G2P) Error & Writing spellings according to pronunciation \\ \cline{3-3}  & & \multirow{3}{*}{Element Error} & The Korean sentence components are not equipped \\  & & or the word order is not correct \\ \cline{3-3}  & & \multirow{3}{*}{Syntax Error} & Tense Error & Using a verb that does not match the tense \\ \cline{3-3}  & & Postposition Error & Probing that does not fit the grammar \\ \cline{3-3}  & & \multirow{3}{*}{Suffix Error} & Using an ending that is not grammatically correct \\ \cline{3-3}  & & Auxiliary predicate Error & Using an auxiliary verb that is not grammatically \\ \cline{3-3}  & & \multirow{3}{*}{Exmantic Error} & Writing in non-standard language \\ \cline{3-3}  & & & Polite speech Error & An adjective expression that does not fit the subject \\ \cline{3-3}  & & \multirow{3}{*}{Behavioral Error} & Expressions that the subject cannot perform \\ \cline{3-3}  & & \multirow{3}{*}{Coreference Error} & Invalid entity reference \\ \cline{3-3}  & & \multirow{3}{*}{Discourse context Error} & Contracting the context of the previous discourse \\ \cline{3-3}  & & & Using grammar or new words that are not included in \\ \cline{3-3} \cline{3-3}  & & & the existing grammar system \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Error type classification criteria for Korean grammatical and spelling error correction in K-NCT dataset [21]. model's ability to understand and execute tasks more effectively compared to a zero-shot setting, where no examples are provided.