## 2 Language Capacity of GPT-4o
### Performance on Exams
#### 2.1.3 Performance on SAT  
The Scholastic Assessment Test (SAT) is a standardized test widely used for college admissions in the United States [34]. Developed and administered by the College Board, the SAT assesses a student's readiness for college and provides colleges with a common data point for comparing all applicants. The SAT covers areas, including reading, writing and language, and mathematics, with an optional essay section. This test is designed to measure a range of skills necessary for academic success in college, including critical thinking, problem-solving, and analytical abilities. The dataset used for evaluating GPT-4o's performance consists of questions from the SAT Practice Test #1, which includes a variety of reading, writing, and math questions that reflect the format and content of the actual SAT exam ([[https://satsuite.collegeboard.org/sat/practice-preparation?excmpid=mtg796-st-1-bk](https://satsuite.collegeboard.org/sat/practice-preparation?excmpid=mtg796-st-1-bk)]([https://satsuite.collegeboard.org/sat/practice-preparation?excmpid=mtg796-st-1-bk](https://satsuite.collegeboard.org/sat/practice-preparation?excmpid=mtg796-st-1-bk)), accessed on 15 June 2024). The practice test consisted of two modules, each containing a reading and writing exam, as well as a math exam. The performance on each module are outlined in Table 3.  
For a comparison with previous GPT models, we refer to the comprehensive report by the Open AI team [35]. In this context, we average the results of M1 and M2 for GPT-4o, as summarized in Table 4.  
GPT-4o demonstrates the highest accuracy in the Reading & Writing section with 90.91%, surpassing all the older models. In the Math section, GPT-4o achieves a strong performance with 87.04%, slightly lower than GPT-4 but higher than the rest. Figures 2-5 provide examples of GPT-4o correct and incorrect responses on each \begin{table}
\begin{tabular}{c c c} \hline \hline
**Model** & **Reading \& Writing** & **Math** \\ \hline GPT-3.5 & 83.75\% & 73.75\% \\ GPT-4 & 88.75\% & 87.50\% \\ GPT-4 (no vision) & 88.75\% & 86.25\% \\ GPT-4o & 90.91\% & 87.04\% \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Performance comparison of GPT models on SAT. \begin{table}
\begin{tabular}{c c} \hline \hline
**Model** & **Accuracy** \\ \hline GPT-3.5 & 58.80\% \\ GPT-4 & 73.20\% \\ GPT-4o & 85.39\% \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Performance comparison of GPT models on CFA Level 1 Exam. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Test** & **Total Questions** & **Correct Answers** & **Accuracy** \\ \hline Reading \& Writing M1 & 33 & 31 & 93.94\% \\ Reading \& Writing M2 & 33 & 29 & 87.88\% \\ Math M1 & 27 & 25 & 92.59\% \\ Math M2 & 27 & 22 & 81.48\% \\ \hline \hline \end{tabular}
\end{table} 
Table 3: GPT-4o performance based on SAT. [PERSON] of the University of Chile observed that alkaline soils contain an insoluble form of iron that blueberry plants cannot absorb, thus inhibiting blueberry growth. If these plants were grown in alkaline soil alongside grasses that aid in iron solubilization, [PERSON] was determined to find out. * The blueberries could thrive. * Explanation: This phrasing correctly completes the sentence as a conditional statement. * While researching a topic, a student has taken the following notes:
* In the midst of the US Civil War, [PERSON] escaped slavery and fled to Union-army-occupied St. Simons Island off the Georgia coast. * She began working for an all-Black army regiment as a nurse and teacher. * In 1902, she published a book about the time she spent with the regiment. * Her book was the only Civil War memoir to be published by a Black woman. * It is still available to readers in print and online. * The graph shows the relationship between the number of shares of stock from Company A, x, and the number of shares of stock from Company B, y, that [PERSON] can purchase. Which equation could represent this relationship?