The More Moral an LLM is, the Smarter It Becomes: Analyzing the Impact of Moral Development on General Problem-Solving in LLMs
Authors: Iseo Kim, Eunjin Hong, Eojin Kang, Juae Kim


Reviewer paper summaries: The paper attempts to explore whether the level of moral development affects reasoning ability. It uses prompts of four levels of moral development to investigate on three Large Language Models (LLMs). The experimental results suggest to some extent that the higher the level of moral development, the stronger the reasoning ability.
Summary of strengths: Linking the level of moral development with reasoning ability is quite interesting. At the same time, discovering that there is indeed a connection between the two is also a good finding.
Summary of weaknesses: 1. Since "Howard Gardner’s theory of multiple intelligences categorizes human intelligence into eight multi-dimensional sets," why analyze the reasoning ability of LLMs from a moral perspective rather than all eight aspects?

2. What is the reason for choosing the three LLMs?

3. Llama3-70b's performance does not align with the author's intended conclusion, but the experimental results are not discussed in detail.

4. Comparing Llama3-70b with Llama3-8b, does this mean that Llama3-70b performs worse than Llama3-8b? Generally, the larger the parameter scale, the better the performance should be.

5. Although the issue is interesting, the analysis is insufficient, and there is no deep insight provided.
Comments, suggestions and typos: In Section 4.3, there is no explanation provided for the uneven distribution of scores for Llama3-70b-instructMMLU, and the paper should clearly state that on average, Llama3-70b-instruct has the highest accuracy in the pre-conventional stage, with precision being the same in the pre-conventional stage and the immoral stage.

In Section 4.3, Figure 3 lists 18 task categories, but the text only describes 17.

The experimental results related to the article are incomplete, for example, the appendix includes "The performance of the Llama3-8b on the MMLU," but other models are not discussed.

Table 1 Pre-conentional stage  ---->Pre-conventional stage
Overall assessment scores: 2