Exploring Large Language Models' Cognitive Moral Development through
  Defining Issues Test
Authors: name: Kumar Tanmay; name: Aditi Khandelwal; name: Utkarsh Agarwal; name: Monojit Choudhury
Published: 2023-09-23 12:17:10

Abstract: The development of large language models has instilled widespread interest
among the researchers to understand their inherent reasoning and
problem-solving capabilities. Despite good amount of research going on to
elucidate these capabilities, there is a still an appreciable gap in
understanding moral development and judgments of these models. The current
approaches of evaluating the ethical reasoning abilities of these models as a
classification task pose numerous inaccuracies because of over-simplification.
In this study, we built a psychological connection by bridging two disparate
fields-human psychology and AI. We proposed an effective evaluation framework
which can help to delineate the model's ethical reasoning ability in terms of
moral consistency and Kohlberg's moral development stages with the help of
Psychometric Assessment Tool-Defining Issues Test.