Challenges and Approaches in Designing Social SDS in the LLM Era (2023)

Abstract: Large language models (LLMs) have brought about a significant transformation in spoken dialogue systems (SDSs). It is anticipated that these systems will be implemented into diverse robotic applications and employed in a variety of social settings. The author presents research interest with the aim of realizing social SDSs from multiple perspectives, including task design, turn-taking mechanisms, and evaluation methodologies. Additionally, future research in social SDSs should delve into a deeper understanding of user mental states and a relationship with society via multi-party conversations. Finally, the author suggests topics for discussion regarding the future directions of SDS researchers in the LLM era.

## research interests the advent of large language models (llms) has progressively transformed advanced spoken dialogue systems (sdss) into a commonplace reality. expected to be integrated into a wide range of robotics in the future, these systems are poised to be implemented in different societal contexts. the author has heretofore engaged in the realization of several sdss utilizing android robots @xcite ). while the functionality of these sdss has primarily been limited to laboratory settings, future efforts aim to incorporate real-world environments such as hospitals, shopping malls, and schools, thereby exerting a profound societal impact through the advancement of sds research. ## spoken dialogue system (sds) research in the upcoming years, sds research is expected to shift its focus toward practicality. it is crucial to go beyond mere applications and strive for a more human-like understanding and behavior in sdss. note that it would potentially need another discussion on whether humanlikeness is needed for sdss. ## suggested topics for discussion the author would like to propose the following topics for discussion.