# Editorial: Advances in Virtual Agents and Affective Computing for the Understanding and Remediation of Social Cognitive Disorders

Eric Brunet-Gouet, Ali Oker, Jean-Claude Martin, Ouriel Grynszpan, Philip

L. Jackson

► To cite this version:

Eric Brunet-Gouet, Ali Oker, Jean-Claude Martin, Ouriel Grynszpan, Philip L. Jackson. Editorial: Advances in Virtual Agents and Affective Computing for the Understanding and Remediation of Social Cognitive Disorders. Frontiers in Human Neuroscience, 2016, 9, pp.697. 10.3389/fnhum.2015.00697. hal-01264335

HAL Id: hal-01264335

https://hal.sorbonne-universite.fr/hal-01264335

Submitted on 29 Jan 2016

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
# Editorial: Advances in Virtual Agents and Affective Computing for the Understanding and Remediation of Social Cognitive Disorders

Eric Brunet-Gouet<fnref n="1" />, ²*, Ali Oker<fnref n="1" />, ², Jean-Claude Martin³, Ouriel Grynszpan⁴ and Philip L. Jackson⁵

**Keywords:** virtual reality, social cognition, affective computing, psychotherapy, social cognition in clinical groups

## The Editorial on the Research Topic

### Advances in Virtual Agents and Affective Computing for the Understanding and Remediation of Social Cognitive Disorders

The present topic emphasizes the parallel development of concepts in social neurosciences and in other domains such as computer science, affective computing, virtual reality development, and even hardware technologies. While several researchers in neurosciences pointed out the necessity to consider naturalistic social cognition (Zaki and Ochsner, 2009), the second person perspective (Schilbach et al., 2013), social interaction (Pfeiffer et al.) and reciprocity (de Bruin et al.), both computer and software developments allowed more and more realistic real-time models of our environment and of virtual humans capable of some interaction with users. A new convergence between scientific disciplines might occur from which it is tricky to predict the outcomes in terms of new concepts, methods, and uses.

Although this convergence meets ongoing societal changes (increasing social demands on computer technologies, augmenting funding), it comes with several difficulties for which the current Frontiers in' topic strives to bring some positive answers, and to provide both theoretical arguments and experimental examples. The first problem was about concepts and vocabulary as contributions described in the following were authored by neuroscientists, computer scientists, psychopathologists, each coming with separate knowledge, and key literature. A special attention was given to avoid purely technical descriptions and to focus on the added value of virtual reality in neurosciences and psychopathology. Another problem concerned methods: more complex computerized interaction models results in unpredictable and poorly controlled experiments. In other words, the assets of naturalistic paradigms may be alleviated by the difficulty to match results between subjects, populations, and conditions. It is crucial to consider this question when investigating pathologies that are associated with profoundly divergent behavioral patterns. The last issue we encountered was about heterogeneity of the objectives of the researches presented here. While selection criteria focused on the use of innovative technologies to assess or improve social cognition, the fields of application of this approach were quite unexpected.

The first group of contributions exemplifies how innovation in methods improves understanding and assessment of social cognition disorders or pathology. Timmermans and Schilbach provide technological orientations for investigating alterations of social interaction in

**OPEN ACCESS**

Edited and reviewed by:

Srikantan S. Nagarajan,
University of California, San Francisco,
USA

*Correspondence:**

Eric Brunet-Gouet
ebrunet@ch-versailles.fr

Received: 01 September 2015

Accepted: 11 December 2015

Published: 07 January 2016

**Citation:**
Brunet-Gouet E, Oker A, Martin J-C, Grynszpan O and Jackson PL (2016)
*Editorial: Advances in Virtual Agents and Affective Computing for the Understanding and Remediation of Social Cognitive Disorders.*
Front. Hum. Neurosci. 9:697.
doi: 10.3389/fnhum.2015.00697

<footnote n="1">¹ Faculté de Médecine, Université Versailles Saint-Quentin, Versailles, France, ² Pôle de Psychiatrie, Centre Hospitalier de Versailles, Le Chesnay, France, ³ Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur-Centre National de la Recherche Scientifique, Orsay, France, ⁴ Institut des Systèmes Intelligents et de Robotique, Centre National de la Recherche Scientifique, Université Pierre et Marie Curie, Paris, France, ⁵ École de Psychologie, Université Laval, Québec, QC, Canada</footnote>
psychiatric disorders by the use of dual interactive eye tracking with virtual anthropomorphic avatars. Joyal et al. bring concurrent and construct validities of a newly developed set of virtual faces expressing six fundamental emotions. The relevance of virtual reality was shown with two contributions focusing on anxiety related phenomena. Jackson et al. describe a new environment allowing investigating empathy for dynamic FACSI-coded facial expressions including pain. Based on a systematic investigation of the impact of social stimuli modalities (visual, auditory), Ruch and collaborators are able to characterize the specificity of the interpretation of laughter in people with gelotophobia (Ruch et al.). On the related issue of social anxiety, Aymerich-Franch et al. presented two studies in which public speaking anxiety has been correlated with avatars' similarity of participants' self-representations. Finally, three contributions demonstrate the feasibility and the usefulness of virtual reality settings on chronic developmental and psychiatric conditions like high functioning autism (HFA) or schizophrenia. Grynszpan and Nadel present an original eye-tracking method to reveal the link between gaze patterns and pragmatic abilities in HFA. About schizophrenia, Oker et al. discuss and report some insights on how affective and reactive virtual agents might be useful to assess and remediate several defects of social cognitive disorders. About assessment within virtual avatars on schizophrenia, Park et al. focused on effect of perceived intimacy on social decision making with schizophrenia patients.

The second set of contributions focus on therapeutic intervention with either a cognitive behavioral therapy (CBT) framework or with cognitive remediation/training procedures. CBT interventions share common principles and take in consideration thoughts, feelings or emotions and behaviors in order to generate gradual modification of each of these levels thanks to thought and schema analysis, stress reduction procedures, etc. They were observed to be somehow useful for the treatment of depression, stress disorders, phobias, and are gaining some authority in personality disorders and addictions. The main asset of new technologies is the possibility to control the characteristics of symptom-eliciting stimuli/situations, and

more precisely the degree to which immersion is enforced. For example, Baus and Bouchard provide a review on the extension of virtual reality exposure-based therapy toward recently described augmented reality exposure-based therapy in individuals with phobias. Concerning substance dependence disorders, Hone-Blanchet et al. present another review on how virtual reality can be an asset for both therapy and craving assessment stressing out the possibilities to simulate social interactions associated with drug seeking behaviors and even peers' pressure to consume.

The last contributions of the topic concern social cognitive training or remediation in severe and chronic mental disorders (autistic disorders, schizophrenia). Here, therapies are based on drill and practice or strategy shaping procedures, and, most of the time, share an errorless learning of repeated cognitive challenges. Computerized methods were early proposed for that they do, effortlessly and with limited costs, repetitive stimulations. While, repetition was incompatible with realism in the social cognitive domain, recent advances provide both immersion and full control over stimuli. Georgescu et al. exhaustively reviews the use of virtual characters to assess and train non-verbal communication in HFA. Regarding schizophrenia remediation, Peyroux and Franck presented a new method, named RC2S, which is a cognitive remediation program to improve social cognition in schizophrenia and related disorders.

To conclude briefly, while it is largely acknowledged that social interaction can be studied as a topic of its own, all the contributions demonstrate the added value of expressive virtual agents and affective computing techniques for the experimentation. It also appears that the use of virtual reality is at the very beginning of a new scientific endeavor in cognitive sciences and medicine.

## FUNDING

Authors EB, AO, JM received funding from ANR ANR-11-EMCO-0007.

relationships that could be construed as a potential conflict of interest.

Copyright © 2016 Brunet-Gouet, Oker, Martin, Grynszpan and Jackson. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

## REFERENCES

Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., et al. (2013). Toward a second-person neuroscience. *Behav. Brain Sci.* 36, 393–414. doi: 10.1017/S0140525X12000660

Zaki, J., and Ochsner, K. (2009). The need for a cognitive neuroscience of naturalistic social cognition. *Ann. N.Y. Acad. Sci.* 1167, 16–30. doi: 10.1111/j.1749-6632.2009.04601.x

**Conflict of Interest Statement:** The authors declare that the research was conducted in the absence of any commercial or financial