Venue: NAACL 2025

# EmoDynamiX : Emotional Support Dialogue Strategy Prediction

by Modelling MiXed Emotions and Discourse Dynamics

 Chenwei Wan1,2 Matthieu Labeau1 Chloe Clavel2

1LTCI, Telecom Paris, Institut Polytechnique de Paris, France 2Inria Paris, France

1{chenwei.wan, matthieu.labeau}@telecom-paris.fr

2chloe.clavel@inria.fr

Work done during the first author's internship at Inria.

###### Abstract

Designing emotionally intelligent conversational systems to provide comfort and advice to people experiencing distress is a compelling area of research. Recently, with advancements in large language models (LLMs), end-to-end dialogue agents without explicit strategy prediction steps have become prevalent. However, implicit strategy planning lacks transparency, and recent studies show that LLMs' inherent preference bias towards certain socio-emotional strategies hinders the delivery of high-quality emotional support. To address this challenge, we propose decoupling strategy prediction from language generation, and introduce a novel dialogue strategy prediction framework, **EmoDynamiX**, which models the discourse dynamics between user fine-grained emotions and system strategies using a heterogeneous graph for better performance and transparency1. Experimental results on two ESC datasets show EmoDynamiX outperforms previous state-of-the-art methods with a significant margin (better proficiency and lower preference bias). Our approach also exhibits better transparency by allowing backtracing of decision making.

Footnote 1: Our code is available at [https://github.com/cw-wan/EmO](https://github.com/cw-wan/EmO) DynamiX-v2.

_Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)_, pages 1678–1695

April 29 - May 4, 2025 ©2025 Association for Computational Linguistics

## 1 Introduction

Providing early intervention for individuals experiencing distress from life challenges is crucial for enabling them to transition toward positive lifestyles and, consequently, fostering a more caring society. This need has inspired the NLP community to develop effective Emotional Support Conversation (ESC) systems Liu et al. (2021). These systems aim to alleviate the distress of help-seekers and can be seen as a first step in helping them to find healthcare professionals. Recently, with the release of multi-turn and human-evaluated ESC datasets Liu et al. (2021); Wu et al. (2022), data-driven approaches have begun to surpass rule-based methods Van der Zwaan et al. (2012); van der Zwaan et al. (2012).

Previous work on data-driven ESC has primarily focused on modular dialogue systems as defined by Clavel et al. (2022). Modular systems feature a three-fold workflow: recognizing, planning, and generating. Examples include Tu et al. (2022), Deng et al. (2023), Liu et al. (2021) and Cheng et al. (2022). In these systems, the socio-emotional strategy is selected based on the recognition of the user's state, and responses are generated using customized language decoders conditioned on the predicted strategy. With the emergence of Large Language Models (LLMs) offering enhanced capabilities, LLMs have increasingly dominated both modular and, particularly, end-to-end ESC systems

Figure 1: This figure shows a _possible_ modular ESC dialogue system, within which our dialogue strategy prediction framework outputs the next dialogue strategy to be used to guide an external generative model.



(Chen et al., 2023; Zheng et al., 2023), where strategy planning has shifted from an explicit process to a more implicit, hidden mechanism.

However, implicit dialogue strategy planning with LLMs faces two challenges. First, transparency is often lacking in such implicit decision-making processes due to the well-known "blackbox" property of LLMs (Ludan et al., 2023; Chhun et al., 2024; Lu et al., 2024). Second, recent studies show that preference biases inherited from pretraining data often cause LLMs to struggle with balancing social-oriented and task-oriented goals. Abulimiti et al. (2023) found that in peer-tutoring dialogues, LLMs like ChatGPT frequently prioritize non-hedging strategies, even in situations where hedging strategies would be more appropriate for repairing low rapport between peers. Similarly, Kang et al. (2024) observed that LLMs' strong predisposition towards certain strategies can undermine the outcome of the current stage of ESC. As a result, the overall objectives may be significantly compromised.

To address this limitation, introducing external strategy planners, which offer greater controllability by enabling us to explicitly exclude inappropriate strategies in specific contexts, stands out to be a promising solution. It has been evidenced by both automatic metrics and human evaluations that, an explicit decision-making module can more effectively mitigate preference bias, and improved proficiency in dialogue strategy actually enhances overall generation quality (Kang et al., 2024). This foundational insight leads us to _isolate and focus specifically on dialogue strategy prediction_--a previously intermediate step--with three primary goals: (1) better alignment with human expert strategies, (2) reduced preference bias, and (3) improved transparency.

Additionally, as more powerful LLMs and improved controlled generation techniques continue to emerge (Dathathri et al., 2020), focusing on dialogue strategy prediction offers a more economical pathway to addressing current dialogue system limitations. Explicit dialogue strategy prediction can serve as a flexible, plug-and-play module compatible with state-of-the-art LLMs or as a foundational component for future RL-based methods, where better alignment with human expert strategies is typically a critical first step (Deng et al., 2024).

Therefore, we treat socio-emotional strategy prediction as _an independent task_, as previously explored by Vanel et al. (2023). We illustrate the scope of this task in Figure 1. From this perspective, we raise the following research questions:

* **RQ1**: Can we build a dedicated framework for socio-emotional dialogue strategy prediction that is _more transparent by design_, while outperforming prompting or fine-tuning LLMs in terms of proficiency?
* **RQ2**: Given the importance of emotional intelligence in delivering effective emotional support, can we boost strategy prediction in ESC by by accounting the user's emotion using an ERC (Emotion Recognition in Conversations) module?

In addressing **RQ1**, we introduce EmoDynamiX, a decision-making framework that integrates multiple expert models and incorporates a heterogeneous graph learning module to capture the dynamic interactions between system strategies and user emotions. With graphs, we backtrace the decision-making process, making a step towards greater transparency. We also utilize dummy nodes (Liu et al., 2022; Scarselli et al., 2008) for role-aware information aggregation, enhancing the overall performance.

For **RQ2**, we design a mixed-emotion module to effectively integrate ERC into our framework: (1) By using emotion distributions instead of discrete labels, we reduce the risk of error propagation, as there are domain gaps between ERC and ESC datasets. (2) By tuning emotion distributions, we can effectively model nuanced emotion categories by fusing primary emotions.

We validate the effectiveness of our proposed framework through comparative experiments on two public ESC datasets. The results demonstrate that EmoDynamiX significantly outperforms all previous baselines, achieving superior F1 scores and a notable reduction in preference bias.

## 2 Related Works

### Emotional Support Conversion

The goal of ESC is both social-oriented and task-oriented. It aims to alleviate distress by expressing empathy and providing suggestions (Liu et al., 2021; Cheng et al., 2022). Modelling user states is thus a critical topic in ESC. Previous work commonly approaches this by querying commonsense knowledge graphs (Tu et al., 2022; Deng et al., 2023; Peng et al., 2022; Zhao et al., 2023; Li et al., 

2024). These queries are constructed by concatenating the current utterance with specific knowledge relations, such as xReact. The queries are then fed into COMET (Hwang et al., 2021), a generative model pre-trained on commonsense knowledge graphs, which returns the user's emotional reaction (xReact) to the situation. However, commonsense knowledge is too general to capture the fine-grained emotional states.

In contrast, models specialized in dialogue with context-aware architectures, such as sequential or graph-based models, trained on ERC datasets, can handle these nuances more effectively. Additionally, emotions are frequently mixed in real-life situations, and contradictory emotions (like _Sadness_ and _Joy_) could coexist in specific contexts (Braniecka et al., 2014). Our mixed-emotion modelling approach handles this complexity better and can model a large set of subtle emotional expressions by combining primary emotions without further human annotations (as demonstrated in Section 6).

EmoDynamiX features two key distinctions: (1) We provide an alternative to knowledge-based user state modelling: a mixed-emotion module based on label distributions predicted by a pre-trained ERC model (2) While previous works have explored various dialogue graph structures Li et al. (2024); Peng et al. (2022); Zhao et al. (2023), our method incorporates discourse structure, which has been proven effective in various dialogue tasks Chen and Yang (2021); Li et al. (2023); Zhang et al. (2023), but remains underexplored in ESC.

### Graph Learning in Conversational Tasks

Graph-based approaches have proven effective in various dialogue-related tasks. In recognition tasks, such as conversational emotion recognition and dialogue act recognition, the target speaker turn aggregates information from its neighbors according to the graph structure. Studies by Ghosal et al. (2019), Ishiwatari et al. (2020), Wang et al. (2020), Fu et al. (2023), and Shen et al. (2021) design dialogue graphs based on interactions between speaker roles. Li et al. (2023) and Zhang et al. (2023) construct dialogue graphs based on discourse dependencies parsed with a pre-trained expert model, an approach also applied by Chen and Yang (2021) and Feng et al. (2021) in dialogue summarization. Yang et al. (2023) incorporate commonsense knowledge as heterogeneous nodes. Furthermore, Hu et al. (2021b) and Chen et al. (2023) model multimodal fusion in dialogue graphs.

In predictive dialogue tasks, such as forcasting the next dialogue act, decisions rely on global information extracted from graphs. Previous works have utilized simple readout functions, such as mean/max pooling Joshi et al. (2021) and linear layers Raut et al. (2023). Our approach introduces dummy nodes as special placeholders for information aggregation. While dummy nodes have been previously used in other graph-learning tasks, such as graph classification and subgraph isomorphism matching Liu et al. (2022), they have primarily served as alternatives to _readout_ functions, which are used for obtaining embeddings of graphs or subgraphs. We are the first to employ dummy nodes in a predictive dialogue task, which is particularly useful, since it allows to clearly model role-aware interactions with previous speaker turns.

## 3 Problem Formulation

The task of predicting the next dialogue strategy can be written as a multi-class classification problem: assuming a dialogue comprising \(T\) speaker turns, we define the dialogue history as \(H^{T}=\{U^{T},A^{T},ST^{T}\}\) where \(U^{T}=\{u_{t}\}_{t=1}^{T}\) is the sequence of utterances, and each \(u_{t}=\{w_{n}\}_{n=1}^{N^{t}}\) is a sequence of \(N^{t}\) words. \(A^{T}=\{a_{t}\}_{t=1}^{T}\)is the sequence of speaker roles, with \(a_{t}\in\{\texttt{user},\texttt{system}\}\). \(ST^{T}=\{st_{t}\}_{t=1}^{T}\) is the sequence of possible strategies, but they only exist for the agent. Noting \(\mathcal{S}\) the set of strategies, \(I_{\text{user}}=\{t,a_{t}=\texttt{user}\}\) the indexes of turns where the user is speaking, and denoting similarly \(I_{\text{agent}}\), we have that \(\forall t\in I_{\text{agent}},st_{t}\in\mathcal{S}\) and \(\forall t\in I_{\text{user}},st_{t}=\varnothing\). Our task is, given a fixed window size of \(N-1\), to predict the strategy for agent speaker turns, which we formulate as estimating the probability distribution \(\mathbb{P}(st_{N}\mid H_{1}^{N-1})\) upon \(\mathcal{S}\) when \(t\in I_{\text{agent}}\). For the sake of simplicity, from now on we will use indexing from the beginning of the context window and no longer from the entire conversation.

## 4 Methodology

Our framework (see Figure 2) comprises three main components: (1) a semantic modelling module for capturing the semantics of the dialogue context; (2) a heterogeneous graph learning module, designed to capture the complex interplay between the user's emotions and system strategies within the dialogue history; and (3) an MLP classification head which integrates the features obtained from the previous 

modules to produce the prediction result.

### Semantic Modelling

To effectively capture the global semantic information in the dialogue history, we adopt a common method of representing the context in a flattened sequence format:

\[<\texttt{context>}=\llbracket a_{1}\rrbracket,u_{1},\llbracket a_{2} \rrbracket,u_{2},... \tag{1}\]

For each speaker turn, we use its speaker role as the separating token indicating the start of the corresponding utterance. This sequence is encoded using RoBERTa Liu et al. (2019):

\[\mathbf{C}=\texttt{Roberta}(\llbracket\texttt{CLS}\rrbracket,<\texttt{context>}) \tag{2}\]

We use the embedding of the [CLS] token \(\mathbf{C}_{\llbracket\texttt{CLS}\rrbracket}\) from the last hidden layer output as the global semantic representation of the dialogue history \(H^{N-1}_{1}\).

### Heterogeneous Graph Learning

We propose to use a heterogeneous graph (HG) to model the interaction dynamics in the history \(H^{N-1}_{1}\). This graph is formally defined as \(\mathcal{G}=\{\mathcal{V},\mathcal{B}\}\), which are respectively the set of nodes and edges. Both can be of several _types_: broadly, _node types_ correspond to past strategies adopted by the conversational agent, the user's previous emotional states, and the strategy to be predicted; while _edge types_ model the discourse dependencies between dialogue turns and facilitate information aggregation.

**Node Types:** Our heterogeneous graph contains \(N\) nodes \(\mathcal{V}=\{v_{i}\}_{i=1}^{N}\), each corresponding to a speaker turn, including the target turn \(N\). For user turns \(i\in I_{\text{user}}\), \(v_{i}\) is an _emotion node_, which encapsulates the fine-grained emotion state of the user. For agent turns \(i\in I_{\text{agent}}\), \(v_{i}\) is a _system strategy node_, that represents the specific conversational strategy implemented by the agent. Lastly, we introduce the _dummy node_\(v_{N}\) as a placeholder for the target utterance, aggregating information from the two other node types and their interactions.

**Edge Types:** The edges in our heterogeneous graph fulfill dual roles: they model the discourse dependencies between dialogue turns and facilitate information aggregation towards the dummy node. Discourse dependencies correspond to edges between and within emotion and system strategy nodes: we follow Asher et al. (2016)'s definition (which include categories such as _Comment_ and _Elaboration_) and pre-train a discourse parser as proposed by Chi and Rudnicky (2022) on the multiparty discourse dataset STAC Asher et al. (2016). Details regarding the training procedure can be found in Appendix D.2. We note \(\mathcal{R}_{\text{Discourse}}\) the set of possible dependencies; then, \(\forall(i,j)\) such that \(1\leq i,j\leq N-1,\langle v_{i},v_{j}\rangle\in\mathcal{R}_{\text{Discourse}}\). We give more details on these dependencies in Appendix A.2. The remaining edges are aggregating information from system strategy nodes, which we call _self-reference_: \(\forall i\in I_{\text{agent}},\langle v_{i},v_{N}\rangle=r_{\text{self}}\); and from user emotion nodes, which we call _interference_: \(\forall i\in I_{\text{user}},\langle v_{i},v_{N}\rangle=r_{\text{inter}}\). We note \(\mathcal{R}=\mathcal{R}_{\text{Discourse}}\cup\{r_{\text{self}},r_{\text{ inter}}\}\) the set of edge types.

We will describe next how we obtain node embeddings for these three node types, and how the different edge types affect their aggregation.

#### 4.2.1 User Emotion Node Embedding: Mixed Emotion Method

Unlike previous work that relies on commonsense knowledge, we propose leveraging a pre-trained ERC model to predict emotion distributions from user utterances. We then utilize the knowledge contained in these distributions to create embeddings for fine-grained user states using a mixed-prototype approach.

Training an ERC modelOur emotion recognition model consists of a RoBERTa encoder with an MLP classifier. To incorporate the global dialogue context while classifying individual utterances, we concatenate all utterances into a single sequence. We train our model with the DailyDialog dataset Li et al. (2017); since it does not provide annotations for speaker roles, we use the special token [SEP] as the common delimiter between all utterances:

\[<\texttt{uncontext}=[\texttt{SEP}]_{1},u_{1},[\texttt{SEP}]_{2},u_{2},.. \tag{3}\]

This concatenated sequence is then encoded by RoBERTa, from which we extract the embeddings of the \([\texttt{SEP}]_{i}\) tokens (preceding each utterance) from the last hidden layer. These embeddings serve as representations for the corresponding utterances. We note \(\mathcal{E}\) the set of emotions; then, the embeddings are fed into an MLP to derive a vector \(\mathbf{z}^{i}\in\mathbb{R}^{|\mathcal{E}|}\) of scores for each utterance \(u_{i}\):

\[\begin{split}\mathbf{C}^{ERC}&=\texttt{Roberta}( \llbracket\texttt{CLS}\rrbracket,<\texttt{ucontext>})\\ &\mathbf{z}^{i}=\texttt{MLP}(\mathbf{C}^{ERC}_{[\texttt{SEP}]_{i}}) \end{split}\] (4) 

For DailyDialog, we categorize emotions into seven groups: Ekman's six basic emotions plus _Neutral_, collectively referred to as \({\cal E}\). Additional statistical details about DailyDialog, along with our motivation for selecting it, are available in Appendix A.2. Detailed information regarding the implementation and training hyperparameters can be found in Appendix D.2.

Mixed-emotion module:To model the user's emotional states, we employ a trainable _emotion codebook_. It takes the form of a parameter matrix \(\mathbf{E}\in\mathbb{R}^{|{\cal E}|\times h}\) with \(h\) the embedding size for our heterogeneous graph; each of the \(|{\cal E}|\) vector \(\left\{\mathbf{E}_{k}\right\}_{k=1}^{|{\cal E}|}\) encodes a distinct emotion. For an emotion node \(v_{i}\), they are combined into a node embedding \(\mathbf{g}_{e}^{i}\) using the adjusted emotion distribution:

\[\mathbf{g}_{e}^{i}=\mathbf{p}^{i}\cdot\mathbf{E} \tag{5}\]

This distribution is directly obtained through the output scores of our ERC model:

\[\mathbf{p}^{i}=\Bigg{[}\frac{\exp(z_{j}^{i}/\tau)}{\sum_{k}\exp(z_{k}^{i}/\tau)} \bigg{]}_{j=1}^{|{\cal E}|} \tag{6}\]

To utilize the information in the emotion label distribution more effectively, we employ a learnable temperature parameter \(\tau\); details on the impact of the initialization of \(\tau\) can be found in Appendix E.1.

Our mixed emotion approach draws inspiration from MISC, where a mixed-strategy module is proposed to condition the response generation Tu et al. (2022), yet MISC does not study the tuning of the label distribution \(\mathbf{p}\): for example, in an ERC dataset where the label "Neutral" is prevalent, refining the distribution to become a little "sharper" could greatly mitigate the ambiguity in the model's predictions, especially for underrepresented classes.

#### 4.2.2 System Strategy Node Embedding

For a speaker turn \(i\in I_{\text{agent}}\), the dialogue strategy information is encoded as a one hot vector \(\mathbf{s}^{i}\in\{0,1\}^{|{\cal S}|}\). Strategies themselves, as emotions, are represented through a parameter matrix \(\mathbf{S}\in\mathbb{R}^{|{\cal S}|\times h}\). Then, we simply obtain:

\[\mathbf{g}_{st}^{i}=\mathbf{s}^{i}\cdot\mathbf{S} \tag{7}\]

as the embedding of the system strategy node \(v_{i}\).

#### 4.2.3 Dummy Node Embedding

Previous work relies on aggregating heterogeneous graph information using simple readout functions and linear layers, which do not consider speaker roles and lack transparency regarding the contribution of each node to the final decision. To address this, we propose using the dummy node \(v_{t}\) as a placeholder for the target of prediction, which interacts with previous speaker turns in a role-aware manner. We set the embedding of the dummy node as a parameter vector \(\mathbf{g}_{d}\in\mathbb{R}^{h}\), hence being trainable and shared among all dialog graphs.

#### 4.2.4 Relational Graph Attention Layers

We previously defined the initial node representations for our three node types. Then, we can employ relational graph attention networks Busbridge et al. (2019) to update these node representa

Figure 2: The overview of our proposed model that consists of a semantic modelling module, a heterogeneous graph learning module, and an MLP classification head.

 

tions. Choosing a number \(K\) of attention heads, we define a relation graph attention (RGAT) layer by defining _keys_, _queries_ and _values_ parameter matrices \({\mathbf{W}}^{(r,k)}_{K},{\mathbf{W}}^{(r,k)}_{Q},{\mathbf{W}}^{(r,k)}_{V}\) for each attention head \(k\) and possible type of edge \(r\in\mathcal{R}\). We begin by computing the attention weights \(\alpha^{(r_{ij},k)}_{i,j}\) between \(v_{i}\) and \(v_{j}\) under relation type \(r_{ij}=\langle v_{i},v_{j}\rangle\) using:

\[a^{(r_{ij},k)}_{i,j} =\sigma({\mathbf{W}}^{(r_{ij},k)}_{Q}{\mathbf{g}}^{i}+{\mathbf{W}}^{(r_{ij}, k)}_{K}{\mathbf{g}}^{j}) \tag{8}\] \[\alpha^{(r_{ij},k)}_{i,j} =\frac{\exp(a^{(r_{ij},k)}_{i,j})}{\sum_{r\in\mathcal{R}}\sum_{m \in\mathcal{N}_{r}(i)}\exp(a^{(r,k)}_{i,m})}\]

where \(\sigma\) denotes the LeakyReLU function and \(\mathcal{N}_{r}(i)\) denotes the set of the indexes of neighbouring nodes of \(v_{i}\) under the edge type \(r\). The result of the multi-head attention for node \(v_{i}\) is then:

\[{\mathbf{h}}^{i}=\|_{k=1}^{K}\sigma(\sum_{r\in\mathcal{R}}\sum_{m\in\mathcal{N}_{ r}(i)}\alpha^{(r,k)}_{i,m}{\mathbf{W}}^{(r,k)}_{V}{\mathbf{g}}^{m}) \tag{9}\]

where \(\|\) denotes concatenation. To avoid gradient vanishing, we also add residual connections between RGAT layers and obtain the new representation for node \(v_{i}\):

\[{\mathbf{g}}^{(1),i}={\mathbf{h}}^{i}+{\mathbf{g}}^{i} \tag{10}\]

In our model, we use the embedding \({\mathbf{g}}^{(L),N}\) of the dummy node after applying \(L\) RGAT layers as representation for _the entire heterogeneous dialogue graph_.

### Next Dialogue Strategy Prediction

We concatenate our global semantic embedding \(\mathbf{C}_{\texttt{[CLS]}}\) with the heterogeneous graph embedding \({\mathbf{g}}^{(L)}_{N}\); this combined representation is fed into a simple MLP classification layer to compute a probability distribution upon \(\mathcal{S}\):

\[{\mathbf{o}}=softmax(\mathtt{MLP}(\mathbf{C}_{\texttt{[CLS]}}\|{\mathbf{g}}^{(L),N})) \tag{11}\]

which finally gives \(\mathbb{P}(st_{N}~{}|~{}H_{1}^{N-1})=o_{st_{N}}\). We adopt the _weighted_ cross-entropy loss as our training objective: to address class imbalance, we adjust the loss contribution from each class based on its prevalence, weighting it in proportion inverse to its frequency in the training dataset.

## 5 Experiments

### Experimental Setups

**Datasets** To make our model learn strategies beneficial for both social and task-oriented goals, we select two ESC datasets (in English) where dialogues have been human-evaluated and filtered to ensure that the conversational outcomes are positive and the strategies applied are socially appropriate: (i) **ESConv**Liu et al. (2021), an ESC dataset annotated by trained crowd-workers. It comprises 1,300 dialogues and features 8 dialogue strategies. We adhere to the official train/dev/test split2:, (ii) **AnnoMI**Wu et al. (2022), an expert-annotated counselling dataset. It includes 133 dialogues and features 9 therapist strategies. We make the train/dev/test split with an 8:1:1 ratio. Detailed dataset statistics are provided in Appendix A.1. For both datasets, we set the context window size to 5 utterances3, resulting in 18,376 samples for ESConv and 4,442 samples for AnnoMI.

Footnote 2: [https://huggingface.co/datasets/thu-coal/esconv](https://huggingface.co/datasets/thu-coal/esconv)

Footnote 3: We employ a _sliding window_ method to generate training samples: for each supporter utterance in a dialogue, we take the five preceding utterances as the dialogue history and use the current dialogue strategy as the target for prediction.

**Baselines** To provide extensive comparisons, we choose baselines from three criteria: (i) promptting LLMs SOTA in dialogue tasks, using task description and supplementary information: **Chat- GPT4**OpenAI (2023) and **LLaMA3-70B**Meta (2024) with 2-shot learning (_+2 shot_) or emotion labels (_+ ERC_). We excluded Chain-of-Thought Wei et al. (2024) prompting because it has already been shown to be ineffective for our task Kang et al. (2024); (ii) fine-tuning LLMs as general-purpose dialogue strategy predictors: **RoBERTa**Liu et al. (2019), **BART**Lewis et al. (2020) and **LLaMA3-8B**Meta (2024); (iii) specialized models for emotional support dialogue strategy prediction: **MISC**Tu et al. (2022), **MultiESC**Cheng et al. (2022), **KEMI**Deng et al. (2023) and **TransESC**Zhao et al. (2023). For more details see Appendix C.

Footnote 4: The version of ChatGPT is gpt-3.5-turbo-0301

**Evaluation Metrics** We use macro F1 score (\(\mathcal{M}\)**-F1**) and weighted F1 score (\(\mathcal{W}\)**-F1**) as metrics for evaluating the proficiency of strategy prediction models, since the ground truth strategies in the two datasets have been validated by human evaluators. Given the unbalanced nature of ESC datasets, the accuracy score is not an ideal choice as it can unfairly favor models that predominantly predict the majority classes. We also incorporate the preference bias score (\(\mathcal{B}\)) as defined by Kang et al. (2024) to quantify the extent to which the model favors its preferred strategies over non-preferred ones (implementation details in Appendix D.1).

 

dialogue strategy predictor should achieve strong F1 scores while minimizing preference bias.

**Implementation Details** We implemented our proposed method using PyTorch Paszke et al. (2019), initializing with the pre-trained weights from RoBERTa and employing the tokenization tools from Huggingface Transformers Wolf et al. (2020). For optimization, we used the AdamW optimizer Loshchilov and Hutter (2019). Detailed hyperparameter settings can be found in Appendix D.3.

### Overall Performance

As shown in Table 1, EmoDynamiX outperforms previous SOTA methods across all evaluation metrics. Compared to TransESC, EmoDynamiX significantly reduces the preference bias score by 38% and achieves higher F1 scores. This suggests that while TransESC also models dialogue state transitions, our ERC-based mixed-emotion approach captures the nuances of user emotion states more effectively, leading to better predictions, as further validated by our ablation study. Furthermore, compared to MultiESC, the previous SOTA model with a low bias score, EmoDynamiX excels across all metrics by a substantial margin. Another interesting result is that models based on specific case knowledge (KEMI) and general commonsense knowledge (MISC) are less effective as dialogue strategy predictors.

Comparisons with two LLM prompting baselines indicate that using LLMs alone for emotional support dialogue prediction is significantly constrained by their inherent biases, even when examples or emotion recognition is provided through prompts. The bias scores for LLM-prompting baselines are significantly higher, ranging from 0.77 to 1.39. Among the LLM-fine-tuning baselines, LLLaMA3-8B achieves the highest F1 scores. RoBERTa generally exhibits a lower bias score, while BART emerges as a balanced option. Nevertheless, these baselines still lag behind EmoDynamiX by a considerable margin.

### Ablation Study

We conducted ablation studies (Table 2) and investigated whether the following modules improves the results of next strategy prediction:

**Modelling user emotions and agent strategies in dialogue context.** We compared two simplified versions: (1) flattened dialogue history only (_RoBERTa_ in Table 1); (2) flattened context with emotions and strategies inserted as tags (_w/o Graph_). Although _w/o Graph_ outperforms _RoBERTa_, there remains a significant gap compared to EmoDynamiX. This indicates that while incorporating emotions and strategies is beneficial, the effectiveness is still limited without our graph-learning module.

**Modelling mixed emotions.** We modelled user emotional states with one-hot vectors instead (_w/o Mixed Emotion_). The resulting decreases in all metrics highlight the importance of leveraging emotion distributions, not just labels, for capturing fine-grained user emotion states.

**Modelling discourse structure.** We connected

\begin{table}
\begin{tabular}{l l c c c c c c} \hline \hline  & **Model** & \multicolumn{4}{c}{ESConv} & \multicolumn{4}{c}{AnnoMI} \\ \cline{3-6}  & & \(\mathcal{M}\)-F1† & \(\mathcal{W}\)-F1� & \(\mathcal{B}\downarrow\) & \(\mathcal{M}\)-F1† & \(\mathcal{W}\)-F1† & \(\mathcal{B}\downarrow\) \\ \hline \multirow{5}{*}{Prompting LLMs} & LLaMA3-70B Meta (2024) & 15.36 & 18.45 & 1.03 & 8.38 & 9.01 & 1.24 \\  & + _2 shot_ & 17.70 & 21.47 & 1.29 & 9.52 & 9.13 & 1.11 \\  & + _ERC_ & 15.70 & 19.32 & 1.12 & 8.28 & 9.02 & 1.30 \\  & ChatGPT OpenAI (2023) & 18.14 & 20.27 & 0.88 & 20.31 & 18.12 & 1.21 \\  & + _2 shot_ & 16.55 & 20.01 & 0.73 & 15.29 & 14.22 & 1.39 \\  & + _ERC_ & 16.50 & 18.79 & 0.77 & 16.17 & 15.60 & 0.89 \\ \hline \multirow{3}{*}{Finetuning LLMs} & RoBERTa Liu et al. (2019) & 25.04 & 27.94 & 0.68 & 22.26 & 27.25 & 0.64 \\  & BART Lewis et al. (2020) & 25.66 & 29.08 & 0.64 & 22.94 & 29.68 & 1.07 \\  & LLMaMa3-8B Meta (2024) & 25.91 & 29.82 & 0.83 & 23.77 & 29.98 & 0.81 \\ \hline \multirow{5}{*}{Specialized Models} & MISC Tu et al. (2022) & 20.91 & 24.93 & 0.89 & - & - & - \\  & MultiESC Cheng et al. (2022) & 25.73 & 29.31 & 0.61 & - & - & - \\ \cline{1-1}  & KEMI Deng et al. (2023) & 24.69 & 26.80 & 0.86 & - & - & - \\ \cline{1-1}  & TransESC Zhao et al. (2023) & 26.28 & 31.33 & 0.73 & - & - & - \\ \hline Ours & _EmoDynamiX_ & **27.70†** & **32.71†** & **0.45†** & **27.92†** & **35.33†** & **0.50 †** \\ \hline \hline \end{tabular}
\end{table}
Table 1: Experimental results on two ESC datasets. The best results are **bolded** and the second best are underlined. ‡ indicates statistically significant improvement (\(p<0.05\)). Since MultiESC has adopted a new set of labels, we merge the updated ones with the original annotations to ensure a fair comparison. Due to the unavailability of TransESC’s data preprocessing pipeline, we report the reproduced results based on their released train/dev/test split.

 

the nodes in simple sequential order instead of discourse structure (_w/o Discourse Parser_). Although this led to drops in all metrics, the declines were not substantial. We hypothesize that the domain gap between the STAC dataset and the ESC datasets may limit the discourse parsing module's effectiveness.

**Use of dummy nodes for information aggregation** We replaced dummy nodes with traditional mean-max pooling Joshi et al. (2021) (_w/o Dummy Node_). We observed performance decreases, with a more significant decline on AnnoMI, indicating that our dummy node design is particularly beneficial in low-resource settings.

## 6 In-depth Analysis of EmoDynamiX

We illustrated a case study using a snippet from ESConv, as shown in Figure 3. The case involves the agent deciding which strategy to apply after the user's emotional state has transitioned positively from _Frustration_ (as _Frustration_ is not a category in DailyDialog, our mixed-emotion module models it as moderated sadness with a little anger) to _Joy_. The ground truth here is _Affirmation and Reassurance_, which acknowledges the user's positive transition and encourages consolidation of positive mood. By looking at the attention weights of dummy node edges, we can observe the contribution of each node in decision-making. We notice that, as the RGAT layer deepens, the dummy node shifts its attention from previously applied strategies to the user's emotional transition, with higher weights applied to edges connecting with the emotion state nodes (especially _Frustration_). In short, our graph-learning module effectively captures clues from emotion/strategy dynamics.

We further study the disagreements between the predictions and human strategies using the confusion matrix (Appendix E.3). Determining the appropriate timing for emotion-related dialogue strategies versus task-oriented ones is particularly challenging. The model frequently predicts _Providing Suggestions_ whereas the human strategies are among the three emotion-related ones: _Reflec

\begin{table}
\begin{tabular}{l c c c c c c} \hline \multirow{2}{*}{**Model**} & \multicolumn{4}{c}{ESConv} & \multicolumn{4}{c}{AnnoMI} \\ \cline{2-7}  & \(\mathcal{M}\)-F1\(\dagger\) & \(\mathcal{W}\)-F1\(\dagger\) & \(\mathcal{B}\)\(\downarrow\) & \(\mathcal{M}\)-F1\(\dagger\) & \(\mathcal{W}\)-F1\(\dagger\) & \(\mathcal{B}\)\(\downarrow\) \\ \hline _EmoDynamiX_ & **27.70** & **32.71** & **0.45** & **27.92** & **35.33** & **0.50** \\ w/o Graph Learning & 25.72\({}_{+1.88}\) & 29.31\({}_{+1.40}\) & 0.78\({}_{+0.32}\) & 26.95\({}_{+0.97}\) & 29.46\({}_{+5.87}\) & 0.73\({}_{+0.23}\) \\ w/o Mixed Emotion & 25.90\({}_{+1.80}\) & 29.45\({}_{+3.28}\) & 0.66\({}_{+0.21}\) & 24.71\({}_{+3.21}\) & 30.25\({}_{+5.08}\) & 0.70\({}_{+0.20}\) \\ w/o Discourse Parser & 26.64\({}_{+1.06}\) & 30.12\({}_{+1.59}\) & 0.59\({}_{+1.04}\) & 27.04\({}_{+0.88}\) & 31.59\({}_{+1.74}\) & 0.60\({}_{+0.10}\) \\ w/o Dummy Node & 25.46\({}_{+1.24}\) & 29.80\({}_{+1.91}\) & 0.73\({}_{+0.28}\) & 24.73\({}_{+3.19}\) & 29.00\({}_{+0.33}\) & 0.72\({}_{+0.22}\) \\ \hline \end{tabular}
\end{table}
Table 2: Evaluation results of ablation study.

Figure 4: Analysis on the correlation between the top-10 disagreement patterns (Ground Truth -> Prediction) and their most influential emotion categories.

Figure 3: Case study: Dialogue history and ground truth (left); visualization of the heterogeneous graph structure (middle); attention weights of the dummy node edges (right).

 

tion of feelings, Self-disclosure_, and _Affirmation and Reassurance_. Notably, over 60% of emotion-related strategies were categorized as task-oriented ones, highlighting the difficulty in making choices between these two strategy categories, as also discussed by Galland et al. (2022). We further analyze the disagreement patterns between predicted and human strategies. By looking at their correlations with the primary emotion categories of emotion nodes with the highest attention weights (Figure 4), we find that "Neutral" contributes a larger proportion to these disagreements in general compared to its overall representation in the ERC module's output distribution (59.22%, as shown in Appendix E.2). This suggests that strategies are easier to predict when the model can pick up the user emotions expressed in the context.

## 7 Conclusions

In this paper, we propose EmoDynamiX, a socio-emotional dialogue strategy prediction framework that aggregates expert models and uses heterogeneous graphs to model the conversational dynamics of user states and system strategies. Our approach significantly improves all baselines on two public ESC datasets, and takes a step towards transparency by analyzing attention weights in the indepth study.

### Limitations on Ground Truths

Although the ESC datasets we use have all been evaluated by humans, we cannot fully ensure that no other strategies, aside from the ground truth, could have been effective in the same context. However, we currently lack a protocol for human evaluation at the strategy-planning stage. Besides, human evaluation is more suitable to be performed after the generation stage.

**Generalizability to Other Languages** We evaluated the effectiveness of our proposed architecture using only two English datasets. It remains to be seen whether our approach can generalize to other languages or multi-language settings. It is also worth noting that since EmoDynamiX is based on expert models pre-trained on English datasets to acquire knowledge about discourse structure and emotion recognition, it may inherit cultural biases from these datasets Gelfand et al. (2011); Hall (1976), potentially influencing the strategy prediction.

**Limitations on Expert Modules** Since ERC and discourse parsing are not the primary contributions of our research, we did not investigate the impact of using different model architectures or datasets for their training. The training and integration of a cross-domain ERC module and discourse parser could be considered in future studies.

**Distance to Practical Application** Although our method outperformed previous baselines significantly, its performance remains unsatisfactory. This underscores the complexity of the task and indicates that additional work is required to make the socio-emotional strategy predictor a robust component in future ESC agents.

### Ethics Statement

**Intent of Technology** We insist that conversational AI should not be developed to replace humans. Therefore, it is crucial to maintain a clear line between AI and humans Ethique et al. (2024). Given that the training data for conversational AI, including the two datasets we selected, are primarily curated by humans, the AI (especially those trained using end-to-end methods) may exhibit human-like behaviors. For instance, in Figure 1, the system learns to utilize _Self-disclosure_ strategy by expressing feelings of loneliness, which is not consistent with ethical recommendations. We stress that strategies leading to such human-like behaviors should be applied cautiously and potentially restricted in real-world applications to ensure safety. We believe that our approach, which allows us to explicitly set desired behaviors for AI, can provide better control over conversational AI in the future.

**Data Privacy** All experiments were conducted using existing datasets derived from public scientific research. Any personally identifiable and sensitive information, such as user and platform identifiers, has been removed from these datasets.

**Medical Disclaimer** We do not provide treatment recommendations or diagnostic claims.

**Transparency** We detail the statistics of the datasets and the hyper-parameter settings of our method. Our analysis aligns with the experimental results.

## Acknowledgement

We thank the anonymous reviewers for their valuable comments.

This work was partially funded by the ANR-23-CE23-0033-01 SINNet project and benefited from the ANR-23-IACL-0008 project under the France 2030 plan 



## References

* A. Abulimiti, C. Clavel, and J. Cassell (2023)How about kind of generating hedges using end-to-end neural models? In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, Canada, pp. 877-892. External Links: Link Cited by: SS4.
* N. Asher, J. Hunter, M. Morey, B. Farah, and S. Afantenos (2016)Discourse structure and dialogue acts in multiparty dialogue: the STAC corpus. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), Portoroz, Slovenia, European Language Resources Association (ELRA), Cited by: SS5.
* A. Braniecka, E. Trzebinska, A. Dowgiert, and A. Wytykowska (2014)Mixed emotions and coping: The benefits of secondary emotions. PloS one9 (8), pp. e103940. External Links: Document, ISSN 1530-022X Cited by: SS1.
* D. Busbridge, D. Sherburn, P. Cavallo, and N. Y. Hammerla (2019)Relational graph attention networks. arXiv preprint arXiv:1904.05811. Cited by: SS1.
* C. Busso, W. Bulut, C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. N. Chang, S. Lee, and S. Narayanan (2008)IEMOCap: interactive emotional dyadic motion capture database. Language resources and evaluation42, pp. 335-359. External Links: Link Cited by: SS1.
* F. Chen, J. Shao, S. Zhu, and H. Tao Shen (2023)Multivariate, multi-frequency and multimodal: rethinking graph neural networks for emotion recognition in conversation. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vol. , pp. 10761-10770. External Links: Document, ISSN 1530-022X Cited by: SS1.
* J. Chen and D. Yang (2021)Structure-aware abstractive conversation summarization via discourse and action graphs. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online, pp. 1380-1391. External Links: Link Cited by: SS1.
* M. Chen, X. Yu, W. Shi, U. Awasthi, and Z. Yu (2023)Controllable mixed-initiative dialogue generation through prompting. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Toronto, Canada, pp. 951-966. External Links: Link Cited by: SS1.
* Y. Cheng, W. Liu, W. Li, J. Wang, R. Zhao, B. Liu, X. Liang, and Y. Zheng (2022)Improving multi-turn emotional support dialogue generation with lookahead strategy planning. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates, New York, NY, USA, pp. 3014-3026. External Links: ISBN 978-1-4503-3213-1, Link Cited by: SS1.
* C. Chhun, F. M. Suchanek, and C. Clavel (2024)Do language models enjoy their own stories? prompting large language models for automatic story evaluation. Transactions of the Association for Computational Linguistics12, pp. 1122-1142. External Links: Link, Document Cited by: SS1.
* T. Chi and A. Rudnicky (2022)Structured dialogue discourse parsing. In Proceedings of the 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue, Edinburgh, UK, pp. 325-335. External Links: Link, Document Cited by: SS1.
* C. Clavel, M. Labeau, and J. Cassell (2022)Socio-conversational systems: three challenges at the crossroads of fields. Frontiers in Robotics and AI9, pp. 937825. External Links: Link, Document Cited by: SS1.
* S. Dathathri, A. Madotto, J. Lan, J. Hung, E. Frank, P. Molino, J. Yosinski, and R. Liu (2020)Plug and play language models: a simple approach to controlled text generation. In International Conference on Learning Representations, Cited by: SS1.
* Y. Deng, W. Zhang, W. Lam, S. Ng, and T. Chua (2024)Plug-and-play policy planner for large language model powered dialogue agents. In The Twelfth International Conference on Learning Representations, Cited by: SS1.
* Y. Deng, W. Zhang, Y. Yuan, and W. Lam (2023)Knowledge-enhanced mixed-initiative dialogue system for emotional support conversations.. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, Canada, pp. 4079-4095. External Links: Link, Document Cited by: SS1.
* C. Ethique, C. Noiville, C. Pelachaud, P. Debre, J. Ganascia, and R. Chatila (2024)COMETS opinion 2024-4 -"The phenomenon of attachment to "social robots". A call for vigilance among the scientific research community". Technical report CNRS COMETS. Cited by: SS1.
* X. Feng, X. Feng, B. Qin, and X. Geng (2021)Dialogue discourse-aware graph model and data augmentation for meeting summarization. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, pp. 3808-3814. External Links: Link, Document Cited by: SS1.
* 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5. External Links: Link, Document Cited by: SS1.
* L. Galland, C. Pelachaud, and F. Pecune (2022)Adapting conversational strategies in information-giving human-agent interaction. Frontiers in Artificial Intelligence5, pp. 1029340.



Michele J Gelfand, Jana L Raver, Lisa Nishii, Lisa M Leslie, Janetta Lun, Beng Chong Lim, Lili Duan, Assaf Almaiaicho, Soon Ang, Jakobina Arnadottir, et al. 2011. Differences between tight and loose cultures: A 33-nation study. _science_, 332(6033):1100-1104.
* Ghosal et al. [2019] Deepanway Ghosal, Navonil Majumder, Soujanya Poria, Niyari Chhaya, and Alexander Gelbukh. 2019. DialogueGCN: A graph convolutional neural network for emotion recognition in conversation. In _Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)_, pages 154-164, Hong Kong, China. Association for Computational Linguistics.
* Hall [1976] Edward T Hall. 1976. _Beyond culture_. Anchor.
* Hinton et al. [2015] Geoffrey Hinton, Oriol Vinyals, and Jeffrey Dean. 2015. Distilling the knowledge in a neural network. In _NIPS Deep Learning and Representation Learning Workshop_.
* Hu et al. [2021a] Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021a. Lora: Low-rank adaptation of large language models. _arXiv preprint arXiv:2106.09685_.
* Hu et al. [2021b] Jingwen Hu, Yuchen Liu, Jinming Zhao, and Qin Jin. 2021b. MMGCN: Multimodal fusion via deep graph convolution network for emotion recognition in conversation. In _Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)_, pages 5666-5675, Online. Association for Computational Linguistics.
* Hwang et al. [2021]Jena D Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, and Yejin Choi. 2021. (comet-) atomic 2020: On symbolic and neural commonsense knowledge graphs. In _Proceedings of the AAAI Conference on Artificial Intelligence_, volume 35, pages 6384-6392.
* Ishiwatari et al. [2020] Taichi Ishiwatari, Yuki Yasuda, Taro Miyazaki, and Jun Goto. 2020. Relation-aware graph attention networks with relational position encodings for emotion recognition in conversations. In _Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)_, pages 7360-7370, Online. Association for Computational Linguistics.
* Joshi et al. [2021]Rishabh Joshi, Vidhisha Balachandran, Shikhar Vasishth, Alan Black, and Yulia Tsvetkov. 2021. Dialograph: Incorporating interpretable strategy-graph networks into negotiation dialogues. In _International Conference on Learning Representations_.
* Kang et al. [2024] Dongjin Kang, Sunghwan Kim, Taeyoon Kwon, Seungjun Moon, Hyunsouk Cho, Youngjae Yu, Dongha Lee, and Jinyoung Yeo. 2024. Can large language models be good emotional supporter? mitigating preference bias on emotional support conversation. In _Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)_, pages 15232-15261, Bangkok, Thailand. Association for Computational Linguistics.
* Lewis et al. [2020] Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In _Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics_, pages 7871-7880, Online. Association for Computational Linguistics.
* Li et al. [2024] Ge Li, Mingyao Wu, Chensheng Wang, and Zhuo Liu. 2024. DQ-hgan: A heterogeneous graph attention network based deep q-learning for emotional support conversation generation. _Knowledge-Based Systems_, 283:111201.
* Li et al. [2023] Wei Li, Luyao Zhu, Rui Mao, and Erik Cambria. 2023. Skaier: A symbolic knowledge integrated model for conversational emotion recognition. _Proceedings of the AAAI Conference on Artificial Intelligence_, 37(11):13121-13129.
* Li et al. [2017] Yanran Li, Hui Su, Xiaoyu Shen, Wenjie Li, Ziqiang Cao, and Shuzi Niu. 2017. DailyDialog: A manually labelled multi-turn dialogue dataset. In _Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)_, pages 986-995, Taipei, Taiwan. Asian Federation of Natural Language Processing.
* Liu et al. [2021] Siyang Liu, Chujie Zheng, Orianna Demasi, Sahand Sabour, Yu Li, Zhou Yu, Yong Jiang, and Minlie Huang. 2021. Towards emotional support dialog systems. In _Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)_, pages 3469-3483, Online. Association for Computational Linguistics.
* Liu et al. [2022] Xin Liu, Jiayang Cheng, Yangqiu Song, and Xin Jiang. 2022. Boosting graph structure learning with dummy nodes. In _International Conference on Machine Learning_, pages 13704-13716. PMLR.
* Liu et al. [2019] Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. _arXiv preprint arXiv:1907.11692_.
* Loshchilov and Hutter [2019] Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In _International Conference on Learning Representations_.
* Lu et al. [2024]Yiming Lu, Yebowen Hu, Hassan Foroosh, Wei Jin, and Fei Liu. 2024. Strux: An llm for decision-making with structured explanations. _Preprint_, arXiv:2410.12583 

Josh Magnus Ludan, Yixuan Meng, Tai Nguyen, Saurabh Shah, Qing Lyu, Marianna Apidianaki, and Chris Callison-Burch. 2023. Explanation-based finetuning makes models more robust to spurious cues. In _Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)_, pages 4420-4441, Toronto, Canada. Association for Computational Linguistics.
* Meta [2024]Meta. 2024. Meta Ilama 3. [https://llama.meta.com/llama3/](https://llama.meta.com/llama3/).
* OpenAI [2023]OpenAI. 2023. Chatgpt. [https://openai.com/blog/chatgpt](https://openai.com/blog/chatgpt).
* Paszke et al. [2019] Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. _Advances in neural information processing systems_, 32.
* Peng et al. [2022] Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie, Yajing Sun, and Yunpeng Li. 2022. Control globally, understand locally: A global-to-local hierarchical graph network for emotional support conversation. In _Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22_, pages 4324-4330. International Joint Conferences on Artificial Intelligence Organization. Main Track.
* Poria et al. [2019] Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Gautam Naik, Erik Cambria, and Rada Mihalcea. 2019. MELD: A multimodal multi-party dataset for emotion recognition in conversations. In _Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics_, pages 527-536, Florence, Italy. Association for Computational Linguistics.
* Raut et al. [2023] Aritra Raut, Sriparna Saha, Anutoshi Maitra, and Roshni Ramnani. 2023. Sentiment aided graph attentive contextualization for task oriented negotiation dialogue generation. In _Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)_, pages 661-674, Nusa Dua, Bali. Association for Computational Linguistics.
* Reimers and Gurevych [2019] Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In _Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)_, pages 3982-3992, Hong Kong, China. Association for Computational Linguistics.
* Scarselli et al. [2008] Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. _IEEE transactions on neural networks_, 20(1):61-80.
* Shen et al. [2021] Weizhou Shen, Siyue Wu, Yunyi Yang, and Xiaojun Quanz. 2021. Directed acyclic graph network for conversational emotion recognition. In _Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)_, pages 1551-1560, Online. Association for Computational Linguistics.
* Tu et al. [2022] Quan Tu, Yanran Li, Jianwei Cui, Bin Wang, Ji-Rong Wen, and Rui Yan. 2022. MISC: A mixed strategy-aware model integrating COMET for emotional support conversation. In _Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)_, pages 308-319, Dublin, Ireland. Association for Computational Linguistics.
* van der Zwaan et al. [2012] Janneke M van der Zwaan, Virginia Dignum, and Catholijn M Jonker. 2012. A conversation model enabling intelligent agents to give emotional support. In _Modern Advances in Intelligent Systems and Tools_, pages 47-52. Springer.
* Van der Zwaan et al. [2012] JM Van der Zwaan, V Dignum, and CM Jonker. 2012. A bdi dialogue agent for social support: Specification and evaluation method. In _Proceedings of the 3rd Workshop on Emotional and Empathic Agents@ AAMAS_, volume 2012, pages 1-8.
* Vanel et al. [2023] Lorraine Vanel, Alya Yacoubi, and Chloe Clavel. 2023. A new task for predicting emotions and dialogue strategies in task-oriented dialogue. In _2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII)_, pages 1-8.
* Wang et al. [2020] Dong Wang, Ziran Li, Haitao Zheng, and Ying Shen. 2020. Integrating user history into heterogeneous graph for dialogue act recognition. In _Proceedings of the 28th International Conference on Computational Linguistics_, pages 4211-4221, Barcelona, Spain (Online). International Committee on Computational Linguistics.
* Wei et al. [2024] Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2024. Chain-of-thought prompting elicits reasoning in large language models. In _Proceedings of the 36th International Conference on Neural Information Processing Systems_, NIPS '22, Red Hook, NY, USA. Curran Associates Inc.
* Wolf et al. [2020] Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remii Louf, Morgan Funtowicz, Joe Davison, Sam Shlieifer, Patrick von Platen, Clara Ma, Yacin Jerndine, Julien Phu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Marirama Drame, Quentin Lhoest, and Alexander Rush. 2020. Transformers: State-of-the-art natural language processing. In _Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations_, pages 38-45, Online. Association for Computational Linguistics.
* Wu et al. [2020] Zixiu Wu, Simone Balloccu, Vivek Kumar, Rim Helaoui, Ehud Reiter, Diego Reforgiato Recupero, 

and Daniele Riboni. 2022. Anno-mi: A dataset of expert-annotated counselling dialogues. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6177-6181. Cited by: SS4.
* Kailai Yang et al. (2023)A bipartite graph is all we need for enhancing emotional reasoning with commonsense knowledge. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, CIKM '23, New York, NY, USA, pp. 2917-2927. External Links: ISBN 978-1-538-3811-1, Link, Document Cited by: SS1, SS2.
* S. M Zahiri and J. D. Choi (2018)Emotion detection on tv show transcripts with sequence-based convolutional neural networks. In Workshops at the thirty-second aaai conference on artificial intelligence, Cited by: SS1, SS2.
* D. Zhang, F. Chen, and X. Chen (2023)DualGATs: dual graph attention networks for emotion recognition in conversations. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, Canada, pp. 7395-7408. External Links: ISBN 978-1-538-3811-1, Link, Document Cited by: SS1, SS2.
* Weixiang Zhao et al. (2023)TransESC: smoothing emotional support conversation via turn-level state transition. In Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, pp. 6725-6739. External Links: ISBN 978-1-538-3811-1, Link, Document Cited by: SS1, SS2.
* Z. Zheng, L. Liao, Y. Deng, and L. Nie (2023)Building emotional support chatbots in the era of lms. arXiv preprint arXiv:2308.11584. Cited by: SS1, SS2.

 

Datasets

### ESC Datasets

Following are the two public ESC datasets we use to evaluate our method.

**ESConv**Liu et al. (2021) utilizes eight dialogue strategies: _Reflection of Feelings_, _Self-Disclosure_, _Question_, _Affirmation and Reassurance_, _Providing Suggestions_, _Restatement or Paraphrasing_, _Information_, and _Others_. The distribution of these strategies is depicted in Figure 5. ESConv collects user feedback scores (ranging from 1 to 5) after every few speaker turns to evaluate the effectiveness of emotional support. Notably, 79.9% of the scores are above 4 (Good), indicating a high overall quality of emotional support conversations in ESConv, which successfully alleviated users' negative moods. To ensure fair comparisons with previous baselines, we did not perform filtering, though training the strategy predictors on highly rated strategies and using poorly rated ones as negative samples could be beneficial. The top-3 topics include _Ongoing depression_, _Job crisis_ and _Break up with parterner_.

**AnnoMI**Wu et al. (2022) categorizes therapist behaviors into 4 high-level types: _Reflection_, _Question_, _Input_, and _Other_. These high-level behaviors are further broken down into 9 fine-grained strategies: _Simple Reflection_, _Complex Reflection_, _Open Question_, _Closed Question_, _Information_, _Advice_, _Giving Options_, _Negotiation/Goal-setting_, and _Other_. Since AnnoMI is a small dataset and has very unbalanced strategy distribution, we merged _Advice_, _Giving Options_, and _Negotiation/Goal-setting_ into a single strategy: _Provide Suggestion_, which is aligned with ESConv. The distribution of these strategies is illustrated in Figure 5. AnnoMI comprises 110 (82.7%) high-quality dialogues and 23 (17.3%) low-quality dialogues. To ensure our strategy predictor learns strategies that positively impact users, we excluded all low-quality conversations, retaining only the high-quality ones. The top-3 topics in AnnoMI are _Reducing alcohol consumption_, _Smoking cessation_ and _Weight loss_.

Datasets for Pre-training Expert Models STACAsher et al. (2016) is used for pre-training our discourse parser. It is a multi-party dialogue corpus collected from an online game. It contains 1,081 dialogues, with an average of 8.5 speaker turns per dialogue. STAC includes 16 discourse dependency categories: _Comment, Clarification Question, Elaboration, Acknowledgment, Continuation, Explanation, Conditional, Question-Answer Pair, Alternation, Question-Elaboration, Result, Background, Narration, Correction, Parallel,_ and _Contrast_.

**DailyDialog**Li et al. (2017) is used to pre-train our emotion recognition module. It is an ERC dataset collected from an English learning website. Its topics are closer to everyday issues and thus better suited for ESC compared to other popular counterparts collected from TV shows Poria et al. (2019); Zahiri and Choi (2018) or actor performances Busso et al. (2008). DailyDialog includes 13,118 multi-turn dialogues, with an average of 7.9 speaker turns per dialogue. The emotion labels in this dataset encompass Ekman's six basic emotions (_Aager, Disgust, Fear, Joy, Sadness, Surprise_) and a _Neutral_ class.

## Appendix B Definitions of ESC Strategies

### Strategies in ESConv

**Question**: asking for information related to the problem to help the seeker articulate the issues that they face.

**Restatement or Paraphrasing**: a simple, more concise rephrasing of the seeker's statements that could help them see their situation more clearly.

**Reflection of Feelings**: describe the help-seeker's feelings to show the understanding of the situation and empathy.

**Self-disclosure**: share similar experiences or emotions that the supporter has also experienced to express your empathy.

**Affirmation and Reassurance**: affirm the help-seeker's ideas, motivations, and strengths to give reassurance and encouragement.

**Providing Suggestions**: provide suggestions about how to get over the tough and change the current situation.

**Information**: provide useful information to the help-seeker, for example with data, facts, opinions, resources, or by answering questions.

**Others**: other support strategies that do not fall into the above categories.

### Strategies in AnnoMI

**Question open**: encourage seekers to elaborate on their thoughts, feelings, and experiences, fostering self-exploration and insight. These questions cannot be answered with a simple yes or no and help build rapport and understanding 



**Question closed**: gather specific information, confirm details, or clarify points with concise responses. They are less exploratory but essential for obtaining precise information and ensuring clarity in the conversation.

**Reflection simple**: use statements that convey understanding or facilitate seeker-supporter exchanges. Simple reflection conveys understanding of what the seeker has said and adds little extra meaning.

**Reflection complex**: use reflective statements that show a deeper understanding of the perspective of the seeker and add substantial meaning or emphasis to what the seeker has said.

**Provide suggestion**: provide suggestions (Advice, Options, Goal-Setting) about how to change, but be careful to not overstep and tell them what to do.

**Provide information**: provide useful information to the help-seeker, for example with data, facts, opinions, resources, or by answering questions.

**Other**: exchange pleasantries and use other support strategies that do not fall into the above categories.

## Appendix C Baselines

**ChatGPT**[20] is an advanced language model with 175 billion parameters developed by OpenAI. Using reinforcement learning from human feedback (RLHF), it generates humanlike text and excels in natural language processing tasks such as conversation and content creation. The prompting is constructed with the template in Figure6 and corresponding strategy definitions in AppendixB.1 or AppendixB.2. To facilitate few-shot learning, we built a case library using

Figure 5: Strategy distributions of ESConv (left) and AnnoMI (right).

Figure 6: Prompting template for LLMs. Examples are optional.



the training data and extracted two examples from this library for each inference on the test data. We employed example extraction based on similarity scores computed from sentence-BERT (Reimers and Gurevych, 2019) embeddings.

**LLaMA3 (70B & SB)**Meta, 2024) is a series of instruction-tuned language models developed by Meta, featuring parameter sizes ranging from 8 to 70 billion. These models are specifically optimized for dialogue use cases and demonstrate superior performance compared to many existing open-source chat models on standard industry benchmarks. For the 70B variant, the prompting templates and few-shot methodologies align with those previously described. In contrast, the 8B variant uses flattened dialogue context with speaker tags as input (same for RoBERTa and BART) and employs LoRA (Hu et al., 2021) for parameter-efficient fine-tuning.

**RoBERTa**Liu et al. (2019) is a transformer-based language model that enhances BERT by using more training data, larger batch sizes, and dynamic masking, while removing the Next Sentence Prediction objective. Its robust training approach makes it more effective than the original BERT model across multiple benchmarks.

**BART**Lewis et al. (2020) is a sequence-to-sequence model that combines a bidirectional encoder and an autoregressive decoder, effectively blending BERT and GPT architectures. It's trained to reconstruct original text from corrupted input, making it highly versatile for tasks like text generation, summarization, and translation.

**MISC**Tu et al. (2022) is based on BlenderBot and integrates commonsense knowledge from COMET with a mixed strategy mechanism to simultaneously predict support strategies and generate responses.

**MultiESC**Cheng et al. (2022) is a specialized ESC framework based on BART. It features a lookahead strategy planning mechanism inspired by A* search algorithm to maximize the expected user feedback.

**KEMI**Deng et al. (2023) is based on BlenderBot and integrates domain-specific case knowledge from HEAL with graph querying. The queries are constructed with commonsense knowledge extracted from COMET. KEMI also simultaneously predict support strategies and generate responses.

**TransESC**Zhao et al. (2023) is a specialized ESC framework built upon BlenderBot. It models dialogue state transitions using a graph-based approach and integrates emotion recognition as an additional training objective, utilizing ground-truth emotion labels predicted by an off-the-shelf ERC model. TransESC's modeling of the user's emotional state also leverages commonsense knowledge from COMET.

## Appendix D Implementation Details

### Implementation of the Preference Bias Score

**Preference**\(p_{i}\) indicates the degree to which the model favors strategy \(i\) over others. It is calculated iteratively using the confusion matrix according to the following formula:

\[p^{\prime}_{i}=\frac{\sum_{j}(w_{ij}p_{j})/(p_{i}+p_{j})}{\sum_{j}w_{ji}/(p_{ i}+p_{j})} \tag{12}\]

Here, \(p^{\prime}_{i}\) denotes the updated preference for strategy \(i\) in the next iteration, and \(w_{ij}\) represents the frequency with which the model predicts strategy \(i\) when the actual ground truth is strategy \(j\). Initially, all preferences \(p_{i}\) are set to 1. In our implementation, we perform 20 iterations of this process.

**Preference Bias** is the standard deviation of \(p\):

\[\mathcal{B}=\sqrt{\frac{\sum_{i=1}^{N}(p_{i}-\overline{p})^{2}}{N}} \tag{13}\]

### Implementation Details for Submodules Discourse Parser

We followed exactly the same train/dev/test split and training hyperparameters in the original paper Chi and Rudnicky (2022). The initial learning rate is set to 2e-5 with a linear decay to 0 for 4 epochs. The batch size is 4. The first 10% of training steps is the warmup stage. We tested the discourse parser on the test set and got a 59.0 F1 on link and relation predictions.

**ERC Module** For the pre-training of the ERC module, we split the DailyDialog dataset as provided in the original repository5. The learning rate was set to 2e-5, with 500 warm-up steps and a weight decay of 1e-3. The model was trained for 12,000 steps, and the best model, determined based on performance on the validation set, was used for inference on the test split. The results on the test set were as follows: an accuracy score of 82.26, a macro F1 score of 53.0, and a weighted F1 score of 83.54.

 



### Hyperparameter Settings

For training EmoDynamiX, we configured the batch size to 16 and set the learning rate to 4e-6, with 500 warm-up steps and a weight decay of 1e-3. Additional hyperparameters included a dimensionality of 512 for the heterogeneous graph embeddings, an initial temperature parameter \(\tau\) of 0.5 for the mixed user emotion state module, and 3 layers for relational graph attention. EmoDynamiX was trained for 3000 steps on ESConv and 1200 steps on AnnoMI, separately.

For the pre-training of the ERC module, we set the learning rate to 2e-5, with 500 warm-up steps and a weight decay of 1e-3, training the model for 12,000 steps. For the pre-training of the discourse parser, we adhered to the hyperparameter settings detailed in Chi and Rudnicky (2022). All training procedures were conducted on a single Nvidia GeForce RTX 4090 GPU.

## Appendix E Supplementary Materials for Analysis

### Impact of the Initialization of \(\tau\)

The temperature parameter \(\tau\) adjusts the shape of the probability distributions used in our mixed-emotion module. To understand the impact of the initial value of \(\tau\), we performed extensive experiments, and the results are displayed in Figure 7. We observed that while both "sharpening" (lower \(\tau\)) and "softening" (higher \(\tau\)) the distribution can positively impact the overall model performance, outperforming the original distribution (\(\tau=1\)), "sharpening" the distribution makes the best results. This differs slightly from our expectations, as soft probabilities are typically more advantageous in learning paradigms like knowledge distillation Hinton et al. (2015), which uses distributional knowledge to transfer learning from teacher to student models. We speculate that this outcome might be influenced by the data distribution in the DailyDialog dataset. Since "Neutral" comprises 83% of the labels, it is usually the largest or second largest category in label distributions. If the label is not "Neutral," "Neutral" plays a significant role, modulating the level of the primary emotion label, such as joy or anger. Conversely, when the label is "Neutral," the second largest category provides additional information, like "Neutral" with a hint of anger or sadness. Our results indicate that emphasizing the primary emotion category while retaining the contribution of the second-highest "moderator" category is beneficial to the overall predictive performance.

We also explored more extreme settings. When \(\tau\) approaches 0, the distribution resembles a one-hot vector, leading to performance similar to the model without the mixed-emotion module (indicated by the red line in the figure). Conversely, initializing \(\tau\) too high (100 or more) over-softens the distributions, allowing minor classes to introduce noise, which results in a decline in performance compared to lower \(\tau\) values.

### Output Statistics of the ERC Module

Table 3 presents the output statistics of our pretrained ERC module on the ESConv test set, alongside a comparison with the original label distribution of DailyDialog. Notably, the dialogue scenes in ESConv exhibit a higher emotional intensity compared to those in DailyDialog.

### Confusion Matrix of EmoDynamiX on ESConv

See Figure 8.

Figure 7: Analysis on the initialized value of \(\tau\).



* [16] M. C. Bader, J. A. Krizhevsky, and D. V. Kingma, "Adam: a method for stochastic optimization of neural networks," in _Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)_, volume 2018, pp. 345-379.
* [17] R. G. Hinton, S. Hariharan, and I. Sutskever, "Deep learning with deep convolutional neural networks," _arXiv preprint arXiv:1502.03018_, 2015.
* [18] L. Bottou, Y. Bengio, and P. Vincent, "Dropout: an imperative approach to boosting neural networks," _Neural computation_, vol. 1, no. 1, p. 101502, 2016.
* [19] T. Ba, X. Chen, Z. Li, and W. Dong, "Batch normalization by reducing the number of hidden layers," _CoRR_, abs/1512.03018, 2015.
* [20] N. Srivastava, E. Rabinovich, and A. Shlensov, "Dropout: A simple way to prevent overfitting," in _Advances in Neural Information Processing Systems (NIPS'06)_, ser. 2006.
* [21] F. Chollet, J. Erhan, I. Goodfellow, and J. Pouget, "Generators for large scale machine translation," _JMLR_, vol. abs/1412.1208, 2014.
* [22] O. Russakovsky, I. Sutskever, and I. Sutskever, "Very Large Scale Visual Networks for Large Scale Visual Networks," _IEEE Transactions on Image Processing_, vol. 12, no. 1, pp. 1-10, Jan. 2015.

[MISSING_PAGE_POST]