26

What causes emotional change?
Monitoring emotion in experimental settings and daily life

Abstract
Our emotions are influenced by changes in both our internal states and external environment includinginteractions with others. In this study, we aimed to investigate how emotional responses change through social
interaction in the experimental setting, and to develop a new framework for monitoring the internal change ofemotional states in daily life. The findings of two experiments measuring autonomic responses during interaction
suggested that negative emotions and positive emotions are transmitted differently through interaction. Theinterpersonal dynamics of emotional change found here will help us to understand larger group phenomena suchas crowd joy or panic. Furthermore, for the purpose of logging internal states which dynamically change throughdaily life, we developed a new self-tracking method using exclamations or onomatopoeias (e.g., “NIKONIKO”,“SHOBON”). This kind of framework will contribute to creating the system that support our wellbeing.

Emotional change through social interactionin the experimental setting

A new self-tracking system for monitoringemotion in daily life

Experiment 1 Sharing pain by simultaneously
Negative emotion stimulation of thermal stimulus

Commonlyused method

Participants with weaker reactions elevated their physiological reactivity in response to their partner’s reactions
during face-to-face interaction, but not vice versa.
Face-to-face interaction

Blocking interaction

Person A

Person A

synchrony
Person B ＜Person B

Negative emotion

Physiologicalresponse（Blood Volume Pulse）

strongerweaker

Stimulation

Stimulation

Experiment 2
Positive emotion

Sharing excitement during
collaborative block game

PlayerPartnerPartner※ブロックを抜く前の25秒間の心拍数・ High cognitive load (difficult to answer intuitively)
・ Unsuited to capture physical emotional experience・ Hesitate to answer honestly (esp. negative emotions)
The method
we propose

Reporting emotional states using
exclamations and onomatopoeias

We propose a new self-tracking method using emotional
expression words (exclamations, onomatopoeias) which
are suitable to express physical emotional experience.
positive

Who areyou with?

TimeHow doyou feel?

negativestronger

Positive emotion

Physiologicalresponse（Z-score of Heart Rate）

Play alternatelyin collaboration
with each otherPlayerHappy 0 ：not at all 〜 10：very much
0 ：not at all 〜 10：very much
Sad

What areyou doing?

Participants changed their physiological reactivity inresponse to their partner’s reactions, whether theirreaction is stronger or weaker than their partner.
Player alternation

Numerical rating for each adjective
expressing emotion

weakerWords were mapped to emotion type and strength
using a large-scale survey (N=14,000) to enable such
word-based emotion assessments.
ex.) Happiness Sadness Anticipation SurpriseAngerstrong うひょー

がっくり

ぴりぴりえー

いらいら びくびくげっうっとり

weak にこにこしゅんそわそわ

どきっかちんうわぁうんFear
ぞくっ

Disgust Accept

References[1] A. Murata, H. Nishida, K. Watanabe, and T. Kameda. “Convergence of physiological responses to pain during face-to-face interaction,”
Scientific Reports, 10（1）, 1-10. 2020.
[2] 村⽥ 藍⼦・熊野 史朗・渡邊 淳司. “協⼒場⾯における対⼈インタラクションの当事者評価と客観評価,” 電⼦情報通信学会技術研究報告, vol. 118,No. 487, pp.111-114, 2019.

Contact
Aiko Murata Email: cs-openhouse-ml@hco.ntt.co.jp
Sensory Resonance Research Group, Human Information Science Laboratory
オープンハウス 2020