# Neural correlates of contrast and humor: Processing common features of verbal irony

Alexandre Obert, Fabien Gierski, Arnaud Calmus, Aurélie Flucher, Christophe Portefaix, Laurent Pierot, Arthur Kaladjian, Stéphanie Caillies

<figure><img src="image_1.png" /></figure>

## To cite this version:

Alexandre Obert, Fabien Gierski, Arnaud Calmus, Aurélie Flucher, Christophe Portefaix, et al. Neural correlates of contrast and humor: Processing common features of verbal irony. PLoS ONE, 2016, 11 (11), pp.e0166704. 10.1371/journal.pone.0166704. hal-01822452

HAL Id: hal-01822452

https://univ-reims.hal.science/hal-01822452v1

Submitted on 24 Jan 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
<figure><img src="image_3.png" /></figure>

<figure><img src="image_4.png" /></figure>

**Citation:** Obert A, Gierski F, Calmus A, Flucher A, Portefaix C, Pierot L, et al. (2016) Neural Correlates of Contrast and Humor: Processing Common Features of Verbal Irony. PLoS ONE 11(11): e0166704. doi:10.1371/journal.pone.0166704

**Editor:** Ruth Filik, University of Nottingham, UNITED KINGDOM

**Received:** June 16, 2016

**Accepted:** November 2, 2016

**Published:** November 16, 2016

**Copyright:** © 2016 Obert et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** All fMRI files are accessible from the Figshare database https://figshare.com/s/cabfc5d12f142a4bef39. Incongruity and humor degrees are accessible from the Figshare database https://figshare.com/s/511a5413503dd1a9eca4.

**Funding:** The authors received no specific funding for this work.

**Competing Interests:** The authors have declared that no competing interests exist.

RESEARCH ARTICLE

# Neural Correlates of Contrast and Humor: Processing Common Features of Verbal Irony

Alexandre Obert¹*, Fabien Gierski¹,², Arnaud Calmus¹,³, Aurélie Flucher¹, Christophe Portefaix⁴,⁵, Laurent Pierot⁴, Arthur Kaladjian¹,², Stéphanie Caillies¹

1 C2S Laboratory (EA 6291), University of Reims Champagne-Ardenne, Reims, France, 2 Department of Psychiatry, Robert Debré Hospital, Reims University Hospital, Reims, France, 3 Department of Physical Medicine and Rehabilitation, Sébastopol Hospital, Reims University Hospital, Reims, France, 4 Department of Medical Imaging, Maison Blanche Hospital, Reims University Hospital, Reims, France, 5 CReSTIC Laboratory (EA 3804), University of Reims Champagne-Ardenne, Reims, France

* obert.alexandre@gmail.com

## Abstract

Irony is a kind of figurative language used by a speaker to say something that contrasts with the context and, to some extent, lends humor to a situation. However, little is known about the brain regions that specifically support the processing of these two common features of irony. The present study had two main aims: (i) investigate the neural basis of irony processing, by delivering short ironic spoken sentences (and their literal counterparts) to participants undergoing fMRI; and (ii) assess the neural effect of two irony parameters, obtained from normative studies: degree of contrast and humor appreciation. Results revealed activation of the bilateral inferior frontal gyrus (IFG), posterior part of the left superior temporal gyrus, medial frontal cortex, and left caudate during irony processing, suggesting the involvement of both semantic and theory-of-mind networks. Parametric models showed that contrast was specifically associated with the activation of bilateral frontal and subcortical areas, and that these regions were also sensitive to humor, as shown by a conjunction analysis. Activation of the bilateral IFG is consistent with the literature on humor processing, and reflects incongruity detection/resolution processes. Moreover, the activation of subcortical structures can be related to the reward processing of social events.

## Introduction

Verbal irony is a kind of nonliteral language that is traditionally viewed as a figure of thought, in the sense that the semantics of an ironic sentence and a nonironic one are indistinguishable [1]. This feature means that context plays a particularly important role in narrative comprehension. For example, in order to understand the comments “He is bright” about an idiot or “He is stupid” about somebody intelligent, it is necessary to take into account the reality of the situation, generally named the *context*. In most theories, verbal irony comprehension relies on an incongruity resolution process, following the detection of an incongruity (termed *contrast* in the irony literature) between the assertion (i.e., ironic sentence) and the reality (i.e., context) [2]. According to prevailing theory, humor relies precisely on the detection of this contrast,
which produces a violation of expectations and/or facts that needs to be resolved [3]. It is fur-
ther generally acknowledged that irony is used because of its humorous effect [4]. There have
even been suggestions that irony serves a social function, enabling us to say something nega-
tive with humor, and thus attenuate the negative impact on the speaker-listener relationship
[5]. Despite this, very few studies have explicitly explored the neural bases of both the contrast
effect and humor appreciation in irony comprehension.

Most findings regarding contrast and humor come from rating studies. The groundbreak-
ing research by Colston and O'Brien [6] highlighted the importance of the contrast effect on
pragmatic goals of verbal irony such as humorousness. These authors found that ironic sen-
tences were rated as more contrasted and more humorous than their literal counterparts, and
that the pragmatic goal of humor was influenced by the perceived contrast. Moreover, in a sec-
ond study [7], they found that making positive comments about negative events (e.g., verbal
irony) was more likely to involve humor than exaggerating these events (e.g., hyperbole), and
strongly negative comments (strong irony) had greater pragmatic effects than weaker negative
comments (weak irony). Similarly, when Ivanko and Pexman [8] modulated the contrast
between context and critical assertion by accentuating the negativity of the context, they found
that a greater contrast appeared to heighten the perception of sarcasm (see also [9]), which is
traditionally viewed as a kind of ironic statement where ridicule is an important component
[10]. In a recent study, however, Calmus and Caillies [2] showed that contrast (between the
context and what is said) and humorousness are linked in a nonlinear manner, in an inverted
U-shape, such that the funniest sentences are those with moderate contrasts between the con-
text and the ironic assertion. All these studies therefore emphasize the role of the contrast
effect in ironic humor.

Even today, little is known about the brain network that subtends the processing of these
two interconnected features when dealing with irony. Relatively few studies have examined the
cerebral bases of irony processing in healthy participants using functional magnetic resonance
imaging (fMRI). Some of these have reported areas of activation, which are discussed in the
light of theory of mind (ToM; drawing of inferences about others' mental states and inten-
tions) and semantic processes. Studies have shown activation of the medial prefrontal cortex
[11–13], left and right temporoparietal junction (TPJ; [13,14]), and superior temporal sulcus
(STS; [12]) (STS; 12), which are recognized as forming part of the ToM network. As well as
this ToM network, some authors have identified a broad language network dedicated to
semantic and contextual processing. Eviatar and Just [15] showed that the right superior and
middle temporal gyri (MTG) are more likely to be activated by ironic sentences than by literal
ones. These authors interpreted this as the neural expression of two kinds of (nonexclusive)
processes: the ability to grasp the speaker's communicative intent; and the integration of differ-
ent items of information into a single, coherent story. Similarly, using sarcastic sentences,
Uchiyama et al. [16] observed left temporal activation for processing both the context and the
critical ironic sentence, supporting the idea of a general involvement of left temporal areas in
contextual and semantic processing. This is congruent with some other studies providing evi-
dence that the temporal gyri are involved in inference processing [17] and semantic incongru-
ity [18]. Additionally, Uchiyama et al. [16] reported activation of the left inferior frontal gyrus
(IFG) during the processing of sarcasm, and argued that it must be a key region for integrating
ToM and semantic processes. Furthermore, a recent meta-analysis by Rapp et al. [19] demon-
strated that the IIFG is a core region for several types of nonliteral language, including meta-
phor, idiom and irony. This can be explained by the higher cognitive demands (in terms of
semantic processing) made by figurative expressions, and by the fact that the IIFG has been
shown to be involved in several language processes, including semantic integration [20,21].
Finally, similar areas of activation have been reported in studies of incongruity based on the
detection-resolution model of humorous stimuli. Samson, Zysset, and Huber [22] showed that the temporoparietal junction is activated during the processing of cartoons requiring ToM processes, and suggested that this reflects successful incongruity resolution processing, whereby complex information is integrated into a coherent meaning [3,23,24].

Taken together, these results shed some interesting light on the semantic processes underlying irony comprehension, and thus on the semantic resolution of the incongruity resulting from the contrast between remark and context. However, very few of them concern the neural bases recruited by the humorous aspect of ironic sentences. To our knowledge, the only fMRI study to have included an analysis of humor appreciation is Akimoto et al. [25]'s study. After the scanning session, participants were asked to rate the stimuli on perceived humor, in addition to the degree of irony. Analyses showed that the right amygdala and hippocampal structures were more likely to respond positively to the degree of irony, and the right dorsolateral prefrontal cortex to the degree of perceived humor. The former were assumed to be sensitive to the emotional states of ironic communication, and the authors postulated that the latter supports the executive functions involved in the resolution of incongruity, as well as in the social function of irony. These results have been echoed in fMRI studies of humor featuring materials other than verbal irony, namely humorous cartoons or stories. For example, Bartolo et al. [26] observed that the left amygdala was positively linked to the degree of amusement derived from humorous cartoons, supporting the idea that this is a key area for emotional responses to humorous events. For their part, Chan et al. [27] used verbal funny stories containing a situational context (e.g., a child has to share some donuts with his brother) and ending with an unexpected punchline (e.g., "Hey, we have a donut to share! I'll take the circle, and you can have the hole!"). When they compared highly funny stories with less funny ones, the authors observed activation of the left ventromedial prefrontal cortex, along with subcortical activation in the bilateral parahippocampal and amygdala structures. These structures are known to form part of the mesolimbic reward system, which has been shown to be activated by subjective appreciation of humor [28]. Moreover, incongruity resolution and humor processing appear to share common cortical areas. Bekinschtein, Davis, Rodd, and Owen [29] conducted an fMRI study in which they asked participants to rate the funniness of sentences that varied on humorous and contrast features. Their results suggested that resolving the incongruity of these sentences engaged the frontotemporal network, while perceiving their humor involved the subcortical reward network. More interestingly, they observed that the left IFG was recruited by both incongruity resolution and humor processing, confirming that incongruity and humor are strongly linked.

The aim of the present study was to investigate the neural bases of auditory verbal irony comprehension using fMRI, and to specifically assess the responsiveness of different brain areas to contrast and humor features, indirectly taking into account the nonlinear relation between the two that had previously been demonstrated. We reasoned that if contrast affects humor appreciation in a nonlinear manner, the brain regions recruited by contrast would respond quadratically to humor. In our design, the stimuli were presented in the auditory modality, as intonation is an important cue for detecting the contrast between context and critical remark, and thus for understanding the irony [30,31].

# Material and Methods

## Participants

Initially, 23 healthy participants were included in the study. Two of them, however, were excluded owing to poor-quality behavioral data (see below). All the remaining participants (10 women and 11 men; mean age = 22.10 years, SD = 1.92, range = 20–27) were native French
speakers and right-handed, according to the Edinburgh Handedness Inventory [32]. They had normal or corrected-to-normal vision and normal hearing, and no past or present medical, psychiatric or neurological illnesses. They also met health and safety regulations regarding the use of MRI. The study was designed in accordance with the Declaration of Helsinki and approved by the East III institutional review board of Nancy University Hospital. All participants gave their written informed consent after receiving a full description of the study.

## Stimuli

Forty-eight two-sentence ironic or literal stimuli were taken from a pool of 74 sentences used in a previous published study [2]. Each ironic story was matched with a literal control story in which the context sentence had been modified in such a way that the second sentence of the pair was no longer ironic (Table 1). It should be noted that the ironic comments were invented, and as a consequence, were neither familiar nor conventional, although they were selected as being easily understandable. Contrast detection and humor appreciation were operationalized with contrast and funniness rating scales. For the contrast judgments, 153 participants were asked to rate the extent to which the meaning of the first sentence contrasted with that of the second sentence on a 6-point Likert-type scale ranging from 1 (*Not at all contrasting*) to 6 (*Highly contrasting*). For the humor judgments, 99 participants (none of whom participated in the contrast judgments) were asked to rate the funniness of the stories on a similar 6-point scale ranging from 1 (*Not at all funny*) to 6 (*Very funny*). For the purpose of the present study, the 24 ironic sentences were all moderately contrasted ($M = 4.84, SD = 0.69$) and moderately humorous ($M = 3.43, SD = 0.61$), and their literal controls were those with the lowest contrast ($M = 1.89, SD = 0.69$) and humor ($M = 1.96, SD = 0.57$) ratings. A statistical *t* test for independent samples revealed significant differences between the ironic and literal sentences on both contrast, $t(46) = 14.80, p < 0.001$, and humor, $t(46) = 8.65, p < 0.001$, with the ironic sentences being judged as more contrasted and more humorous than the literal ones. In order to test the relationship between the degrees of contrast and humor of the selected sentences, linear and nonlinear relations were modeled. At a descriptive level (see Fig 1), the degrees of contrast and humor of the selected sentences were more likely to follow a quadratic distribution than a linear one. Computation of R-squared confirmed this view with the quadratic model explaining more variance than the linear one ($R^2_{quadratic} = 0.581 > R^2_{linear} = 0.492$).

The two-sentence stories were recorded in audio files. Each story was accompanied by a *yes/no* visually presented question concerning its ironic or literal nature. A training session featured two other ironic stories and their literal counterparts.

## Procedure

Participants were invited to listen to the 48 two-sentence stories, which were presented in a semirandom order (fixed order for each participant). A black screen with a fixation point was

<table><caption>**Table 1. Examples of the Two-Sentence Stories.**</caption><thead><tr><th></th><th>Example 1</th><th>Example 2</th></tr></thead><tbody><tr><th>Ironic</th><td>C'est la meilleure des promotions que j'ai eues dans cette entreprise. Demain, je la quitte définitivement.<br>(This is the best promotion I've ever had in this company. Tomorrow, I'm leaving for good.)</td><td>Ce nouveau spectacle n'est pas mauvais. C'est tout simplement un navet.<br>(This new show isn't bad. It's complete rubbish.)</td></tr><tr><th>Control</th><td>C'est la pire des situations que j'ai eues dans cette entreprise. Demain, je la quitte définitivement.<br>(It's the worst post I've ever held in this company. Tomorrow, I'm leaving for good.)</td><td>Ce nouveau spectacle est de mauvais goût. C'est tout simplement un navet.<br>(This new show's in bad taste. It's complete rubbish.)</td></tr></tbody></table>

doi:10.1371/journal.pone.0166704.t001
<figure><img src="image_5.png" /><figcaption>**Fig 1.** Scatterplot of contrast and humor degrees showing the linear (dash line) and quadratic (solid line) relationships.</figcaption></figure>

doi:10.1371/journal.pone.0166704.g001

presented first, via a mirror. It was displayed for between 0 and 3000 ms to introduce jitter. The presentation of this black screen was used to establish a baseline activation level for the first-level functional computations (see below). While participants listened to each sentence pair, a similar and indistinguishable black screen with a fixation point remained in full view. After they had heard the item, another black screen appeared, this time featuring a question mark and the words *ironic* (bottom lefthand corner) and *literal* (bottom righthand corner). Participants were invited to judge the nature of the item and indicate their choice by pressing the corresponding button.

## Imaging procedures

The fMRI data were collected using a Philips Achieva 3.0T whole-body MRI scanner (Philips Medical Systems, Best, Netherlands). The study was performed with a 2D T2*-weighted EPI sequence, in ascending slice order (TR = 2000 ms, TE = 33 ms, 90° flip angle, FOV = 240 mm). Thirty-two slices were acquired, and each slice was 4.5 mm thick, with a gap of 0 mm. The acquisition matrix was 64 x 64 voxels. The functional acquisition sequence was composed of 245 volumes, corresponding to the continuous acquisition of the 32 axial slices, and lasted 8 minutes and 10 seconds. For each participant, we also acquired a high-resolution 3D T1- weighted anatomical image (TR = 8.2 ms, TE = 3.7 ms, 8° flip angle, FOV = 240 mm), allowing us to register the functional data. One hundred and sixty slices were acquired, and each slice was 1 mm thick, with no gap. Structural and functional images were taken in the axial plane parallel to the anterior-posterior commissure (AC-PC) line.

Functional data were preprocessed with Statistical Parametric Mapping (SPM) software Version 8 (Wellcome Department of Cognitive Neurology, Institute of Neurology, London, UK), implemented in MATLAB®. Functional images were realigned to the mean functional image of the series, then normalized with reference to a standard brain template (EPI template of the Montreal Neurological Institute, MNI). Data were spatially smoothed using an 8-mm full width at half maximum (FWHM) Gaussian filter. High-pass and low-pass filters were also used, in order to filter the data for artifacts of a physiological origin (breathing, heartbeat).
## Whole-brain analysis

We began by modeling the onset of the correctly classified ironic and literal target sentences as two regressors. The context sentences, fixation crosses and participants' response events were also modeled across these two conditions, leading to three additional regressors. In the first analysis, we compared the ironic condition with the literal one.

In order to test the effects of the contrast and humor features of irony on brain activity, taking account of the nonlinear effect of contrast on humor appreciation [2], we calculated two parametric models. As indicated earlier, our reasoning was that if contrast affects humor appreciation in a nonlinear manner, then brain regions affected by contrast should respond quadratically to the humor. A first parametric model was calculated using all the correctly classified sentences as a single regressor and contrast values as parametric modulator with a negative polynomial quadratic function [33]. Context sentences, fixation crosses and participants' response events were entered as covariates of no interest. A second design contained the same regressors, but with humor as a parametric modulator with a linear polynomial function. For both designs, contrast images representing the effects of contrast and humor were computed for each participant. In order to identify the brain regions that responded to both contrast and humor features, we performed a conjunction analysis with a conjunction null hypothesis, using these individual contrast images [34]. For the ironic versus literal comparison, parametric models and conjunction analysis, activation maps were thresholded at *p* = 0.001 uncorrected, with a cluster extent of 20 voxels, and labelled using the AAL toolbox for SPM8 [35].

## Results

### Behavioral results

We used Grubbs' method to assess outliers for both accuracy and response times. Two participants were excluded because they provided fewer correct responses than the group as a whole. We ran two one-way repeated-measures analyses of variance (ANOVAs) on the mean number of correct responses as a function of condition (ironic vs. literal): one per participant (*F*₁), the other per item (*F*₂). The mean number of correct responses in the ironic condition did not differ significantly from that in the literal condition, *F*₁(1, 20) = 1.74, *p* = 0.20, and *F*₂(1, 23) = 0.40, *p* = 0.53. Similar results were observed for mean correct response times, *F*₁(1, 20) = 1.25, *p* = 0.28, and *F*₂(1, 23) = 0.25, *p* = 0.53 (Table 2).

### Brain activation results

**Ironic versus literal conditions.** The ironic minus literal comparison revealed a fronto-temporal pattern of activations: in the posterior part of the left superior temporal gyrus (STG), encompassing the superior temporal sulcus (STS), as well as the bilateral inferior frontal gyrus (IFG), left caudate, and left lingual gyrus extending to the fusiform area (Table 3 and Fig 2).

**Effects of contrast and humor.** A negative quadratic effect of contrast was observed in the bilateral IFG, extending to the middle frontal gyrus (MFG) in the left hemisphere. Left

<table><caption>Table 2. Behavioral data per participants and per items.</caption><thead><tr><th rowspan="3">Conditions</th><th colspan="4">Reaction times (ms)</th><th colspan="2">Correct responses</th></tr><tr><th colspan="2">(Mean ± SD)</th><th colspan="2">(Mean ± SD)</th><th colspan="2"></th></tr><tr><th>Participants</th><th>Items</th><th>Participants</th><th>Items</th><th colspan="2"></th></tr></thead><tbody><tr><td>Irony</td><td>1008.75 ± 234.79</td><td>1014.46 ± 200.21</td><td>20.99 ± 1.78</td><td>20.99 ± 1.78</td><td colspan="2"></td></tr><tr><td>Literal</td><td>953.23 ± 262.23</td><td>989.69 ± 257.76</td><td>20.18 ± 2.38</td><td>20.18 ± 2.38</td><td colspan="2"></td></tr></tbody></table>

doi:10.1371/journal.pone.0166704.t002
<table><caption>Table 3. Whole-Brain Activation for the Irony > Literal Comparison.</caption><thead><tr><th rowspan="2">Location<br>Area</th><th rowspan="2">Hemisphere</th><th rowspan="2">BA</th><th colspan="2">Significance</th><th colspan="3">MNI coordinates</th></tr><tr><th>No. voxels</th><th><i>p</i><sub>FWE-corr</sub></th><th>t values</th><th>x</th><th>y</th><th>z</th></tr></thead><tbody><tr><td>Superior temporal gyrus</td><td>L</td><td>21</td><td>325</td><td>0.016</td><td>6.73</td><td>-49</td><td>-29</td><td>1</td></tr><tr><td>Inferior frontal gyrus</td><td>L</td><td>45</td><td>1079</td><td>0.001</td><td>6.47</td><td>-51</td><td>23</td><td>11</td></tr><tr><td>Lingual gyrus</td><td>L</td><td>18</td><td>565</td><td>0.001</td><td>6.05</td><td>-11</td><td>-83</td><td>-9</td></tr><tr><td>Medial superior frontal gyrus</td><td>R</td><td>10</td><td>31</td><td>0.875</td><td>4.58</td><td>9</td><td>59</td><td>29</td></tr><tr><td>Inferior frontal gyrus</td><td>R</td><td>45</td><td>35</td><td>0.845</td><td>4.58</td><td>59</td><td>29</td><td>11</td></tr><tr><td>Caudate</td><td>L</td><td>-</td><td>61</td><td>0.632</td><td>4.50</td><td>-1</td><td>7</td><td>7</td></tr><tr><td>Medial superior frontal gyrus</td><td>L</td><td>10</td><td>49</td><td>0.731</td><td>4.31</td><td>-5</td><td>61</td><td>31</td></tr><tr><td>Inferior frontal gyrus</td><td>R</td><td>38</td><td>20</td><td>0.944</td><td>4.17</td><td>45</td><td>29</td><td>-21</td></tr></tbody></table>

Note. L = left; MNI = Montreal Neurological Institute; *p*<sub>FWE-corr</sub>: *p* = 0.05 cluster threshold corrected for familywise error. *p* < 0.001 uncorrected; k = 20.

doi:10.1371/journal.pone.0166704.t003

activations were also observed in the superior parietal gyrus and posterior part of the MTG encompassing the STG and STS. Activations in the right medial frontal gyrus (MedSFG), extending to the supplementary motor area and bilateral subcortical regions, specifically the caudate and putamen, were also significant. A linear effect of humor was observed in the bilateral IFG, anterior part of the MedSFG, right thalamus and left caudate. Additionally, activations in the left lingual gyrus were recorded (Table 4 and Fig 3). The conjunction analysis revealed that the bilateral IFG and left caudate were both significantly activated by contrast and humor (Table 4).

<figure><img src="image_6.png" /><figcaption>**Fig 2.** Activation for the Irony > Literal comparison. *p* < 0.001 uncorrected, k = 20 voxels. Differences were observed in the bilateral inferior frontal gyrus, left superior temporal gyrus, lingual gyrus caudate, and bilateral medial superior frontal gyrus.</figcaption></figure>

doi:10.1371/journal.pone.0166704.g002
<table><caption>Table 4. Whole-Brain Activation for Contrast and Humor.</caption><thead><tr><th rowspan="2">Location<br>Area</th><th colspan="2">Hemisphere</th><th colspan="2">Significance</th><th colspan="3">MNI coordinates</th></tr><tr><th>BA</th><th>No. voxels</th><th>p<sub>FWE-corr</sub></th><th>t value</th><th>x</th><th>y</th><th>z</th></tr></thead><tbody><tr><td colspan="8"><strong>Contrast</strong></td></tr><tr><td>Inferior frontal gyrus</td><td>R</td><td>45</td><td>525</td><td>0.001</td><td>7.58</td><td>57</td><td>37</td><td>15</td></tr><tr><td>Middle temporal gyrus</td><td>L</td><td>21</td><td>563</td><td>0.001</td><td>7.46</td><td>-59</td><td>-45</td><td>1</td></tr><tr><td>Medial superior frontal gyrus</td><td>R</td><td>8</td><td>720</td><td>0.001</td><td>7.27</td><td>3</td><td>25</td><td>49</td></tr><tr><td>Inferior frontal gyrus</td><td>L</td><td>48</td><td>844</td><td>0.001</td><td>6.23</td><td>-47</td><td>17</td><td>25</td></tr><tr><td>Caudate</td><td>L</td><td>25</td><td>232</td><td>0.020</td><td>5.92</td><td>-9</td><td>23</td><td>-1</td></tr><tr><td>Putamen</td><td>R</td><td>-</td><td>124</td><td>0.157</td><td>5.79</td><td>15</td><td>9</td><td>-3</td></tr><tr><td>Middle temporal gyrus</td><td>L</td><td>39</td><td>36</td><td>0.822</td><td>4.85</td><td>-41</td><td>-53</td><td>19</td></tr><tr><td>Inferior frontal gyrus</td><td>R</td><td>47</td><td>106</td><td>0.226</td><td>4.72</td><td>41</td><td>35</td><td>-7</td></tr><tr><td>Middle frontal gyrus</td><td>L</td><td>6</td><td>24</td><td>0.929</td><td>4.24</td><td>-17</td><td>5</td><td>53</td></tr><tr><td>Middle temporal gyrus</td><td>L</td><td>20</td><td>23</td><td>0.936</td><td>4.23</td><td>-47</td><td>-43</td><td>-11</td></tr><tr><td>Superior Parietal Gyrus</td><td>L</td><td>7</td><td>26</td><td>0.914</td><td>4.04</td><td>-25</td><td>-75</td><td>41</td></tr><tr><td>Inferior frontal gyrus</td><td>L</td><td>45</td><td>21</td><td>0.949</td><td>4.01</td><td>-45</td><td>39</td><td>7</td></tr><tr><td colspan="8"><strong>Humor</strong></td></tr><tr><td>Inferior frontal gyrus</td><td>L</td><td>48</td><td>587</td><td>0.014</td><td>7.31</td><td>-49</td><td>21</td><td>17</td></tr><tr><td>Inferior frontal gyrus</td><td>R</td><td>45</td><td>31</td><td>0.875</td><td>5.46</td><td>61</td><td>31</td><td>11</td></tr><tr><td>Lingual Gyrus</td><td>L</td><td>17</td><td>238</td><td>0.047</td><td>5.16</td><td>-11</td><td>-83</td><td>-9</td></tr><tr><td>Medial superior frontal gyrus</td><td>L</td><td>10</td><td>60</td><td>0.636</td><td>4.52</td><td>-5</td><td>61</td><td>31</td></tr><tr><td>Thalamus</td><td>R</td><td>-</td><td>21</td><td>0.939</td><td>4.17</td><td>5</td><td>-19</td><td>5</td></tr><tr><td>Caudate</td><td>L</td><td>25</td><td>22</td><td>0.934</td><td>3.91</td><td>-7</td><td>15</td><td>5</td></tr><tr><td colspan="8"><strong>Conjunction between Contrast and Humor</strong></td></tr><tr><td>Inferior frontal gyrus</td><td>L</td><td>48</td><td>346</td><td>0.012</td><td>4.90</td><td>-49</td><td>21</td><td>19</td></tr><tr><td>Inferior frontal gyrus</td><td>R</td><td>45</td><td>28</td><td>0.456</td><td>4.43</td><td>61</td><td>31</td><td>11</td></tr><tr><td>Caudate</td><td>L</td><td>25</td><td>34</td><td>0.971</td><td>3.67</td><td>-9</td><td>17</td><td>-1</td></tr></tbody></table>

Note. L = left; MNI = Montreal Neurological Institute; p<sub>FWE-corr</sub>: p = 0.05 cluster threshold corrected for familywise error. p < 0.001 uncorrected; k = 20.

doi:10.1371/journal.pone.0166704.t004

## Discussion

The present study used fMRI to assess the neural bases of the comprehension of auditory verbal irony, more specifically the brain areas involved in irony processing as a function of contrast and humor features. Results showed that, compared with the processing of literal stimuli, irony processing was associated with specific patterns of activation, the most robust activations being observed in the posterior part of the left STG and left STS, as well as in the left IFG. Additional activations were observed in the right IFG and caudate structure. More interestingly, we found that contrast, acting quadratically, also triggered activations in these regions, as well as in the left MFG and putamen. A linear effect of humor was observed in the bilateral IFG, medial SFG, right thalamus, left caudate and left lingual gyrus, with the strongest activation in the IFG. Lastly, analysis of the conjunction between contrast and humor showed that the greatest significant common activation was located in the left IFG, with additional common activation in its right homologue, as well as in the left caudate.

## Activations during irony processing

As previously mentioned, our irony versus literal comparison highlighted activations in the posterior part of the left STG and left STS, as well as the caudate, bilateral IFG and medial SFG
<figure><img src="image_7.png" /><figcaption>**Fig 3. Activation for the Contrast (blue) and Humor (green) effects.** *p* < 0.001 uncorrected, *k* = 20 voxels. Common activations were localized in the bilateral inferior frontal gyrus and left caudate.</figcaption></figure>

doi:10.1371/journal.pone.0166704.g003

that were specific to the processing of ironic sentences. This pattern of activations can be attributed to both theory of mind (ToM) and semantic processes.

Irony is often regarded as a figure of thought that requires mentalizing processes. Many studies have been designed to investigate this specific question, and these have consistently found activation of the brain areas recruited by ToM, such as the superior temporal sulcus and medial SFG [11,12,16]. These areas are part of a well-known ToM network [36,37] that is strongly elicited during irony processing, as the latter requires higher-order inferences about others' beliefs and intentions [38]. The activation of the IFG, and more particularly the left IFG, which appears more robust, is consistent with studies revealing that this region plays a semantic role in figurative language processing, particularly the left IFG. For instance, Rapp et al. [19] observed left IFG activation for all the figurative expressions they studied (metaphors, idioms, metonymy and irony). According to these authors, this region is involved in contextual integration, meaning selection and evaluation, and integration of world knowledge into sentences. In their meta-analysis, Vigneau et al. [39] also reported robust activation of the left IFG for both semantic and sentence processing, as well as the left STG for sentence processing. Taken together, the left STG and left IFG activations appear to confirm the hypothesis that semantic integration processes are engaged in irony comprehension. One potential issue regarding this interpretation concerns the modality of stimulus presentation in our study, as we cannot exclude the possibility of an overlap in the areas associated with auditory or semantic processing. Indeed, Frühholz and Grandjean [40] suggested that the STG, along with the bilateral IFG, is involved in affective prosody processing. Consistent with this, Matsui et al. [41] showed bilateral IFG activation when processing ironic prosody. Following these authors,
the right IFG would be sensitive to the detection of statement-prosodic incongruity, while the
left IFG is engaged more during information selection and integration, as required in case of
disparity between context and sentence meaning.

Furthermore, ToM and semantic language processes may interact during irony processing,
instead of being mutually exclusive. When Kuperberg et al. [42] compared sentences contain-
ing a pragmatic, semantic or syntactic violation with normal ones, they found that the left STG
was activated more for pragmatically violated sentences than for semantically or syntactically
violated ones. The authors interpreted this as reflecting reevaluation of the sentence when the
pragmatic meaning could not easily be grasped. Moreover, based on evidence of STS activation
in both language and mentalizing tasks, Redcay [43] suggested that the superior temporal area
endorses the analysis of visual and verbal inputs and the extraction of their social meanings. In
the same vein, Spotorno et al. [13] showed that parts of the medial frontal cortex and left IFG
strongly interact during irony processing, suggesting information exchanges between ToM
and linguistic networks. Taken together, these findings suggest that auditory irony processing
engages areas dedicated to the integration of linguistic auditory inputs, which require linguistic
and mentalizing processes to grasp their socially consistent meaning.

In studies of language processing, the caudate has been identified as a key region in mean-
ing selection and ambiguity resolution [44,45]. This process is probably needed more to *get the*
>joke* with verbal irony, as this figure of speech can convey the opposite of what is being said.
However, very few studies of irony have reported subcortical activation, and this kind of acti-
vation has therefore seldom been discussed [14,46,47].

Neural correlates of contrast and humor

The results modulated by the contrast revealed activation of left areas in the IFG, MFG, MTG extending to the STG, and parietal gyrus. Activations in the right medial SFG and bilateral caudate and putamen were also observed. A linear effect of humor was observed in the bilateral IFG, medial SFG, right thalamus, left caudate, and left lingual gyrus. Finally, the bilateral IFG and left caudate appeared to be sensitive to both the contrast and humor features.

The left IFG had previously been highlighted in studies of humor processing. According to Gardner et al. [48], humorous events are processed in two stages: humor detection and humor appreciation. The purpose of the first stage (cognitive component) is to understand the disparity between the unexpected ending and the situation. The second stage corresponds to the affective component, and is responsible for the emotional enjoyment of the humorous event (see also [49] for a complementary perspective). In line with this theory, Moran et al. [50] found that the left IFG reacted to the first component (i.e., humor detection) when participants were asked to watch episodes of sitcoms. Chan et al. [27], who tried to segregate these two components of humor processing using verbal stories, also observed activation of the bilateral IFG when participants were engaged in a humor comprehension process. Similarly, Bartolo et al. [26] found that the left and right IFG were activated more during the processing of funny versus unfunny cartoons, and the right IFG was also positively correlated with the feeling of amusement. Thus, the authors suggested that while the left IFG is involved in incongruity detection, its right homologue is engaged in the incongruity resolution that is required to achieve a feeling of amusement. Thus, the bilateral IFG could be a key region for incongruity detection and resolution when processing humorous events.

The explanation for the involvement of subcortical structures in irony processing remains
unclear. Activation of the caudate nucleus and putamen could be related to the decision-mak-
ing process inherent to the task, and reflect the activation of the *executive* frontal-subcortical
loops [51]. However, when focusing on the potential effect of humor in different kinds of
stimuli, humor can be seen to involve the activation not just of cortical areas, but also of sub-cortical ones that are known to be associated with the reward system [27,50]. This system constitutes a network encompassing both cortical (e.g., medial temporal, prefrontal and orbitofrontal cortices) and subcortical areas, including midbrain structures (ventral tegmental area, substantia nigra) and the ventral striatum (nucleus accumbens, caudate, putamen) [52]. Data from the literature show that this system is activated during the processing of humorous stimuli such as cartoons [26,53], comedy clips [54], and verbal jokes [29], and could be thus extended to ironic sentence listening.

One possible caveat of the present study may lie in the methodology we used, as the humor ratings were not provided by the participants themselves, but were taken from an earlier stimulus validation. Unlike contrast, which more strongly refers to a feature of the stimuli, humor appreciation is a very individual experience. The pattern of activation we observed may not, therefore, directly relate to individual differences in irony. As a consequence, we acknowledge that further studies will be needed to confirm our results.

Furthermore, it may be important to distinguish humor from other ways of triggering emotional states. The ironic material used in studies frequently singles out a specific victim for differing degrees of mockery [14,15,25]. However, irony and sarcasm have been shown to induce different emotional states and different emotional attributions, with sarcasm producing more negative feelings in addressees [55]. Future studies could therefore be conducted to investigate the specific neural correlates associated with these different rhetorical devices.

Taken together, the results of the present study highlight the brain network involved in the processing of auditory ironic sentences. They also reveal that some brain regions that are sensitive to the processing of the disparity between context and critical sentence are also sensitive to the humor intensity of the sentences. Our results echo the literature findings on humor, and underline the importance of both cortical and subcortical structures. Moreover, some components of the reward system have been found to be involved in the processing of humorous events, supporting the notion that both social and emotional processes are engaged. Nevertheless, further studies are needed to confirm the involvement of these structures and investigate whether this system is linked to the successful decoding of irony or to the processing of the stories' degree of humor. Furthermore, our results suggest that the IIFG is a key region that supports both contrast and humor features through an incongruity detection-resolution process.

**Acknowledgments**

The authors would like to express their gratitude to Mathieu Vigneau and Donald McLaren.

**Author Contributions**

**Conceptualization:** AO FG SC AC.

**Data curation:** CP.

**Formal analysis:** AO FG.

**Funding acquisition:** AK.

**Investigation:** AO AF AC FG.

**Methodology:** AO AC FG SC AF.

**Project administration:** FG SC LP AK.

**Resources:** LP AK.
**Software:** AO FG CP.

**Supervision:** FG SC.

**Validation:** AO FG SC.

**Visualization:** AO FG SC.

**Writing – original draft:** AO FG SC.

**Writing – review & editing:** FG SC.

## References

1. Attardo S (2002) Humor and irony in interaction: From mode adoption to failure of detection. Say not to say: 165–185.

2. Calmus A, Caillies S (2014) Verbal irony processing: How do contrast and humour correlate? International Journal of Psychology 49: 46–50. doi: 10.1002/ijop.12003 PMID: 24811722

3. Vrticka PJMR AL (2013) The neural basis of humour processing. Nature Reviews Neuroscience 14: 860–868. doi: 10.1038/nrn3566 PMID: 24169937

4. Roberts R, Kreuz R (1994) Why do people use figurative language? Psychological Science 5: 159–164.

5. Dews S, Kaplan J, Winner E (1995) Why not say it directly? The social functions of irony. Discourse Processes 19: 347–367.

6. Colston HL, O'Brien J (2000) Contrast and pragmatics in figurative language: Anything understatement can do, irony can do better. Journal of Pragmatics 32: 1557–1583.

7. Colston HL, O'Brien J (2000) Contrast of Kind Versus Contrast of Magnitude: The Pragmatic Accomplishments of Irony and Hyperbole. Discourse Processes 30: 179–199.

8. Ivanko SL, Pexman PM (2003) Context Incongruity and Irony Processing. Discourse Processes 35: 241–279.

9. Gerrig RJ, Goldvarg Y (2000) Additive Effects in the Perception of Sarcasm: Situational Disparity and Echoic Mention. Metaphor and Symbol 15: 197–208.

10. Gibbs RW Jr. (1994) The poetics of mind: Figurative thought, language, and understanding. New York, NY, US: Cambridge University Press.

11. Rapp AM, Mutschler DE, Wild B, Erb M, Lengsfeld I, et al. (2010) Neural correlates of irony comprehension: The role of schizotypal personality traits. Brain and Language 113: 1–12. doi: 10.1016/j.bandl.2009.11.007 PMID: 20071019

12. Shibata M, Toyomura A, Itoh H, Abe Ji (2010) Neural substrates of irony comprehension: A functional MRI study. Brain Research 1308: 114–123. doi: 10.1016/j.brainres.2009.10.030 PMID: 19853585

13. Spotorno N, Koun E, Prado J, Van Der Henst JB, Noveck IA (2012) Neural evidence that utterance-processing entails mentalizing: The case of irony. NeuroImage 63: 25–39. doi: 10.1016/j.neuroimage.2012.06.046 PMID: 22766167

14. Varga E, Simon M, Tényi T, Schnell Z, Hajnal A, et al. (2013) Irony comprehension and context processing in schizophrenia during remission—A functional MRI study. Brain and Language 126: 231–242. doi: 10.1016/j.bandl.2013.05.017 PMID: 23867921

15. Eviatar Z, Just MA (2006) Brain correlates of discourse processing: An fMRI investigation of irony and conventional metaphor comprehension. Neuropsychologia 44: 2348–2359. doi: 10.1016/j.neuropsychologia.2006.05.007 PMID: 16806316

16. Uchiyama H, Seki A, Kageyama H, Saito DN, Koeda T, et al. (2006) Neural substrates of sarcasm: A functional magnetic-resonance imaging study. Brain Research 1124: 100–110. doi: 10.1016/j.brainres.2006.09.088 PMID: 17092490

17. Si Kim, Yoon M, Kim W, Lee S, Kang E (2012) Neural Correlates of Bridging Inferences and Coherence Processing. Journal of Psycholinguistic Research 41: 311–321. doi: 10.1007/s10936-011-9185-z PMID: 22113486

18. Ye Z, Doñamayor N, Münte TF (2014) Brain network of semantic integration in sentence reading: Insights from independent component analysis and graph theoretical analysis. Human Brain Mapping 35: 367–376. doi: 10.1002/hbm.22182 PMID: 22987790

19. Rapp AM, Mutschler DE, Erb M (2012) Where in the brain is nonliteral language? A coordinate-based meta-analysis of functional magnetic resonance imaging studies. NeuroImage 63: 600–610. doi: 10.1016/j.neuroimage.2012.06.022 PMID: 22759997
20. Rodd JM, Johnsrude IS, Davis MH (2010) The role of domain-general frontal systems in language comprehension: Evidence from dual-task interference and semantic ambiguity. Brain and Language 115: 182-188. doi: 10.1016/j.bandl.2010.07.005 PMID: 20709385

21. Zhu Z, Zhang JX, Wang S, Xiao Z, Huang J, et al. (2009) Involvement of left inferior frontal gyrus in sentence-level semantic integration. NeuroImage 47: 756-763. doi: 10.1016/j.neuroimage.2009.04.086 PMID: 19426814

22. Samson AC, Zysset S, Huber O (2008) Cognitive humor processing: different logical mechanisms in nonverbal cartoons—an fMRI study. Social neuroscience 3: 125-140. doi: 10.1080/17470910701745858 PMID: 18633854

23. Samson AC, Hempelmann CF, Huber O, Zysset S (2009) Neural substrates of incongruity-resolution and nonsense humor. Neuropsychologia 47: 1023-1033. doi: 10.1016/j.neuropsychologia.2008.10.028 PMID: 19046978

24. Lerner Y, Honey CJ, Silbert LJ, Hasson U (2011) Topographic mapping of a hierarchy of temporal receptive windows using a narrated story. The Journal of neuroscience: the official journal of the Society for Neuroscience 31: 2906-2915.

25. Akimoto Y, Sugiura M, Yomogida Y, Miyauchi CM, Miyazawa S, et al. (2014) Irony comprehension: Social conceptual knowledge and emotional response. Human Brain Mapping 35: 1167-1178. doi: 10.1002/hbm.22242 PMID: 23408440

26. Bartolo A, Benuzzi F, Nocetti L, Baraldi P, Nichelli P (2006) Humor comprehension and appreciation: an fMRI study. Journal of cognitive neuroscience 18: 1789-1798. doi: 10.1162/jocn.2006.18.11.1789 PMID: 17069470

27. Chan YC, Chou TL, Chen HC, Liang KC (2012) Segregating the comprehension and elaboration processing of verbal jokes: An fMRI study. NeuroImage 61: 899-906. doi: 10.1016/j.neuroimage.2012.03.052 PMID: 22472220

28. Mobbs D, Greicius MD, Abdel-Azim E, Menon V, Reiss AL (2003) Humor Modulates the Mesolimbic Reward Centers. Neuron 40: 1041-1048. PMID: 14659102

29. Bekinschtein TA, Davis MH, Rodd JM, Owen AM (2011) Why Clowns Taste Funny: The Relationship between Humor and Semantic Ambiguity. Journal of Neuroscience 31: 9665-9671. doi: 10.1523/JNEUROSCI.5058-10.2011 PMID: 21715632

30. Attardo S, Eisterhold J, Hay J, Poggi I, Attardo JodiHay JIS (2003) Multimodal markers of irony and sarcasm. Humor: International Journal of Humor Research 16: 243-243.

31. Ga Bryant, Fox Tree JE (2002) Recognizing Verbal Irony in Spontaneous Speech. Metaphor and Symbol 17: 99-119.

32. Oldfield RC (1971) The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9: 97-113. PMID: 5146491

33. Buchel C, Holmes Ap Fau—Rees G, Rees G Fau—Friston KJ, Friston KJ Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments.

34. Friston KJ, Penny WD, Glaser DE (2005) Conjunction revisited. NeuroImage 25: 661-667. doi: 10.1016/j.neuroimage.2005.01.013 PMID: 15808967

35. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, et al. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15: 273-289. doi: 10.1006/nimg.2001.0978 PMID: 11771995

36. Frith U, Frith CD (2003) Development and neurophysiology of mentalizing. Philosophical Transactions of the Royal Society B: Biological Sciences 358: 459-473.

37. Saxe R, Powell LJ (2006) It's the Thought That Counts: Specific Brain Regions for One Component of Theory of Mind. Psychological Science 17: 692-699. doi: 10.1111/j.1467-9280.2006.01768.x PMID: 16913952

38. Wang AT, Lee SS, Sigman M, Dapretto M (2006) Neural basis of irony comprehension in children with autism: The role of prosody and context. Brain 129: 932-943. doi: 10.1093/brain/awl032 PMID: 16481375

39. Vigneau M, Beaucousin V, Hervé PY, Duffau H, Crivello F, et al. (2006) Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing. NeuroImage 30: 1414-1432. doi: 10.1016/j.neuroimage.2005.11.002 PMID: 16413796

40. Frühholz S, Grandjean D (2013) Processing of emotional vocalizations in bilateral inferior frontal cortex. Neuroscience and Biobehavioral Reviews 37: 2847-2855. doi: 10.1016/j.neubiorev.2013.10.007 PMID: 24161466

41. Matsui T, Nakamura T, Utsumi A, Sasaki AT, Koike T, et al. (2016) The role of prosody and context in sarcasm comprehension: Behavioral and fMRI evidence. Neuropsychologia 87: 74-84. doi: 10.1016/j.neuropsychologia.2016.04.031 PMID: 27157883
42. Kuperberg GR, McGuire PK, Bullmore ET, Brammer MJ, Rabe-Hesketh S, et al. (2000) Common and distinct neural substrates for pragmatic, semantic, and syntactic processing of spoken sentences: an fMRI study. J Cogn Neurosci 12: 321-341. PMID: 10771415

43. Redcay E (2008) The superior temporal sulcus performs a common function for social and speech perception: Implications for the emergence of autism. Neuroscience and Biobehavioral Reviews 32: 123-142. doi: 10.1016/j.neubiorev.2007.06.004 PMID: 17706781

44. Price CJ (2010) The anatomy of language: A review of 100 fMRI studies published in 2009. Annals of the New York Academy of Sciences 1191: 62-88. doi: 10.1111/j.1749-6632.2010.05444.x PMID: 20392276

45. Ketteler D, Kastrau F, Vohn R, Huber W (2008) The subcortical role of language processing. High level linguistic features such as ambiguity-resolution and the human brain; an fMRI study. NeuroImage 39: 2002-2009. doi: 10.1016/j.neuroimage.2007.10.023 PMID: 18061483

46. Uchiyama HT, Saito DN, Tanabe HC, Harada T, Seki A, et al. (2012) Distinction between the literal and intended meanings of sentences: A functional magnetic resonance imaging study of metaphor and sarcasm. Cortex 48: 563-583. doi: 10.1016/j.cortex.2011.01.004 PMID: 21333979

47. Wang AT, Lee SS, Sigman M, Dapretto M (2006) Developmental changes in the neural basis of interpreting communicative intent. Social cognitive and affective neuroscience 1: 107-121. doi: 10.1093/scan/nsl018 PMID: 18985123

48. Gardner H., Ling PK, Fau LP, Flamm L., Silverman J (1975) Comprehension and appreciation of humorous material following brain damage.

49. Wyer RS, Collins JE (1992) A Theory of Humor Elicitation. Psychological Review 99: 663-688. PMID: 1454903

50. Moran JM, Wig GS, Adams RB, Janata P, Kelley WM (2004) Neural correlates of humor detection and appreciation. NeuroImage 21: 1055-1060. doi: 10.1016/j.neuroimage.2003.10.017 PMID: 15006673

51. Bonelli RM, Cummings JL (2007) Frontal-subcortical circuitry and behavior. Dialogues in Clinical Neuroscience 9: 141-151. PMID: 17726913

52. Schultz W (2000) Multiple reward signals in the brain. Nat Rev Neurosci 1: 199-207. doi: 10.1038/35044563 PMID: 11257908

53. Watson KK, Matthews BJ, Allman JM (2007) Brain activation during sight gags and language-dependent humor. Cerebral Cortex 17: 314-324. doi: 10.1093/cercor/bhj149 PMID: 16514105

54. Franklin RG, Adams RB (2011) The reward of a good joke: neural correlates of viewing dynamic displays of stand-up comedy. Cognitive, Affective, & Behavioral Neuroscience 11: 508-515.

55. Leggitt JS, Gibbs RW (2010) Emotional Reactions to Verbal Irony. Emotional Reactions to Verbal Irony. Discourse Processes 29: 37-41.