# Emotional visual mismatch negativity: a joint investigation of social and non-social dimensions in adults with autism

Klara Kovarski, Judith Charpentier, Sylvie Roux, Magali Batty, Emmanuelle Houy-Durand, Marie Gomot

<figure><img src="image_1.png" /></figure>

## To cite this version:

Klara Kovarski, Judith Charpentier, Sylvie Roux, Magali Batty, Emmanuelle Houy-Durand, et al. Emotional visual mismatch negativity: a joint investigation of social and non-social dimensions in adults with autism. Translational Psychiatry, 2021, 11 (1), 10.1038/s41398-020-01133-5. hal-03115323

HAL Id: hal-03115323

https://hal.science/hal-03115323

Submitted on 18 Dec 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.
ARTICLE

Open Access

# Emotional visual mismatch negativity: a joint investigation of social and non-social dimensions in adults with autism

Klara Kovarski<sup>1,2,3</sup>, Judith Charpentier<sup>1</sup>, Sylvie Roux<sup>1</sup>, Magali Batty<sup>4</sup>, Emmanuelle Houy-Durand<sup>1,5</sup> and Marie Gomot<sup>1</sup>

## Abstract

Unusual behaviors and brain activity to socio-emotional stimuli have been reported in Autism Spectrum Disorder (ASD). Atypical reactivity to change and intolerance of uncertainty are also present, but little is known on their possible impact on facial expression processing in autism. The visual mismatch negativity (vMMN) is an electrophysiological response automatically elicited by changing events such as deviant emotional faces presented among regular neutral faces. While vMMN has been found altered in ASD in response to low-level changes in simple stimuli, no study has investigated this response to visual social stimuli. Here two deviant expressions were presented, neutral and angry, embedded in a sequence of repetitive neutral stimuli. vMMN peak analyses were performed for latency and amplitude in early and late time windows. The ASD group presented smaller amplitude of the late vMMN to both neutral and emotional deviants compared to the typically developed adults (TD) group, and only the TD group presented a sustained activity related to emotional change (i.e., angry deviant). Source reconstruction of the vMMNs further revealed that any change processing elicited a reduced activity in ASD group compared to TD in the saliency network, while the specific processing emotional change elicited activity in the temporal region and in the insula. This study confirms atypical change processing in ASD and points to a specific difficulty in the processing of emotional changes, potentially playing a crucial role in social interaction deficits. Nevertheless, these results require to be further replicated with a greater sample size and generalized to other emotional expressions.

## Introduction

Autism Spectrum Disorder (ASD) is a neurodevelop-
mental disorder characterized by two main categories of
symptoms, the first including disturbances in the socio-
emotional domain and the second including restricted
interests, stereotyped behaviors, and atypical sensory
responsiveness<fnref n="1" />. Difficulties in social interactions have
been associated with atypical social cognition and emo-
tional processing, while signs observed in the second
clinical dimension have often been related to intolerance
of uncertainty, a dispositional trait implying a reduced
adaptation under unpredictable conditions<fnref n="2" />. Though the

combination of both social difficulties and repetitive
behaviors is required for ASD diagnosis, the interplay
between these two clinical dimensions remains barely
studied.

In line with difficulties for ASD in the social domain,
faces represent particularly challenging stimuli to appre-
hend. Faces are socially relevant and convey rapid infor-
mation about others' intentions. Facial expressions
provide additional important cues triggering emotion-
related attentional mechanisms. Because of its social
value, detecting changes in facial expressions is a funda-
mental requisite to avoid danger and allows adaptation to
others' reactions. In autism, impaired emotional face
recognition has repeatedly been reported³,⁴, in line with
atypical amplitude and/or latency of event-related
potentials (ERPs) or patterns of brain activity in

Correspondence: Klara Kovarski (Klara.kovarski@u-paris.fr)

<figure><img src="image_2.png" /></figure>

<footnote n="1">¹UMR 1253 iBrain, Université de Tours, Inserm, Tours, France</footnote>

<footnote n="2">²Hôpital Fondation Adolphe de Rothschild, Paris, France
Full list of author information is available at the end of the article</footnote>
response to both static and dynamic emotional faces<sup>3,5-7</sup>. Symmetrically, sensory particularities and intolerance of uncertainty in ASD might relate to atypical processing of changes in sensory information<sup>8-12</sup>. In the visual domain, automatic change detection responses can be investigated via oddball paradigms allowing to record the visual mismatch negativity (vMMN)<sup>13</sup>. The vMMN is a negative component representing the automatic neural mechanism involved in the processing of unexpected information. vMMN results from the subtraction of a standard stimulation from a deviant stimulation and it is usually observed in early latency range peaking around 100-250 ms post stimulus and has been observed in response to different deviancies such as color, shape, or motion<sup>14</sup>. vMMN has also been identified in response to complex stimuli such as facial expressions peaking within a large time window including one or two deflections depending on the study (100-500 ms, refs.<sup>15-20</sup>). In a previous study on typically developed adults (TD) using a tightly controlled paradigm, we also showed that deviant expressions elicited an early and a late vMMN<sup>18</sup>. Interestingly, while both neutral and emotional deviants elicited vMMN peaks, only the emotional deviancy evoked a late sustained specific response following the later peak.

Although several studies have investigated vMMN in response to simple stimuli in individuals with psychiatric conditions such as schizophrenia (see for a review, ref. ²¹), little research has been conducted on autism ⁹,²²⁻²⁶. Using deviant and novel geometric stimuli during an oddball sequence, it has been shown that children and adults with autism displayed earlier and smaller vMMN compared to controls ⁹,²³, suggesting unusual brain reactivity to visual changes. Few studies have specifically investigated facial expression vMMN in psychiatric conditions²⁷⁻²⁹. One study on major depression disorder showed that early vMMN was reduced and that the later activity was absent in the clinical group²⁷. Similar results were also observed in schizophrenic patients who presented smaller amplitude to fearful and happy deviant faces²⁸. While no studies have investigated vMMN to facial expressions in autistic individuals, one previous work has measured autistic personality traits assessed via the Autism-Spectrum Quotient (AQ) in TD adults, revealing a positive correlation between the AQ scores and the emotional vMMN amplitude. This suggests that vMMN component is sensitive to autistic traits and that greater autistic traits are associated with smaller sustained vMMN mean amplitude (i.e., more positive, ref. ³⁰). Despite growing evidence showing that deficits are not restricted to the social domain, few studies have jointly investigated socio-emotional difficulties with intolerance to change in ASD, by combining both diagnostic dimensions³¹. Accordingly, emotional vMMN is a particularly suitable tool to explore the brain processes at the interplay

between the two diagnostic criteria in autism. By using a highly controlled paradigm, the present study aimed at investigating automatic change detection to emotional faces in adults with ASD. To this end, both oddball and equiprobable sequences have been presented to participants allowing to control for neural habituation and to low-level features³²,³³. Both an emotional (i.e., angry face) and a neutral deviant were presented to investigate the automatic emotional change response¹⁸. In accordance with the literature and clinical observations in individuals with ASD, we expected (i) a disruption of the automatic change detection and (ii) a lack of modulation of the change detection process according to the emotional value/nature of the deviant stimulus. Conversely, in the TD group an emotion-specific response to angry deviants should be recorded, as previously shown¹⁸.

# Material and methods

## Participants

Thirty-seven participants completed the electroencephalographic (EEG) task. An original sample of 20 adults with ASD completed the task; however, 3 participants were excluded from the group analyses because of poor EEG recording quality (e.g., noisy signal, few averaged trials). Seventeen adults with ASD (mean age ± standard deviation: 25.7 ± 6.4; 3 females) were matched by chronological age to 17 TD adults (mean age: 26.3 ± 6.8; 3 females, age group comparison: t(32) = 0.26, P = 0.80). ASD participants were evaluated by an experienced clinical team at the Autism Resource Centre of Tours and were diagnosed according to the Diagnostic and Statistical Manual of Mental Disorders criteria and by using the Autism Diagnostic Observation Schedule, Second Edition and/or the Autism Diagnostic Interview-Revised scales¹,³⁴,³⁵. Only one participant was medicated with neuroleptic treatments, which did not influence group data. None of the TD participants reported any developmental difficulties in language or sensorimotor acquisition. For all participants, no disease of the central nervous system, infectious/metabolic disease, epilepsy, or auditory/visual deficit was reported.

Intellectual Quotients (verbal and performance IQs) were obtained using the Wechsler Intelligence Scale for Children Fourth Edition³⁶. An estimation of verbal and performance IQs was performed in the TD group using four selected subtests (Vocabulary, Similarities, Block Design, and Matrix). Two-tailed *t* tests revealed that groups differed on both non-verbal (ASD: 97.1 ± 23; TD: 112.1 ± 11.4; *t*(32) = -2.42, *P* = 0.02) and verbal IQ (ASD: 101.2 ± 23.6; TD: 117.9 ± 14; *t*(32) = -2.51, *P* = 0.04); however, none of the participants presented a developmental delay (IQ < 70).

Written informed consent for the experiment was collected from all participants. The protocol was approved by
the local Ethics Committee according to the ethical
principles of the Declaration of Helsinki (Clinical trial:
NCT02160119).

Stimuli and procedures

The procedure and stimuli used in the present study
were the same as previously reported¹⁸. Six photographs
of the same actress (Fig. 1A) were presented in two
sequences: an oddball and an equiprobable sequence
(Fig. 1A). In the latter, stimuli had equal probability of
occurrence. This sequence was presented to control for
neural habituation due to stimulus repetition in oddball
sequences (standard stimulus)³²,³³,³⁷. Accordingly, con-
trolled vMMN was performed by subtracting the evoked
response of the deviant stimulus (in the oddball sequence)
from the same stimulus presented in the equiprobable
sequence. This allows reducing low-level feature effects
and revealing genuine automatic change detection
responses³⁸.

In the oddball sequence, a neutral expression was pre-
sented as the standard stimulus (std; probability of

occurrence *P* = 0.80). Photographs of the same actress
expressing anger or with a different neutral expression
were presented as the emotional deviant (devAnger, *P* =
0.10) and the neutral deviant (devNeutral, *P* = 0.10)
respectively. In the equiprobable sequence, six stimuli
were presented: the three stimuli of the oddball sequence
and three other facial expressions. Altogether the equi-
probable sequence included angry (the same stimulus as
the angry deviant: equiAnger), fearful and happy faces
(equiFear and equiHappy, respectively), and three neutral
faces (equiNeutral1: same as the standard stimulus,
equiNeutral2: same as the neutral deviant, and equiNeu-
tral3) presented pseudo-randomly (*P* = 0.16 each),
avoiding immediate repetition. Responses to the equiFear,
equiHappy, and equiNeutral3 stimuli were not further
analyzed as these stimuli were added to respect the design
of the equiprobable sequence. Stimuli were previously
behaviorally validated for their emotional significance and
arousal on an independent group of participants; for
details, see ref. ¹⁸. Deviants and the standard stimuli were
normalized for luminance and contrast.

Participants sat comfortably in an armchair 120 cm from
the screen. By using the Presentation® software, stimuli were
presented in the central visual field (visual angle:
width = 5.7°, height = 8.1°) for 150 ms with a 550- ms inter-
stimulus interval (Fig. 1B). The short presentation of the
stimuli allowed preventing from saccadic movements toward
the eyes or mouth region. The oddball sequence comprised
1575 stimuli and the equiprobable sequence 924 stimuli.
Total recording time lasted 30 min. Subjects were asked to
focus on a concurrent visual task: target stimuli consisted of a
face stimulus in which a black fixation cross on the nose,
otherwise present, disappeared. Participants were instructed
to look at the fixation cross and to press a button as quickly
as possible when the cross disappeared. Targets occurred on
neutral standards in the oddball sequence and on any sti-
mulus in the equiprobable sequence (*P* = 0.05). All subjects
were monitored with a camera during the recording session
to ensure compliancy to the task.

Behavioral analysis

Accuracy and false alarms (FAs) during the target
detection task were analyzed and the sensitivity index,
d' = z-score (% correct responses) – z-score (FAs) was
measured to evaluate the degree of attention of the par-
ticipants. A t test was performed to compare groups.

EEG recording

EEG data were recorded using a 64-channel ActiveTwo
system (BioSemi®, The Netherlands). Two electrodes
were applied on the left and right outer canthi of the eyes
and one below the left eye to record the electrooculo-
graphic activity. An additional electrode was placed on the
tip of the nose for offline referencing. During recording,

<figure><img src="image_3.png" /></figure>
impedances were kept <10 kΩ. EEG signal was recorded
with a sampling rate of 512 Hz and filtered at 0–104 Hz.

Pre-processing

A 0.3-Hz digital high-pass filter was applied to the EEG
signal. Ocular artifacts were removed by applying Indep-
endent Component Analysis (ICA) as implemented in
EEGLab. Blink artifacts were captured into components
that were selectively removed via inverse ICA transfor-
mation. Thirty-two components were examined for arti-
facts and one or two components were removed in each
subject. Muscular and other recording artifacts were dis-
carded manually. EEG data were recorded continuously
and time locked to each trial onset. Trials were extracted
over a 700-ms analysis period, from 100 ms pre-stimulus
to 600 ms post-stimulus. ERPs were baseline corrected
and digitally filtered with a low-pass frequency cut-off of
30 Hz.

The first three trials of a sequence, as well as trials
occurring after deviant or target stimuli were not included
in averaging. Each ERP was computed by averaging all
trials of each stimulus type (see Fig. 2A) from the oddball
sequence (std, devAnger, devNeutral) and from the
equiprobable sequence (equiAnger, equiNeutral2). For
each stimulus of interest, the average of artifact-free trials
was, for the TD group: 679 ± 113 (std), 128 ± 17
(devAnger), 128 ± 19 (devNeutral), 123 ± 15 (equiAnger),
and 121 ± 21 (equiNeutral2); for the ASD group: 691 ± 84
(std), 127 ± (devAnger), 128 ± 17 (devNeutral), 127 ± 15
(equiAnger), and 123 ± 15 (equiNeutral2). Groups did not
differ in the number of averaged stimuli regardless of the
stimulus category (all *P* > 0.57).

Responses were analyzed and compared with the ELAN
software³⁹. vMMNs were calculated as ERPs to devAnger
and ERPs to devNeutral stimuli minus the responses eli-
cited by the same emotional (equiAnger) and neutral
(equiNeutral2) stimuli, respectively, presented in the
equiprobable sequence (i.e., anger vMMN = devAnger –
equiAnger; neutral vMMN = devNeutral – equiNeutral2);
see refs. ¹⁸,³³. Group grand average difference waveforms
across participants were examined to establish deflections
of interest. Group comparisons were performed on spe-
cific brain activities related to emotion deviants and neu-
tral deviants.

Statistical analyses

Event-related potentials

To investigate sensory ERP responses, the P100 and
N170 peak latency and amplitude in response to anger
and neutral stimuli presented in the equiprobable
sequence (namely, equiAnger and equiNeutral2) were
analyzed. For the P100, peaks were measured individually
in the 80–140 ms time window (see Fig. 2A). A repeated-
measure analysis of variance (ANOVA) included Group

(TD, ASD) as between-subject factor and Emotion
(Anger, Neutral) and Electrode (O1, O2) as within-subject
factors. A similar analysis was carried out for the N170
but on PO7 and PO8 electrodes in the 140–200 ms time
window.

Visual mismatch negativity

For each condition (i.e., anger and neutral vMMN) and
each group, vMMN amplitudes were compared to base-
line at each electrode and each time point. Then, based on
previous emotional face vMMN studies and on visual
inspection of averaged vMMN responses in both groups,
three time windows were selected to measure early and
late peak latency (80–180 ms and 220–400 ms, respec-
tively) and amplitude and mean amplitude (400–480 ms)
in all participants. These time windows were similar to
responses previously observed in neurotypical individuals
and allowed comparing the clinical groups.

**vMMN peak analyses** Peak latency and amplitude were measured over occipital and parietal sites in two time windows (80–180 ms and 220–400 ms) as the largest negativity within the range for each participant to investigate early and late vMMNs, respectively.

**Sustained vMMN mean amplitude** Mean amplitude was measured in a selected time window (400–480 ms) in each participant, as it rather reflects sustained responses compared to tighter peak activity (see ref. ¹⁸).

**vMMN statistical analyses** Peak (latency, amplitude) and mean amplitude analyses ANOVA were performed on six posterior electrodes: O1, O2, PO7, PO8, P7, and P8 with Group (TD, ASD) as between-subject factor and Emotion (Anger, Neutral), Electrode (Occipital, Parieto-occipital, Parietal), and Hemisphere (Left, Right) as within-subject factors.

For each ANOVA, Bonferroni post hoc comparisons
were performed when necessary. For significant results,
the effect sizes are shown as $\eta_p^2$. Levene tests were
performed to control for group variance if group effects
were found.

As group differences were observed on both verbal and
performance IQs, to control that IQ did not affect brain
responses, analyses of correlation between vMMN and
both verbal and performance IQ were performed in each
group separately. Correlations are reported whether
significant differences were observed.

Permutation analyses

For each condition, a permutation test in the 50–550 ms
time window was performed to compare between groups
activity recorded over all the electrodes. Results were
<figure><img src="image_4.png" /><figcaption>**Fig. 2** Sensory ERPs and vMMNs for each condition and group over parieto-occipital electrodes. **A** Grand-average ERPs at PO8 elicited by emotional (i.e., anger, red lines) and neutral (blue lines) stimuli presented in the equiprobable sequence for the ASD (plain lines) and TD (dotted lines) groups. P1 and N170 components are indicated by arrows. **B** On the top, grand-average vMMN at PO7 and PO8 elicited by emotional (angry, red lines) and neutral (blue lines) deviants for the ASD (plain lines) and for TD (dotted lines) groups. Gray rectangles represent the time windows in which analyses were performed (peak analyses for 120–200 ms and 280–360 ms and 400–480 ms for mean amplitude). On the bottom, 2D scalp topographies (back view) showing mean activity in selected time windows for analyses.</figcaption></figure>
corrected for multiple comparisons across time⁴⁰. These analyses provide supplementary information on group differences by confirming peak analyses or proving topographical findings.

## Source analysis

We performed source reconstruction to estimate the anatomical location of electric sources that could explain ERP data. We used the Curry 8 software (Compumedics USA, Inc.) which implemented the methodology proposed by Wagner et al. Distributed source analysis was performed with the sLORETA method (standardized low-resolution brain electromagnetic tomography) for current density reconstruction (CDR) and a realistically shaped three-compartment boundary element method as head model⁴¹. CDR results for each subject, each emotion (Anger, Neutral), and each condition (Deviant, Equiprobable) were analyzed using the CDR SnPM algorithm (CDR-Statistical non-Parametric Mapping), which is able to extract brain locations through time with significantly different activations between Groups, Emotions, and Conditions, including both main effects and interactions⁴².

For each group, sLORETA images for ERP sources to the emotional vs. neutral stimuli (Emotion effect) in the deviant vs. equiprobable conditions (Condition effect) were compared statistically with a voxel-by-voxel method. Multiple comparisons were corrected by a randomized normalized test based on SnPM. The Group effect (TD vs. ASD) and the Group-by-Emotion interaction of the current sources of emotional and neutral vMMN were performed in the time window between 50 and 500 ms post stimuli onset. The voxels with significant differences (*P* < 0.05) were projected in specific brain regions.

## Results

### Behavioral results

The ASD group presented smaller *d'* values compared to the TD group (ASD: *d'* = 3.4 ± 1.5; TD: *d'* = 4.7 ± 0.75; *t*(32) = 3.23, *P* = 0.003). This was due in particular to four participants in the ASD group presenting a poor task performance (*d'* < 2.0). The other participants performed the task well (ASD: *d'* = 4.0 ± 1.0, *N* = 13). The recordings of the four subjects underscoring on the behavioral task were visually inspected to ensure that these participants looked at the screen during the task. Accordingly, both P1 and N170 components were present in these participants suggesting basic face processing and compliance to the task regardless of the poor performance. Similarly to verbal and performance IQ correlations, *d'* was introduced in correlation analyses together with vMMN parameters, whenever previous electrophysiological statistics revealed significant group differences.

### Event-related potentials

ERPs over PO8 electrode are displayed in Fig. 2A. The results revealed no significant effects on the P100 latency (*P* > 0.21). However, a main effect of Group showed that the ASD group presented a smaller amplitude of the P100 than the TD group (*F*(1,32) = 5.09, *P* = 0.03, η²_p = 0.137). A significant main effect of Emotion (*F*(1,32) = 12.88, *P* = 0.001, η²_p = 0.287) was due to angry faces eliciting a greater P100 compared to neutral face. However, the interaction between Group and Emotion was also significant (*F*(1,32) = 5.78, *P* = 0.02, η²_p = 0.153), explained by the fact that the emotional modulation of P1 amplitude was present in the TD group only (*P* = 0.001) and that groups tended mainly to differ on the emotional condition (*P* = 0.07). For the N170, no significant main effects were revealed on latency (all *P* > 0.13) nor on amplitude (all *P* > 0.08). No significant interactions were found. The apparent but non-significant N170 group difference (*P* = 0.09) seen on the curves Fig. 2A could be related to the important amplitude variability in the TD group (e.g., emotional and neutral averaged amplitude over PO8: TD: -3.53 ± 5.0 μV, ASD: -1.57 ± 2.5 μV).

### Visual mismatch negativity

Student's *t* test for each vMMN in each group revealed significant deflections compared to baseline (*P* < 0.05) between 100 and 550 ms.

### Posterior peak analyses

Visual inspection of potential waveforms over posterior electrodes indicated that two peaks were clearly recognizable in the TD group, occurring at 150 and 310 ms, respectively (see Fig. 2B over PO8 electrode) as previously shown¹⁸.

In the first time window (80–180 ms), analyses of the posterior peak amplitude revealed an effect of Electrode (*F*(1.71,54.6) = 13.10, *P* < 0.001, η²_p = 0.291) explained by parieto-occipital sites (i.e., PO7 and PO8) presenting more negative responses compared to occipital or parietal electrodes (*P* = 0.009, *P* < 0.001, respectively). A significant interaction between Electrode, Emotion, and Group (*F*(1.87,59.8) = 3.39, *P* = 0.043, η²_p = 0.095) was also found due in particular to the ASD group presenting a smaller vMMN amplitude to the emotional compared to the neutral deviancy over the occipital sites (*P* = 0.012), whereas no emotion effect was found on the first vMMN peak amplitude in the TD group. Latency analyses revealed that responses were faster over the occipital sites compared to parieto-occipital sites (*P* = 0.012) as shown by a significant effect of Electrode (*F*(1.80,57.5) = 4.67, *P* = 0.016, η²_p = 0.127). No group differences or other effects were found in this time window.

In the second time window (220–400 ms), peak analyses of the amplitude revealed a significant Group effect
$(F(1,32) = 5.38, P = 0.03, \eta_p^2 = 0.144)$ due to the ASD group presenting a smaller vMMN response. The Electrode effect was also significant $(F(1.80,57.7) = 15.83, P < 0.001, \eta_p^2 = 0.331)$, as both occipital and parieto-occipital sites presented more negative responses compared to parietal sites ($P = 0.002, P < 0.001$, respectively). This effect was further explained by a significant interaction between Group and Electrode ($F(1.80,57.7) = 5.02, P = 0.012, \eta_p^2 = 0.136$) showing that the Electrode effect was due to the TD group only (both comparisons $P < 0.001$). The Hemisphere effect was also significant ($F(1,32) = 6.94, P = 0.013, \eta_p^2 = 0.178$) and explained by larger amplitude over the right hemisphere.

Latency analyses revealed a significant effect of the Hemisphere ($F(1,32) = 5.88, P = 0.02, \eta_p^2 = 0.155$) as the response occurred faster over the left hemisphere. A three-way interaction between the Emotion, Electrode, and Hemisphere was found ($F(1.94,62) = 3.40, P = 0.04, \eta_p^2 = 0.096$) due to responses occurring faster for the neutral compared to the emotional vMMN over the left (P7) compared to the right (P8) parietal electrode ($P = 0.002$). No significant correlations were found with verbal, non-verbal IQ, or *d'* in the TD or ASD groups.

**Mean amplitude analysis of posterior response**

Finally, in the 400–480 ms time window, the analysis performed on the vMMN revealed a significant interaction between Group and Emotion ($F(1,32) = 4.39, P = 0.04, \eta_p^2 = 0.122$), as emotional vMMN response was larger in TD compared to ASD group ($P < 0.05$; emotional response over PO8, TD: $-1.15 \pm 1.7 \mu V$; ASD: $0.04 \pm 1.5 \mu V$). Verbal and non-verbal IQ nor *d'* correlated with mean vMMN activity.

**Permutation analyses**

As show in Fig. 3, the results showed group differences in mainly three time windows for the emotional condition (anger-MMN), while groups differed only around the 300–320 ms time window for the neutral condition. As no group differences were observed on vMMN peak latencies, permutations confirmed that group differences were due to amplitude differences. These analyses also confirmed the significant Group-by-Emotion interaction found in the mean amplitude analysis in the late time window.

**Source estimations**

Source analyses results are summarized in Table 1 and Fig. 4A, B. Table 1 displays brain regions and latencies where significant statistical effects were found.

**Descriptive analysis**

In both groups, CD activity was observed in several brain regions for neutral and emotional vMMN mostly

including striate (in ASD) and extrastriate (in TD) occipital cortices in the MMN first peak latency range and the right fusiform gyrus (FG) and right temporal regions during the second MMN peak in both groups (Fig. 4A).

**Within-group statistical analysis**

In the TD group, the statistical comparison of CD activity in response to Equiprobable and Deviant stimuli leaded to significant differences at 175 ms in the left inferior frontal gyrus (IFG) and at 275 ms in the left superior temporal gyrus (BA22, STG). In the ASD group, the same analysis displayed significant differences in the right temporal pole (BA38, TP), the right STG/insula, right precuneus, and cingulate regions (Table 1).

Source activities of Neutral and Emotional change detection were then directly compared in the Emotion (Anger vs. Neutral) by Condition (Equiprobable vs. Deviant) interaction within each group. The analysis in the TD group showed greater activity for the Emotional than for the Neutral change detection in the left superior frontal gyrus (BA10), left inferior parietal lobule (IPL) (BA40), right middle temporal gyrus (MTG), and later in the right cuneus, right middle frontal gyrus/rectal (BA11) and right anterior cingulate cortex. In the ASD group, no interaction was observed between Emotion (Anger vs. Neutral) and Condition (Equiprobable vs. Deviant) in any of the time windows.

**Between-group statistical analysis**

Group comparison of vMMN sources revealed in the ASD group a significant lower activity compared to the TD group in early time windows in the Precuneus (BA7, 19) and later in the insula (BA13) and in the posterior MTG (BA39) but larger activity in the TP (BA38) in a later time window (340–440 ms). Moreover, significant Group-by-Emotion interaction (i.e., Anger and neutral vMMN) ($P = 0.002$) revealed reduced duration of the source activity in the right insula during emotional change compared to neutral change detection at 395 ms time window in the ASD group, whereas source in the insula maintained its activity for emotional change in the TD group (Table 1 and Fig. 4B).

**Discussion**

By using both oddball and equiprobable sequences, we investigated specific automatic change detection of emotional (i.e., anger) and neutral deviant faces in adults with autism. To our knowledge, this is the first study characterizing automatic deviancy processing to facial expressions in autism by investigating visual MMN and its brain sources.

From the early stages of sensory perception, our results showed atypical responses to faces in individuals with ASD. Indeed, as in a previous study, P100 amplitude was
<figure><img src="image_5.png" /><figcaption>**Fig. 3** Permutation tests analyses. Permutation tests analyses showing statistical significance between groups over the entire scalp (64 electrodes) in the 50–600 ms latency range for the anger vMMN (left) and the neutral MMN (right). Statistical significance is represented by light gray, gray, and black colors ($P < 0.05$, $P < 0.01$, and $P < 0.001$, respectively).</figcaption></figure>

found reduced to emotional face stimuli⁷, in line with early visual responses being affected in those with ASD⁴³⁻⁴⁵. Conversely, N170 amplitude did not differ between the groups as recently shown in a meta-analysis in ASD⁴⁶. Moreover, we showed that only the TD group displayed a greater response to the angry stimulus compared to the neutral one, while this modulation by the emotion was not observed in the ASD group⁷,⁴⁷. These atypical sensory responses suggest that early steps of face and facial expression processing are altered in adults with ASD, in accordance with previous neuroimaging findings showing atypical responses in the occipito-temporal regions⁶,⁴⁸⁻⁵⁰. As demonstrated by the increasing number of studies using vMMN paradigms in psychiatric neurodevelopmental and neurodegenerative conditions, vMMN component is considered as a potential electrophysiological marker of automatic change detection (for a review and meta-analysis, see ref. ²¹). However, to date only few studies have specifically investigated facial expression-related vMMN in clinical populations²⁷⁻²⁹,⁵¹,⁵².

In the present study, similarly to previous investigations on facial expression vMMN, two peaks were observed in the TD group around 150 and 310 ms¹⁷,¹⁸,²⁷,⁵³, with the second peak being followed by a sustained activity for the emotional deviant stimulus but not for the neutral one (see ref. ¹⁸). Analyses of vMMN peaks revealed that change detection responses were different in the ASD and TD groups in the earliest time window (80–180 ms) as only the ASD group presented a reduced emotional response, while the TD group shows similar responses for the neutral and the angry deviants. Reduced vMMN was observed on the second peak in the 220–400 ms latency range in response regardless of the nature of the deviant

stimuli. This corroborates previous studies investigating MMN in the visual modality in ASD using simple non-social stimuli and showing disrupted change detection processing in both children and adults⁹,²³. It is possible that individuals with ASD favor low-level information at the expense of relevant features influenced by the context⁵⁴,⁵⁵. This could turn into a smaller vMMN amplitude compared to TD adults, especially in the case of a controlled vMMN where the stimulus presented in the equiprobable sequence is subtracted from the same stimulus presented as deviant in the oddball sequence allowing to control for low-level features. Conversely, TD individuals might rely more on higher-level information depending on the context (i.e., sequence in which the stimulus is presented), than on low-level aspects while automatically processing changing events (see ref. ⁵⁴).

Such atypical change detection in participants with ASD has also been shown in the auditory modality in response to both physical (tone frequency)¹⁰,¹¹ and prosodic (emotional) deviancies⁵⁶. Altogether, results from visual and auditory MMN studies support the hypothesis of a broad impairment of the automatic change detection system.

In accordance with our expectations, we found no emotional sustained activity in the ASD group in the later time window as compared to TD participants¹⁸. Overall, group differences point for an impairment of change detection mechanism as well as for a specific emotional change detection deficit. This was also confirmed by permutation analyses showing that group differences were found for the emotional condition around an earlier time window compared to the neutral condition. Thus, emotional deviant events may not be processed as being
<table><caption>Table 1 CDR statistical analyses.</caption><thead><tr><th>Comparison</th><th>Time window (ms)</th><th>Brain region label</th><th>Brain region (BA)</th><th>MNI coordinates (x, y, z)</th><th>P value</th></tr></thead><tbody><tr><td colspan="6"><em>Anger vs. neutral (Emo effect)</em></td></tr><tr><td colspan="6"><em>Deviant vs. equiprobable (Cond effect)</em></td></tr><tr><td colspan="6"><em>Comparisons in each group</em></td></tr><tr><td colspan="6"><strong>TD</strong></td></tr><tr><td rowspan="2">Cond effect</td><td>175-179</td><td>IIFG</td><td>BA9</td><td>-45, 6, 25</td><td>P = 0.022</td></tr><tr><td>265-285</td><td>ISTG</td><td>BA22</td><td>-66, -43, 8</td><td>P = 0.001</td></tr><tr><td rowspan="4">Emo effect</td><td>224-240</td><td>rIFG</td><td>BA47</td><td>33, 26, -7</td><td>P = 0.006</td></tr><tr><td>299-304</td><td>rPrecentral G</td><td>BA6</td><td>33, -16, 66</td><td>P = 0.033</td></tr><tr><td>382-406</td><td>rIPL</td><td>BA40</td><td>57, -43, 37</td><td>P = 0.006</td></tr><tr><td>443-451</td><td>rSupraMarginal G</td><td>BA40</td><td>57, -43, 36</td><td>P = 0.015</td></tr><tr><td rowspan="6">Interaction Emo*Cond</td><td>100-107</td><td>ISFG</td><td>BA10</td><td>-38, 49, 20</td><td>P = 0.009</td></tr><tr><td>156-158</td><td>IIPL</td><td>BA40</td><td>-62, -36, 29</td><td>P = 0.044</td></tr><tr><td>363-377</td><td>rMTG</td><td>BA21</td><td>70, -22, -14</td><td>P = 0.003</td></tr><tr><td>415-433</td><td>rMOG</td><td>BA18</td><td>13, -100, 15</td><td>P = 0.004</td></tr><tr><td></td><td>rMFG/rectal</td><td>BA11</td><td>5, 35, -28</td><td>P = 0.004</td></tr><tr><td></td><td>rACC</td><td>BA32</td><td>7, 31, -14</td><td>P = 0.004</td></tr><tr><td colspan="6"><strong>ASD</strong></td></tr><tr><td rowspan="8">Cond. effect</td><td>189-202</td><td>rTP</td><td>BA38</td><td>22, 7, -40</td><td>P = 0.004</td></tr><tr><td>248-257</td><td>IPrecentral</td><td>BA6</td><td>-61, -16, 43</td><td>P = 0.021</td></tr><tr><td>270-277</td><td>rInsula</td><td>BA13</td><td>46, -13, 4</td><td>P = 0.013</td></tr><tr><td></td><td>rSTG</td><td>BA22</td><td>53, -16, 5</td><td>P = 0.013</td></tr><tr><td>293-308</td><td>IPrecentral</td><td>BA6</td><td>-37, -9, 63</td><td>P = 0.001</td></tr><tr><td>375-390</td><td>rIPS/precuneus</td><td>BA7</td><td>28, -57, 54</td><td>P = 0.022</td></tr><tr><td>417-431</td><td>IMFG</td><td>BA6</td><td>-3, -22, 53</td><td>P = 0.013</td></tr><tr><td></td><td>rMFG</td><td>BA6</td><td>5, -22, 54</td><td>P = 0.013</td></tr><tr><td colspan="6"><em>Group comparisons on vMMNs</em></td></tr><tr><td rowspan="4">Emo. effect</td><td rowspan="4">Interaction Emo*Cond</td><td></td><td>rCingulate</td><td>BA24</td><td>-7, -23, 38</td><td>P = 0.013</td></tr><tr><td></td><td>rCingulate</td><td>BA24</td><td>6, -23, 39</td><td>P = 0.013</td></tr><tr><td>205-238</td><td>IIPL</td><td>BA40</td><td>-66, -26, 23</td><td>P = 0.001</td></tr><tr><td colspan="6"><em>Group comparisons on vMMNs</em></td></tr><tr><td rowspan="4">TD > ASD</td><td>171-189</td><td>rPrecuneus</td><td>BA19</td><td>44, -76, 37</td><td>P = 0.002</td></tr><tr><td>319-341</td><td>rPrecuneus</td><td>BA7</td><td>12, -78, 45</td><td>P = 0.017</td></tr><tr><td>429-437</td><td>rInsula</td><td>BA13</td><td>-31, 18, -8</td><td>P = 0.013</td></tr><tr><td>447-454</td><td>rMTG</td><td>BA39</td><td>44, -61, 25</td><td>P = 0.030</td></tr><tr><td rowspan="2">ASD > TD</td><td>347-355</td><td>rSTG</td><td>BA38</td><td>44, 17, -37</td><td>P = 0.034</td></tr><tr><td>429-437</td><td>ISTG</td><td>BA38</td><td>-33, 20, -36</td><td>P = 0.013</td></tr><tr><td>Interaction Group*Emo</td><td>392-396</td><td>rInsula</td><td>BA13</td><td>37, 7, -8</td><td>P = 0.006</td></tr></tbody></table>

particularly salient as in TD adults and might be under-processed in participants with ASD, leading to major difficulties in social adaptation. Altogether, these results

are in line with the positive correlation between AQ scores measured in TD adults and vMMN amplitude to happy deviant stimuli as previously shown³⁰, meaning
<figure><img src="image_6.png" /></figure>

that more autistic traits were associated with smaller
vMMN amplitude (i.e. more positive).

In order to better understand the brain processes
involved in facial expression change detection, explora-
tory and complementary source analyses were performed.
Only few studies investigated sources in emotional
vMMN in TD participants<sup>15,16,28,37</sup>, and this is the first to
investigate source activity of vMMN responses to emo-
tional and neutral deviants in people with ASD. Foremost,
in both groups, we replicated previous results reported in
TD populations and found activity in the insula and in the
occipital and temporal cortices (i.e., STG, FG, see
refs. <sup>16,37</sup>) during the vMMN process to change in facial
expressions. Hence, the broad face processing network
was involved regardless of the emotional content in both
groups, suggesting that when gaze is forced to a specific
face area (nearby the eyes' region as in our protocol), the
FG is typically activated in autistic individuals<sup>48,57</sup>. Sec-
ond, we showed that during change processing, compared
to controls, individuals with autism displayed reduced
activity in the posterior MTG/IPL (BA 19/39), regions
belonging to the automatic saliency network<sup>58</sup>. Results
also indicated reduced activity in the insula in the ASD
group while processing the emotional deviancy specifi-
cally. Here again, findings suggest that the activity of the
brain regions involved in the broad change detection
process is atypical and also not modulated by the emo-
tional nature of the stimuli. By showing reduced activity of
the insula in those with ASD, the present results are in
accordance with a meta-analysis showing a hypo-
activation of this region during face perception<sup>59</sup>. How-
ever, such hypo-activation was also observed in non-social

cognition contexts, in line with the insula contributing to
the processing of saliency and also integrating together
sensory and affective information⁶⁰. Other studies, how-
ever, show a hyper-activation of this region in autism,
especially in children (for a review, see ref. ⁶⁰), suggesting
that, depending on the specific process and age group,
different patterns can be observed. In line with this, our
results suggest an impaired activity of the insula related to
atypical change detection of emotional faces, which might
support that this region plays a critical role in both
affective and pre-attentional processes.

Some limitations should be considered in the present
study. To our knowledge, this is the first investigation of
vMMN to emotional face in adults with autism, which
requires to be further replicated. These data should be
confirmed within a larger sample size and by using
other emotional facial expressions. vMMN protocols
often require the participants to be involved in an active
concurrent task, therefore constraining this kind of
investigation to the higher part of the autistic spectrum.
Other protocols should be designed to allow studying
automatic change detection within the visual modality
in individuals from the whole autistic spectrum. In a
similar vein, studying the vMMN to facial expressions
in younger participants could provide crucial informa-
tion on the developmental aspects of the automatic
detection of emotional changes. Finally, since similar
atypical change detection to emotional faces was found
in other clinical conditions such as schizophrenia, it
would be of interest to compare different groups to
investigate whether our results are specific to the ASD
population.
# Conclusions

The present study provides additional understanding of the automatic emotional processing in autism. Here we combine both understanding of atypical emotional face processing and unusual automatic change detection in autism (see ref. ⁶¹). Indeed, these findings suggest that both atypical tracking of subtle changes and less accurate processing of facial expressions could be responsible for the difficulties in ASD to adapt to complex and rapidly changing social situations.

# Acknowledgements

We thank Luce Corneau and Céline Courtin for helping during recordings and Rémy Magné for technical support. We thank all the participants who took part in the study. This work was supported by a French National Research Agency grant (ANR-12-JSH2 0001-01-AUTATTEN).

# Author details

¹UMR 1253 iBrain, Université de Tours, Inserm, Tours, France. ²Hôpital Fondation Adolphe de Rothschild, Paris, France. ³Université de Paris, CNRS, Integrative Neuroscience and Cognition Center, 75006 Paris, France. ⁴Université de Toulouse, CERPPS, Toulouse, France. ⁵CHRU de Tours, Centre Universitaire de Pédopsychiatrie, Tours, France

# Data availability

Data supporting the findings of this study are available from the corresponding author upon request.

# Conflict of interest

The authors declare that they have no conflict of interest.

# Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Received: 21 July 2020 Revised: 27 November 2020 Accepted: 3 December 2020

Published online: 05 January 2021

# References

1. APA. *Diagnostic and Statistical Manual of Mental Disorders (DSM-5)* (American Psychiatric Association, Washington, DC, 2013).

2. Gomot, M. & Wicker, B. A challenging, unpredictable world for people with autism spectrum disorder. *Int. J. Psychophysiol.* **83**, 240–247 (2012).

3. Harms, M. B., Martin, A. & Wallace, G. L. Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies. *Neuropsychol. Rev.* **20**, 290–322 (2010).

4. Evers, K., Steyaert, J., Noens, I. & Wagemans, J. Reduced recognition of dynamic facial emotional expressions and emotion-specific response bias in children with an autism spectrum disorder. *J. Autism Dev. Disord.* **45**, 1774–1784 (2015).

5. Black, M. H. et al. Mechanisms of facial emotion recognition in autism spectrum disorders: Insights from eye tracking and electroencephalography. *Neurosci. Biobehav. Rev.* **80**, 488–515 (2017).

6. Critchley, H. D. et al. The functional neuroanatomy of social behaviour: changes in cerebral blood flow when people with autistic disorder process facial expressions. *Brain* **123**, 2203–2212 (2000).

7. Batty, M., Meaux, E., Wittemeyer, K., Roge, B. & Taylor, M. J. Early processing of emotional faces in children with autism: an event-related potential study. *J. Exp. Child Psychol.* **109**, 430–444 (2011).

8. Clery, H., Andersson, F., Fonlupt, P. & Gomot, M. Brain correlates of automatic visual change detection. *Neuroimage* **75**, 117–122 (2013).

9. Clery, H. et al. Atypical visual change processing in children with autism: an electrophysiological study. *Psychophysiology* **50**, 240–252 (2013).

10. Gomot, M. et al. Candidate electrophysiological endophenotypes of hyperreactivity to change in autism. *J. Autism Dev. Disord.* **41**, 705–714 (2011).

11. Gomot, M., Giard, M. H., Adrien, J. L., Barthelemy, C. & Bruneau, N. Hypersensitivity to acoustic change in children with autism: electrophysiological evidence of left frontal cortex dysfunctioning. *Psychophysiology* **39**, 577–584 (2002).

12. Gomot, M. et al. Change detection in children with autism: an auditory event-related fMRI study. *Neuroimage* **29**, 475–484 (2006).

13. Kimura, M., Schroger, E. & Czigler, I. Visual mismatch negativity and its importance in visual cognitive sciences. *Neuroreport* **22**, 669–673 (2011).

14. Qian, X. et al. The visual mismatch negativity (vMMN): toward the optimal paradigm. *Int. J. Psychophysiol.* **93**, 311–315 (2014).

15. Kimura, M., Kondo, H., Ohira, H. & Schroger, E. Unintentional temporal context-based prediction of emotional faces: an electrophysiological study. *Cereb. Cortex* **22**, 1774–1785 (2012).

16. Vogel, B. O., Shen, C. & Neuhaus, A. H. Emotional context facilitates cortical prediction error responses. *Hum. Brain Mapp.* **36**, 3641–3652 (2015).

17. Astikainen, P., Cong, F., Ristaniemi, T. & Hietanen, J. K. Event-related potentials to unattended changes in facial expressions: detection of regularity violations or encoding of emotions? *Front. Hum. Neurosci.* **7**, 557 (2013).

18. Kovarski, K. et al. Facial expression related vMMN: disentangling emotional from neutral change detection. *Front. Hum. Neurosci.* **11**, 18 (2017).

19. Rosburg, T., Weigl, M. & Deuring, G. Enhanced processing of facial emotion for target stimuli. *Int. J. Psychophysiol.* **146**, 190–200 (2019).

20. Kuehne, M., Siwy, I., Zaehle, T., Heinze, H. J. & Lobmaier, J. S. Out of focus: facial feedback manipulation modulates automatic processing of unattended emotional faces. *J. Cogn. Neurosci.* **31**, 1631–1640 (2019).

21. Kremlacek, J. et al. Visual mismatch negativity (vMMN): a review and meta-analysis of studies in psychiatric and neurological disorders. *Cortex* **80**, 76–112 (2016).

22. Clery, H. et al. fMRI investigation of visual change detection in adults with autism. *Neuroimage Clin.* **2**, 303–312 (2013).

23. Clery, H. et al. Electrophysiological evidence of atypical visual change detection in adults with autism. *Front. Hum. Neurosci.* **7**, 62 (2013).

24. Kemner, C., Verbaten, M. N., Cuperus, J. M., Camfferman, G. & Van Engeland, H. Visual and somatosensory event-related brain potentials in autistic children and three different control groups. *Electroencephalogr. Clin. Neurophysiol.* **92**, 225–237 (1994).

25. Sokhadze, E. et al. Event-related potential study of novelty processing abnormalities in autism. *Appl. Psychophysiol. Biofeedback* **34**, 37–51 (2009).

26. Maekawa, T. et al. Top-down and bottom-up visual information processing of non-social stimuli in high-functioning autism spectrum disorder. *Res. Autism Spectr. Disord.* **5**, 201–209 (2011).

27. Chang, Y., Xu, J., Shi, N., Zhang, B. & Zhao, L. Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN. *Neurosci. Lett.* **472**, 33–37 (2010).

28. Csukly, G., Stefanics, G., Komlosi, S., Czigler, I. & Czobor, P. Mismatch-related visual mismatch responses in schizophrenia: impairments and correlations with emotion recognition. *PLoS ONE* **8**, e75444 (2013).

29. Tang, D. et al. Visual mismatch negativity in the detection of facial emotions in patients with panic disorder. *Neuroreport* **24**, 207–211 (2013).

30. Gayle, L. C., Gal, D. E. & Kieffaber, P. D. Measuring affective reactivity in individuals with autism spectrum personality traits using the visual mismatch negativity event-related brain potential. *Front. Hum. Neurosci.* **6**, 334 (2012).

31. Dichter, G. S., Felder, J. N. & Bodfish, J. W. Autism is characterized by dorsal anterior cingulate hyperactivation during social target detection. *Soc. Cogn. Affect Neurosci.* **4**, 215–226 (2009).

32. Schroger, E. & Wolff, C. Mismatch response of the human brain to changes in sound location. *Neuroreport* **7**, 3005–3008 (1996).

33. Kimura, M., Katayama, J., Ohira, H. & Schroger, E. Visual mismatch negativity: new evidence from the equiprobable paradigm. *Psychophysiology* **46**, 402–409 (2009).

34. Lord, C. et al. The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. *J. Autism Dev. Disord.* **30**, 205–223 (2000).

35. Lord, C., Rutter, M. & Le Couteur, A. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. *J. Autism Dev. Disord.* **24**, 659–685 (1994).

36. Wechsler, D. *Wechsler Intelligence Scale for Children (Fourth Edition, WISC-IV)* (The Psychological Corporation, San Antonio, TX, 2005).

37. Li, X., Lu, Y., Sun, G., Gao, L. & Zhao, L. Visual mismatch negativity elicited by facial expressions: new evidence from the equiprobable paradigm. *Behav. Brain Funct.* **8**, 7 (2012).
38. Jacobsen, T. & Schroger, E. Is there pre-attentive memory-based comparison of pitch? *Psychophysiology* **38**, 723–727 (2001).

39. Aguera, P. E., Jerbi, K., Caclin, A. & Bertrand, O. ELAN: a software package for analysis and visualization of MEG, EEG, and LFP signals. *Comput. Intell. Neurosci.* **2011**, 158970 (2011).

40. Guthrie, D. & Buchwald, J. S. Significance testing of difference potentials. *Psychophysiology* **28**, 240–244 (1991).

41. Fuchs, M., Kastner, J., Wagner, M., Hawes, S. & Ebersole, J. S. A standardized boundary element method volume conductor model. *Clin. Neurophysiol.* **113**, 702–712 (2002).

42. Wagner, M., Ponton, C., Tech, R., Fuch, M. & Kastner, J. Non-parametric statistical analysis of EEG/MEG map topographies and source distributions on the epoch level. *Hum. Cogn. Neurophysiol.* **7**, 1–23 (2014).

43. Kovarski, K. et al. Brief report: early VEPs to pattern-reversal in adolescents and adults with autism. *J. Autism Dev. Disord.* **46**, 3377–3386 (2016).

44. Pei, F., Baldassi, S. & Norcia, A. M. Electrophysiological measures of low-level vision reveal spatial processing deficits and hemispheric asymmetry in autism spectrum disorder. *J. Vis.* **14**, 3 (2014).

45. Kornmeier, J., Worner, R., R., A., Bach, M. & vE, L. T. A different view on the checkerboard? Alterations in early and late visually evoked EEG potentials in asperger observers. *PLoS ONE* **9**, e90993 (2014).

46. Kang, E. et al. Atypicality of the N170 event-related potential in autism spectrum disorder: a meta-analysis. *Biol. Psychiatry* **3**, 657–666 (2018).

47. de Jong, M. C., van Engeland, H. & Kemner, C. Attentional effects of gaze shifts are influenced by emotion and spatial frequency, but not in autism. *J. Am. Acad. Child Adolesc. Psychiatry* **47**, 443–454 (2008).

48. Hadjikhani, N. et al. Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. *Neuroimage* **22**, 1141–1150 (2004).

49. Pelphrey, K. A. et al. Visual scanning of faces in autism. *J. Autism Dev. Disord.* **32**, 249–261 (2002).

50. Kovarski, K. et al. Enhanced early visual responses during implicit emotional faces processing in autism spectrum disorder. *J. Autism Dev. Disord.* **49**, 871–886 (2019).

51. Xu, Q. et al. Automatic processing of changes in facial emotions in dysphoria: a magnetoencephalography study. *Front. Hum. Neurosci.* **12**, 186 (2018).

52. She, S. et al. Revealing the dysfunction of schematic facial-expression processing in schizophrenia: a comparative study of different references. *Front. Neurosci.* **11**, 314 (2017).

53. Astikainen, P. & Hietanen, J. K. Event-related potentials to task-irrelevant changes in facial expressions. *Behav. Brain Funct.* **5**, 30 (2009).

54. Pellicano, E. & Burr, D. When the world becomes 'too real': a Bayesian explanation of autistic perception. *Trends Cogn. Sci.* **16**, 504–510 (2012).

55. Mottron, L., Dawson, M., Soulières, I., Hubert, B. & Burack, J. Enhanced perceptual functioning in autism: an update, and eight principles of autistic perception. *J. Autism Dev. Disord.* **36**, 27–43 (2006).

56. Charpentier, J. et al. Emotional prosodic change detection in autism spectrum disorder: an electrophysiological investigation in children and adults. *J. Neurodev. Disord.* **10**, 28 (2018).

57. Perlman, S. B., Hudac, C. M., Pegors, T., Minshew, N. J. & Pelphrey, K. A. Experimental manipulation of face-evoked activity in the fusiform gyrus of individuals with autism. *Soc. Neurosci.* **6**, 22–30 (2011).

58. Corbetta, M., Kincade, J. M., Ollinger, J. M., McAvoy, M. P. & Shulman, G. L. Voluntary orienting is dissociated from target detection in human posterior parietal cortex. *Nat. Neurosci.* **3**, 292–297 (2000).

59. Di Martino, A. et al. Functional brain correlates of social and nonsocial processes in autism spectrum disorders: an activation likelihood estimation meta-analysis. *Biol. Psychiatry* **65**, 63–74 (2009).

60. Nomi, J. S., Molnar-Szakacs, I. & Uddin, L. Q. Insular function in autism: update and future directions in neuroimaging and interventions. *Prog. Neuropsychopharmacol. Biol. Psychiatry* **89**, 412–426 (2019).

61. Latinus, M. et al. Inflexibility in autism spectrum disorder: need for certainty and atypical emotion processing share the blame. *Brain Cogn.* **136**, 103599 (2019).