# The EU-AIMS Longitudinal European Autism Project (LEAP): design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders

Eva Loth, Tony Charman, Luke Mason, Julian Tillmann, Emily J H Jones, Caroline Wooldridge, Jumana Ahmad, Bonnie Auyeung, Claudia Brogna, Sara Ambrosino, et al.

► To cite this version:

Eva Loth, Tony Charman, Luke Mason, Julian Tillmann, Emily J H Jones, et al.. The EU-AIMS Longitudinal European Autism Project (LEAP): design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders. Molecular Autism, 2017, 8 (24), 10.1186/s13229-017-0146-8. pasteur-01967232

HAL Id: pasteur-01967232

https://pasteur.hal.science/pasteur-01967232

Submitted on 30 Dec 2018

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
RESEARCH

Open Access

<figure><img src="image_2.png" /></figure>

CrossMark

# The EU-AIMS Longitudinal European Autism Project (LEAP): design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders

Eva Loth<sup>1,2,*</sup>, Tony Charman<sup>3</sup>, Luke Mason<sup>4</sup>, Julian Tillmann<sup>3</sup>, Emily J. H. Jones<sup>4</sup>, Caroline Wooldridge<sup>5</sup>, Jumana Ahmad<sup>2</sup>, Bonnie Auyeung<sup>6,7</sup>, Claudia Brogna<sup>8</sup>, Sara Ambrosino<sup>9</sup>, Tobias Banaschewski<sup>10</sup>, Simon Baron-Cohen<sup>6</sup>, Sarah Baumeister<sup>10</sup>, Christian Beckmann<sup>11</sup>, Michael Brammer<sup>5</sup>, Daniel Brandeis<sup>10,12</sup>, Sven Bölte<sup>13</sup>, Thomas Bourgeron<sup>14</sup>, Carsten Bours<sup>11</sup>, Yvette de Bruijn<sup>11</sup>, Bhismadev Chakrabarti<sup>6,15</sup>, Daisy Crawley<sup>2</sup>, Ineke Cornelissen<sup>11</sup>, Flavio Dell' Acqua<sup>1,2</sup>, Guillaume Dumas<sup>14</sup>, Sarah Durston<sup>9</sup>, Christine Ecker<sup>1,16</sup>, Jessica Faulkner<sup>2</sup>, Vincent Frouin<sup>17</sup>, Pilar Garces<sup>18</sup>, David Goyard<sup>17</sup>, Hannah Hayward<sup>2</sup>, Lindsay M. Ham<sup>19</sup>, Joerg Hipp<sup>18</sup>, Rosemary J. Holt<sup>6</sup>, Mark H. Johnson<sup>4</sup>, Johan Isaksson<sup>13,20</sup>, Prantik Kundu<sup>21</sup>, Meng-Chuan Lai<sup>6,22</sup>, Xavier Liogier D'ardhuy<sup>18</sup>, Michael V. Lombardo<sup>6,23</sup>, David J. Lythgoe<sup>5</sup>, René Mandl<sup>9</sup>, Andreas Meyer-Lindenberg<sup>24</sup>, Carolin Moessnang<sup>24</sup>, Nico Mueller<sup>10</sup>, Laurence O'Dwyer<sup>11</sup>, Marianne Oldehinkel<sup>11</sup>, Bob Oranje<sup>9</sup>, Gahan Pandina<sup>25</sup>, Antonio M. Persico<sup>8,26</sup>, Amber N. V. Ruigrok<sup>6</sup>, Barbara Ruggeri<sup>27</sup>, Jessica Sabet<sup>2</sup>, Roberto Sacco<sup>8</sup>, Antonia San José Cáceres<sup>2</sup>, Emily Simonoff<sup>28</sup>, Roberto Toro<sup>14</sup>, Heike Tost<sup>24</sup>, Jack Waldman<sup>6</sup>, Steve C. R. Williams<sup>5</sup>, Marcel P. Zwiers<sup>11</sup>, Will Spooren<sup>18</sup>, Declan G. M. Murphy<sup>1,2</sup> and Jan K. Buitelaar<sup>11</sup>

## Abstract

**Background:** The tremendous clinical and aetiological diversity among individuals with autism spectrum disorder (ASD) has been a major obstacle to the development of new treatments, as many may only be effective in particular subgroups. Precision medicine approaches aim to overcome this challenge by combining pathophysiologically based treatments with stratification biomarkers that predict which treatment may be most beneficial for particular individuals. However, so far, we have no single validated stratification biomarker for ASD. This may be due to the fact that most research studies primarily have focused on the identification of mean case-control differences, rather than within-group variability, and included small samples that were underpowered for stratification approaches. The EU-AIMS Longitudinal European Autism Project (LEAP) is to date the largest multi-centre, multi-disciplinary observational study worldwide that aims to identify and validate stratification biomarkers for ASD.

(Continued on next page)

<footnote>* Correspondence: eva.loth@kcl.ac.uk</footnote>

<footnote n="1"><sup>1</sup>Sackler Institute for Translational Neurodevelopment, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK</footnote>

<footnote n="2"><sup>2</sup>Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK</footnote>

<footnote>Full list of author information is available at the end of the article</footnote>
(Continued from previous page)

**Methods:** LEAP includes 437 children and adults with ASD and 300 individuals with typical development or mild intellectual disability. Using an accelerated longitudinal design, each participant is comprehensively characterised in terms of clinical symptoms, comorbidities, functional outcomes, neurocognitive profile, brain structure and function, biochemical markers and genomics. In addition, 51 twin-pairs (of which 36 had one sibling with ASD) are included to identify genetic and environmental factors in phenotypic variability.

**Results:** Here, we describe the demographic characteristics of the cohort, planned analytic stratification approaches, criteria and steps to validate candidate stratification markers, pre-registration procedures to increase transparency, standardisation and data robustness across all analyses, and share some 'lessons learnt'. A clinical characterisation of the cohort is given in the companion paper (Charman et al., accepted).

**Conclusion:** We expect that LEAP will enable us to confirm, reject and refine current hypotheses of neurocognitive/ neurobiological abnormalities, identify biologically and clinically meaningful ASD subgroups, and help us map phenotypic heterogeneity to different aetiologies.

**Keywords:** Biomarkers, Cognition, Neuroimaging, MRI, EEG, Eye-tracking, Genetics

## Background

Autism spectrum disorder (ASD) is a life-long neurodevelopmental condition, currently estimated to affect between 1 and 1.5% of children and adults worldwide [1]. Since Kanner's [2] and Asperger's seminal case reports [3], diagnostic classification has solely relied on clinical observation, rather than aetiology. Defining symptoms are impairments in social-communication, repetitive and restricted behaviours and interests, and atypical sensory responses (DSM-5 [4]). However, the tremendous clinical, aetiological and genetic heterogeneity among individuals with ASD is now widely recognised. Clinically, individuals with ASD can differ substantially from each other in terms of the quality and severity of core symptoms, level of intellectual ability, co-occurring psychiatric symptoms, and developmental trajectories [5]. Multiple neurocognitive and neurobiological abnormalities have been reported, yet none seem to be shared by all individuals with ASD [6]. Likewise, hundreds of common and rare risk genes have been identified [7]. These diverse genetic as well as environmental risk factors may converge on a smaller number of common molecular pathways, including protein synthesis, synapse development and function, and neuro-immune interaction, which in turn impact brain circuit development and function [8]. However, it is not yet known how different aetiologies and phenotypic diversity at the cellular, molecular, brain systems, cognitive, and/or behavioural level(s) map onto one another.

This heterogeneity has also been a major obstacle to the development of effective treatments. Different people with ASD may have different treatment needs; moreover, most medical treatments may only be *effective* in certain subgroups because similar symptoms may have different biological causes in different individuals. In response to this problem, precision medicine aims to develop treatments

based on the understanding of individual differences in the underlying pathophysiology, and then select patients for a particular treatment through use of 'stratification biomarkers' [9]. Therefore, a crucial step for this approach is the identification and validation of biomarkers that can parse the condition into distinct (biological) subgroups.

Stratification research in ASD is still in its infancy. In fact, most studies use case-control designs and look for 'diagnostic biomarkers'. Conceptually, the assumption that ASD involves a variety of pathophysiological mechanisms casts doubt that a truly diagnostic marker—universal and specific to ASD—may exist. Also, the recently developed NIMH Research Domain Criteria (RDoC) Framework suggests that several circuit-based behavioural dimensions may be shared across neurodevelopmental/neuropsychiatric disorders [10]. Methodologically, a mean group difference alone (especially in combination with small effect sizes) does not necessarily indicate that a particular measure would be a good (diagnostic) biomarker for ASD. For example, a test on which the majority of people with ASD falls within 0.5–1 standard deviations of the control group scores would have limited clinical utility in predicting whether someone has ASD or not. Alternatively, a small proportion of individuals with highly atypical scores may drive a mean group difference. On a test with continuous scores, higher scores may be correlated with severity of particular symptoms across ASD and control populations but only indicate risk for ASD above a certain cut-off. This may be more indicative of a potential subgroup, yet within-group variability remains largely unexplored.

In addition, most studies have been hampered by relatively small sample sizes, resulting primarily in lack of power but also the 'winner's curse' (the likelihood of finding exaggerated effects in small studies) [11]. As in many areas of neuroscience [12], in ASD research replication failures are common. Methodological differences,
such as different versions of cognitive tests or different neuroimaging analysis approaches, all impact findings and comparability between studies. Therefore, it is often difficult to disentangle whether inconsistencies between findings reflect participant heterogeneity, statistical power, or methods used.

Hence, to identify clinically useful stratification markers, we need to move from group level declarations to a better understanding of *individual* differences, and we need new approaches to identifying potentially (biologically) distinct ASD subgroups. The developmental nature of ASD and the likelihood that there may not be a strict one-to-one correspondence between different levels of analyses add complexity. Large-scale, longitudinal multidisciplinary observational (or ‘natural history’) studies are an important first step to identify stratification markers and track how different biological and clinical profiles are linked over development. This requires collaborative research using a standardised protocol and analysis plan, and stringent statistical approaches [13]. As part of the European Autism Interventions—A Multicentre Study for Developing New Medications (EU-AIMS) consortium (www.eu-aimseu.eu) [14, 15], we set up the multicentre Longitudinal European Autism Project (LEAP) to address this challenge.

# Methods

## Overall design of the Longitudinal European Autism Project

LEAP comprises over 800 participants. The case-control study includes approximately 437 individuals with ASD, and 300 controls and uses an accelerated longitudinal design. In this design, four cohorts, defined by age and IQ, are recruited concurrently: A. Adults aged 18–30 years; B. Adolescents aged 12–17 years, C. Children aged 6–11 years,—all with IQ in the typical range (75+)—and D. Adolescents and adults aged 12–30 years with ASD and/or mild intellectual disability (ID) (IQ 50–74). Within each schedule, participants are recruited with a male:female ratio 3:1—corresponding to recent estimates of the sex ratio in ASD [16]. The main advantage of the accelerated longitudinal design over a single-cohort longitudinal study lies in the ability to span the age range of interest in a shorter period of time. The cohorts are followed up after 12–24 months using the same core measures (see Table 1). A further twin cohort of N = 102 (including 36 monozygotic or dizygotic twin pairs discordant of ASD) is tested at one time point to identify genetic and environmental causes for ASD and to investigate variable expressivity and penetrance of genetic mutations [17].

The project was designed by academic and industry partners and in consultation with the European Medicines Agency (EMA) to increase the chances that stratification biomarkers identified in this study may be

qualified to support regulatory decisions for future clinical trials [18]. An overview of our study protocol is given in Table 1 and Additional file 1. Our protocol and standard operation procedures (SOPs) are accessible on https://www.eu-aimseu/fileadmin/websites/eu-aimseu/media/EU-AIMS_LEAP/EU-AIMS-LEAP_SOP_Study-Protocol.zip. The study was approved by national and local ethics review boards at each study site and is carried out to Good Clinical Practice (ICH GCP) standards. An overview of the recruitment and study procedures is given in Fig. 1

## Participant selection criteria

In the ASD group, inclusion criteria were an existing clinical diagnosis of ASD according to DSM-IV/ICD-10 or DSM-5 criteria. All psychiatric comorbidities (except for psychosis or bipolar disorder) are allowed as up to 70% of people with ASD have one or more co-occurring psychiatric conditions [19]. Similarly, we include participants on stable medication because 30–50% [20] children and adults with ASD in Europe and up to 70% in the USA are prescribed at least one medication for features, such as aggression, anxiety, hyperactivity, or sleep problems [21]. The intellectual disability (ID) group (defined by IQ between 50 and 74) comprises individuals with both idiopathic and syndromic forms of mild intellectual impairments.

## Clinical characterisation measures in ASD

In the ASD group, diagnosis is confirmed using the combined information of the Autism Diagnostic Interview-Revised (ADI-R [22]) and the Autism Diagnostic Observation Schedule 2 (ADOS-2). Cut-offs on the ADI-R/ADOS-2 are not used as exclusion criteria [23]. To assess dimensional symptom severity across ASD core domains, we used several parent-report instruments with relative emphasis on social-communication [24, 25], repetitive and restricted behaviours [26, 27], sensory processing anomalies [28, 29], and overall autism symptom severity [30, 31] (see Additional file 1). All scales had been validated for the targeted age ranges. In-house translations/back-translations were carried out for some scales. In adolescents and adults with average IQ, companion self-report versions are also included.

We assess a range of psychiatric disorders using the Development and Well-being Assessment (DAWBA, [32]). The most common comorbidities (attention-deficit/hyperactivity disorder (ADHD), depression, anxiety, sleep anomalies) are also assessed at the symptom level using parent and self-report questionnaires. Parental interviews on adaptive behaviour [33] and parent and/or self-report questionnaires on quality of life [34] provide additional outcome measures.
<table><caption>**Table 1** LEAP summary of study protocol, by schedule</caption><thead><tr><th rowspan="2">Level</th><th rowspan="2">IA/ OA</th><th rowspan="2">Domain/task</th><th rowspan="2">Time point</th><th colspan="4">Schedule<sup>a</sup></th></tr><tr><th>A</th><th>B</th><th>C</th><th>D</th></tr></thead><tbody><tr><td colspan="8"><strong>Clinical diagnosis</strong></td></tr><tr><td>Level 1</td><td>IA</td><td>Autism Diagnostic Interview-Revised (ADI-R)<sup>c</sup></td><td>Base</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td></tr><tr><td>Level 1</td><td>IA</td><td>Autism Diagnostic Observation Schedule (ADOS or ADOS-2)<sup>c</sup></td><td>Base &amp; FU</td><td>S<sup>b</sup></td><td>S<sup>b</sup></td><td>S<sup>b</sup></td><td>S<sup>b</sup></td></tr><tr><td colspan="8"><strong>Dimensional measures of ASD symptoms</strong></td></tr><tr><td>Level 2</td><td>OA</td><td>Social Responsiveness Scale-2nd Edition (SRS-II)<sup>c</sup></td><td>Base &amp; FU</td><td>S &amp; P<sup>b</sup></td><td>S &amp; P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Repetitive Behaviour Scale-Revised (RBS-R)<sup>c</sup></td><td>Base &amp; FU</td><td>p<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Short Sensory Profile (SSP)<sup>c</sup></td><td>Base &amp; FU</td><td>p<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Children's Social Behaviour Questionnaire (CSBQ)<sup>c</sup><br>Adults' Social Behaviour Questionnaire (ASBQ)<sup>c</sup></td><td>Base &amp; FU</td><td>-<br>S &amp; P<sup>b</sup></td><td>P<br>-</td><td>P<br>-</td><td>P<br>-</td></tr><tr><td>Level 2</td><td>OA</td><td>Autism Quotient (AQ), AQ-Adol, AQ-Child<sup>c</sup></td><td>Base &amp; FU</td><td>S &amp; P<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Aberrant Behaviour Checklist</td><td>FU</td><td>p<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Adult Routines Inventory (ARI) or<br>Childhood Routines Inventory-Revised (CRI-R)</td><td>FU</td><td>S<br>-</td><td>-<br>P</td><td>-<br>P</td><td>-<br>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Sensory Experiences Questionnaire—short version (SEQ 3.0)</td><td>FU</td><td>p<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Global Score of Change</td><td>FU</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td></tr><tr><td colspan="8"><strong>Comorbidities</strong></td></tr><tr><td>Level 2</td><td>OA</td><td>Development and Well-Being Assessment (DAWBA)<sup>c</sup></td><td>Base</td><td>S &amp; P<sup>b</sup></td><td>S &amp; P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Strengths and Difficulties Questionnaire (SDQ)<sup>c</sup></td><td>Base &amp; FU</td><td>S &amp; P<sup>b</sup></td><td>S &amp; P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>DSM-5 ADHD rating scale<sup>c</sup></td><td>Base &amp; FU</td><td>S &amp; P<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 3</td><td>OA</td><td>Beck Anxiety Inventory (BAI)</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>P</td><td>P</td></tr><tr><td>Level 3</td><td>OA</td><td>Beck Depression Inventory (BDI)</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>P</td><td>P</td></tr><tr><td colspan="8"><strong>Quality of life/adaptive behaviour</strong></td></tr><tr><td>Level 1</td><td>IA</td><td>Vineland Adaptive Behaviour Scale-2nd Ed (VABS-2)</td><td>Base &amp; FU</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Columbia Impairment Scale (CIS)<sup>c</sup></td><td>Base &amp; FU</td><td>S &amp; P<sup>b</sup></td><td>S &amp; P</td><td>P</td><td>P</td></tr><tr><td>OA</td><td></td><td>Child Health and Illness Profile (CHIP-CE) or<br>World Health Organisation Quality of Life (WHOQOL-BREF)</td><td>Base &amp; FU</td><td>-<br>S</td><td>P<br>-</td><td>P<br>-</td><td>P<br>-</td></tr><tr><td colspan="8"><strong>Medical or psychiatric history</strong></td></tr><tr><td>Level 1</td><td>OA</td><td>NIH ACE Subject Medical History Questionnaire<sup>c</sup></td><td>Base</td><td>S' or P<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>NIH ACE Family History Form</td><td>Base</td><td>S' or P<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Medical Psychiatric History Perinatal<br>Environmental Risk<br>Questionnaire<sup>c</sup></td><td>FU</td><td>p<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Brief Life Events Questionnaire, anchored<br>in pregnancy</td><td>FU</td><td>p<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td>Level 2</td><td>OA</td><td>Children's Sleep Habits Questionnaire or<br>Adult version (FU only)</td><td>Base &amp; FU</td><td>-<br>S</td><td>S &amp; P<br>-</td><td>P<br>-</td><td>P<br>-</td></tr><tr><td>Level 2</td><td>IA</td><td>Family Medical History Interview</td><td>FU</td><td>S' or P<sup>b</sup></td><td>P</td><td>P</td><td>P</td></tr><tr><td colspan="8"><strong>Cognitive and psychological profile</strong></td></tr><tr><td>Level 1</td><td>IA</td><td>WASI or WISC / WAIS (4 subtests)<sup>c</sup></td><td>Base</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 1</td><td>IA</td><td>WASI or WISC / WAIS (2 subtests)<sup>c</sup></td><td>FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 1</td><td>IA</td><td>BPVS and RCPM</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr></tbody></table>
<table><caption>**Table 1** LEAP summary of study protocol, by schedule (Continued)</caption><tbody><tr><td>Level 2</td><td>OA</td><td>HRS-MAT online adaptive IQ test</td><td>FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Probabilistic reversal learning<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Spatial working memory<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Un/Segmented block design task<sup>c</sup></td><td>Base</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Animated shapes narratives task<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>OA</td><td>Empathy Quotient</td><td>Base &amp; FU</td><td>S</td><td>P</td><td>-</td><td>-</td></tr><tr><td>Level 3</td><td>OA</td><td>Systemising Quotient</td><td>Base &amp; FU</td><td>S</td><td>P</td><td>-</td><td>-</td></tr><tr><td>Level 3</td><td>OA</td><td>Child EQ-SQ</td><td>Base &amp; FU</td><td>-</td><td>-</td><td>P</td><td>-</td></tr><tr><td>Level 3</td><td>OA</td><td>Toronto Alexithymia Scale (TAS)</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>P</td><td>P</td></tr><tr><td>Level 3</td><td>IA</td><td>Reading the Mind in the Eyes task (RMET)</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Karolinska Directed Emotional Faces (KDEF)</td><td>FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Sandbox continuous false belief task</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td colspan="8">Cognitive tests assessed as part of the eye-tracking battery:</td></tr><tr><td>Level 3</td><td>IA</td><td>Event memory task</td><td>FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Emotion matching task</td><td>Base</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Films expression task</td><td>FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Visual processing task</td><td>FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Change detection task</td><td>Base or FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td colspan="8">Eye-tracking</td></tr><tr><td>Level 2</td><td>IA</td><td>Natural scenes: static and dynamic<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Gap overlap<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Implicit false belief<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Pupillary light reflex<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 3</td><td>IA</td><td>Biological motion</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td colspan="8">Neuroimaging</td></tr><tr><td>Level 1</td><td>IA</td><td>Structural MRI<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 1</td><td>IA</td><td>FLAIR sequence or localiser sequence MRI<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Diffusion tensor imaging (DTI)<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Resting-state fMRI<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Social/non-social reward fMRI<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Animated shapes theory of mind fMRI<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>-</td></tr><tr><td>Level 2</td><td>IA</td><td>Flanker Go/No-Go task<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>-</td><td>-</td></tr><tr><td>Level 3</td><td>IA</td><td>Hariri emotion processing fMRI</td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>-</td></tr><tr><td colspan="8">EEG</td></tr><tr><td>Level 2</td><td>IA</td><td>Resting state<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Auditory oddball task<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Upright-inverted Faces (gamma)<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Social / non-social videos<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td colspan="8">Biological samples</td></tr><tr><td>Level 2</td><td>IA</td><td>Blood sample (for genomic analyses)<sup>c</sup></td><td>Base or FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Saliva (for genomic analyses where blood samples cannot be obtained and for epigenetics)<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr></tbody></table>
<table><caption>**Table 1** LEAP summary of study protocol, by schedule (Continued)</caption><tbody><tr><td>Level 2</td><td>IA</td><td>Urine (at home, for biochemical biomarkers)<sup>c</sup></td><td>Base or FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Hair roots (to generate iPSCs)<sup>c</sup></td><td>Base or FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td>Level 2</td><td>IA</td><td>Head circumference<sup>c</sup>, weight<sup>c</sup>, height<sup>c</sup></td><td>Base &amp; FU</td><td>S</td><td>S</td><td>S</td><td>S</td></tr><tr><td colspan="8">Assessment of clinical symptoms and cognition in both biological parents</td></tr><tr><td>Level 3</td><td>OA</td><td>Social Responsiveness Scale (SRS-2)</td><td>Base</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td></tr><tr><td>Level 3</td><td>OA</td><td>DSM-5 ADHD rating scale</td><td>Base</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td></tr><tr><td>Level 3</td><td>OA</td><td>Beck Anxiety Inventory (BAI)</td><td>Base</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td></tr><tr><td>Level 3</td><td>OA</td><td>Beck Depression Inventory (BDI)</td><td>Base</td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td><td>p<sup>b</sup></td></tr><tr><td>Level 3</td><td>OA</td><td>Adult Routines Inventory (ARI)</td><td>FU</td><td>p<sup>b</sup></td><td>p</td><td>p</td><td>p</td></tr><tr><td>Level 2</td><td>OA</td><td>HRS-MAT online adaptive IQ test</td><td>FU</td><td>p<sup>b</sup></td><td>p</td><td>p</td><td>p</td></tr></tbody></table>

Level 1 measures are defined as the minimal data set that must be acquired for any one participant to be included in the 'head count'. Level 2 measures are (a) central to primary and/or secondary study objectives, (b) suitable for the entire targeted participant age and ability range, and (c) have previously shown ASD case-control differences or have been validated in ASD group(s). Level 3 measures are measures that are either (a) more exploratory (e.g. related to novel/emerging hypotheses), (b) less central to the primary or secondary study objectives, and/or (c) only suitable for some schedules. Within each assessment module, in the order of assessments, level 1 and level 2 assessments should be administered before level 3 assessments. Level 3 measures are omitted first in the event of, e.g. participant fatigue or if assessments take considerably longer than average

ADHD attention-deficit hyperactivity disorder, ASD autism spectrum disorder, Base baseline assessment wave, DSM Diagnostic and Statistical Manual of Mental Disorders, fMRI functional magnetic resonance imaging, FU follow-up assessment wave, IA investigator administered assessment at the institute, iPSCs induced pluripotent stem cells, NIH ACE US National Institutes of Health Autism Centers of Excellence, OA online assessment, P reported by parent, S self-reported, S' self-reported in the TD adult group in which parents are not enrolled in the study, sMRI structural magnetic resonance imaging, TD typical development

<sup>a</sup>Schedule A: adults with ASD or TD (aged 18–30 years, with IQ greater than 70); schedule B: adolescents with ASD or TD (aged 12–17 years, with IQ greater than 75); schedule C: children with ASD or TD (aged 6–11 years, with IQ greater than 75); schedule D: adolescents and adults with mild ID (with or without ASD) (aged 12–30 years, with IQ 50–74); schedule E: monozygotic or dizygotic twins (schedule E is not shown but is based on schedules A–C)

<sup>b</sup>ASD groups only

<sup>c</sup>Core measures that were submitted to the European Medicines Agency for QA

## Biomarker methodologies

Core measures were selected to be suitable across all age and ability levels to determine whether biomarkers are present only at distinct ages or change with age. We chose measures on which individuals with ASD were previously reported to differ from controls on average and that test several of the most influential neurocognitive (see Table 1) and neurobiological hypotheses of ASD (e.g. differences in brain connectivity [35], excitatory-inhibitory balance [36]). Measures that provide comparable read-outs in animal models and humans were prioritised so that findings can be translated to drug discovery. Some of these measures were taken from the high-risk infant sibling study EUROSIBS (www.euroeibs.eu) allowing us to establish whether some cognitive or neurobiological markers identified in this study also confer risk for developing ASD.

**Neurocognitive and behavioural markers** Neurocognitive measures included in this study span a wide range of social, motivational, affective, and cognitive domains previously linked to ASD.

*Theory of mind (ToM)* [37] (also called mentalising or mindreading) refers to the ability to represent mental states, such as beliefs, desires, and intentions to predict and explain (others' and own) behaviour. ToM deficits have been widely regarded as core social-cognitive deficits in ASD and have been hypothesised to underlie, or contribute to, a range of social-communicative impairments.

However, severity of impairments has been shown to depend on age and ability level. A useful distinction has been made between explicit (i.e. verbally or cognitively mediated) [38] and implicit or spontaneous ToM [39, 40]. Many high-functioning adolescents and adults with ASD acquire some degree of explicit ToM, whereas abnormalities may primarily consist of persistent deficits in the (typically developmentally earlier emerging) *implicit* theory of mind usage. Therefore, we compare for each participant abnormalities in explicit vs. implicit/spontaneous ToM at the behavioural and (using fMRI) neurofunctional levels because atypical brain processes can persist despite apparently 'intact' behaviour.

*Emotion recognition* refers to the ability to infer other people's emotions from their facial expressions and is therefore critical for many aspects of social-communication. We assess the ability to recognise a range of simple and complex facial expressions in behavioural tests [41] and using eye-tracking [42] and examine neural responses during the processing of facial expressions using fMRI [43].

Another influential theory has proposed that diminished *social motivation* may represent a primary deficit in ASD [44] and is often operationalized as diminished spontaneous attention to social (vs. non-social) information when observing (naturalistic) images or social situations, using eye-tracking. Social motivation deficits may in turn be rooted in diminished social reward sensitivity [45], i.e. the reward value of faces and other social information.
<figure><img src="image_3.png" /></figure>

**Fig. 1** LEAP recruitment and assessment procedures. **a** Participants are concurrently recruited and assessed at seven European study sites: the Institute of Psychiatry, Psychology and Neuroscience, King's College London, United Kingdom Autism Research Centre at the University of Cambridge, United Kingdom, Radboud University Nijmegen Medical Centre, University Medical Centre Utrecht, the Netherlands, Central Institute of Mental Health, Mannheim, Germany, and the University Campus Bio-Medico, Rome, Italy. Twins are predominantly recruited from the Roots of Autism and ADHD Twin Study in Sweden (RATSS) at Karolinska Institute, Stockholm, Sweden [17]. At each study site, participants with ASD and mild ID are recruited from existing local databases, clinic contacts, and local and national support groups. TD participants are recruited via mainstream schools, flyers (e.g. left at youth centres, colleges, churches, etc.), and existing databases. Participants (or parents) who express interest are sent an information sheet and then screened over the phone for eligibility. If inclusion criteria are confirmed, written consent is obtained and the participant is assigned to a study schedule based on their age and ability level. **b** Parents (as well as adolescents and adults without ID) are sent login details to an online questionnaire (Delosis Ltd., London) to complete at home. **c** and **d** The participant and a parent visit the study centre on two separate occasions within 4 weeks. For participants who travel from far, visits take place on two consecutive days with an overnight stay at a local hotel arranged by the research team. Clinical assessments and interviews are conducted with the participant (e.g. ADOS-2) and a parent (ADI-R, Vineland, Family History Interview). If parents stay with their child during his/her assessments, these interviews are later conducted over the phone. Most cognitive tests are administered using the computerised platform Psytools (Delosis, London Ltd.); some are paper-pencil tests. Eye-tracking is acquired using Tobii-Eye-trackers with a standard acquisition rate of 120 Hz. Tasks are presented interleaved to minimise attentional requirements. Each participant completes a 60–90-min MRI scan session to acquire structural and DTI scans, a resting-state functional MRI scan, and (depending on schedule) one to four task-related fMRI scans. During a training session before the scan, they are instructed to keep still, familiarised with the scanner noise, trained in the functional tasks, and, where possible, are given the opportunity to lie in a mock scanner. During the structural scans, participants watch videos from a video library or DVD brought from home, to make the scan experience more enjoyable. The EEG session tests functional activation during face processing, social and non-social processing, an auditory oddball paradigm (MMN), and resting state. Blood, urine, and saliva samples are taken from the participant and, where possible, both parents for biochemical and genomic analyses. Hair samples are taken to derive induced pluripotent stem cells from selected participants
*Executive functions (EF)* is an umbrella term for a set of cognitive processes that rely on prefrontal regions and that include attentional control, inhibitory control, working memory, cognitive flexibility, reasoning, problem solving, and planning. Originally, EF deficits, perhaps notably impairments in cognitive flexibility, were hypothesised to underlie repetitive and restricted behaviours [46, 47]. Whereas evidence for the role of EF in RRBIs is mixed, EF deficits may contribute to both social and non-social ASD symptoms, possibly, by interacting—developmentally or online—with other cognitive systems. Intact EF skills in some individuals may serve as a compensatory mechanism [48] that scaffolds adaptive behaviour [49]. We assess spatial working memory [50] and probabilistic reversal learning [51] using computerised tests and inhibitory control while fMRI blood-oxygen-level dependent (BOLD) responses are recorded.

*Weak central coherence (WCC)* [52] describes a local, detail-focused information processing style, paired with difficulties in global processing, processing information for meaning and in integrating information in context. WCC is thought to pervade different areas of perception and cognition. This account explicitly aims to address lets of talent (in absolute or relative terms) and spared skills. We include the un/segmented block design task as an index of WCC.

*Systemizing* [53] describes a cognitive style characterised by the motivation to predict lawful events (using if-then rules) and observations of input-operation-output relationships and includes good attention to detail. Systemizing is thought to represent a continuum where, on average, males exceed females, and individuals with ASD (both males and females) are shifted to the extreme end of aptitude. It also aims to address relative and absolute strengths in ASD. We assess systemizing using age-appropriage versions of the Systemizing Quotient [54].

*Top-down processing* refers to the fundamental cognitive principle that we use our past experiences and prior knowledge to make sense of the present and predict the future. Top-down processing anomalies have been linked to superior perceptual skills and a more ‘accurate’ or veridical memory in ASD [55].

*Predictive coding* [56, 57] assumes that the brain constantly matches incoming (external) stimuli against a set of (internal) expectations of what will likely happen. Abnormalities in predictive coding may potentially implicated in several facets of repetitive behaviours, sensory processing anomalies, talents as well as social cognitive abilities [58]. Top-down processing is assessed using eye-tracking change detection and event memory tasks; predictability using by studying mismatch negativity derived from an auditory oddball task (using EEG).

Together, this aims to create a comprehensive profile of each participant's strengths and weaknesses across cognitive domains. Such a cross-domain profile (or composite markers) may potentially be better in predicting symptom severity or functional outcome than the severity of deficits/differences in one single domain. For core domains (e.g. theory of mind), we use convergent methodologies (e.g. behavioural testing, eye-tracking, and fMRI) in the same participant, to identify atypical processes and compensatory mechanisms.

**Eye-tracking in ASD** Eye-tracking measures can be easily acquired in children and adults with ASD as they are non-invasive and do not require motor responses or language skills. Visual fixation patterns and saccadic control provide a quantitative index of several attentional, perceptual, or social cognitive abnormalities that may be both more specific to particular clinically related features than are questionnaire scores (which typically comprise a composite of several behavioural abnormalities) and more proximal to neurobiological abnormalities. For example, we assess the pupillary light reflex, which largely depends on cholinergic synaptic transmission [59]. We also measure spontaneous visual attention to social and non-social aspects of static and dynamic naturalistic scenes (movie clips). Previous studies found diminished spontaneous attention to the eyes in a high proportion of individuals with ASD from around one year of age through to adults [60, 61]. This behavioural marker of social impairment has been linked to either reduced social reward sensitivity or increased (social) anxiety, which may in turn be mediated by the neuropeptides oxytocin [62] and vasopressin [63], or serotonin [64]. Therefore, changes in visual fixation patterns or saccadic control following a treatment may indicate an initial benefit that presages longer term symptom reduction or behavioural/adaptive changes. It may also provide indications of the neurocognitive mechanisms through which improvements occur.

## Markers of brain structure, function, and connectivity

We use magnetic resonance imaging (MRI) and electroencephalography (EEG) to study differences in brain structure [65], function, and connectivity [35, 66]. These methods are critical to delineating ASD subgroups based on systems-level abnormalities and provide the basis for identifying the mechanisms through which (future) treatments may produce improvements in functioning.

**MRI and DTI** Across sites, MRI scans are acquired on 3T scanners from different manufacturers (Siemens, Philips, General Electric). We carried out several procedures to optimise structural and functional sequences for the best manufacturer-specific options and to address challenges related to standardisation and quality
assurance of multi-site image-acquisition (e.g. use of phantoms, travelling heads).

Measures of total grey and white matter volume provide global descriptors of brain anatomy. Previous neuroimaging studies showed abnormalities in brain development in ASD, with enlarged brain volumes over the first years of life that plateaued across school age and were followed by a more rapid decline from adolescence [65]. This indicates that differences in total brain volume may only reflect risk for ASD at certain developmental stages rather than being causal for the condition. Abnormalities have also been reported in regional brain volumes of children and adults with ASD, including the frontal and temporal cortices, amygdala, hippocampus, caudate nucleus, and cerebellum [67]. These regions support several cognitive, motivational, and emotional functions that are affected in some people with ASD (Table 2). In addition to total and regional brain volumes, we also investigate differences in cortical thickness and cortical surface area, as these anatomical indices have distinct genetic determinants [68], phylogeny, and developmental trajectories [69].

Structural connectivity reflects physical connections between neurons. Its strength depends on the number and efficacy of synapses and in turn affects functional connectivity. We derive indices of structural connectivity both from structural MRI scans and diffusion tensor imaging (DTI). For example, intrinsic grey matter connectivity can be estimated by examining differences in local and global wiring costs [70] and differences in short and long-range white matter tracts using tractography analysis of specific pathways [71].

**Task-related functional MRI** Four functional MRI paradigms assess neural activation in networks implicated in social and non-social reward processing using an incentive delay task that measures brain reactivity when anticipating a social reward (a woman's smile) or a monetary reward [72], theory of mind, using an adapted version of the animated shapes task [73], inhibitory control/ conflict monitoring using a Flanker/Go-NoGo task [74], and emotional reactivity to fearful faces [43]. Their known or putative underlying brain networks and implicated neurotransmitter systems are described in Table 2.

The paradigms have been adapted such that each task can be acquired within 5–10 min, as it is challenging for young children and some individuals with ASD (and especially ID) to remain still in the scanner for longer periods of time.

Good test-retest reliability of the fMRI battery was demonstrated in typically developing adults [75, 76]. A pilot study confirmed the feasibility of the tasks for use in children and individuals with ASD. We will use region-of-interest analyses of known areas comprising a particular network (Table 2) as well as exploratory whole-brain analyses in order to investigate potential abnormalities in both activation and functional connectivity within and across tasks.

**Resting-state fMRI** We use a multi-echo EPI sequence for resting-state fMRI data acquisition. Data are processed using multi-echo independent component analysis and TE-dependent analysis to identify and remove non-neural noise, such as motion artefacts, from the BOLD-signal [77]. This enhances the temporal signal-to-noise

<table><caption>**Table 2** Neurocognitive domains, underlying brain networks, and neurotransmitter systems</caption><thead><tr><th>Cognitive domains</th><th>Brain network</th><th>Neurotransmitter</th></tr></thead><tbody><tr><td>Theory of mind</td><td>Mentalising network [76, 78]; dorsal medial prefrontal cortex, ventro-medial prefrontal cortex, R/L temporal-parietal junction, posterior superior temporal sulcus posterior cingulate cortex/precuneus, R/L anterior temporal lobe, L temporal pole, cerebellar regions</td><td>ND</td></tr><tr><td>Emotion recognition/emotional reactivity</td><td>The corticolimbic circuit; amygdala, medial prefrontal cortex, lateral prefrontal cortex</td><td>5-HT, DA, OT, endocannabinoids</td></tr><tr><td>Social motivation/social reward sensitivity</td><td>Brain reward network: ventral striatum/nucleus accumbens [114], ventral medial prefrontal cortex, orbitofrontal cortex, midbrain; social reward processing further relies on connections to modality specific social information, e.g. right fusiform gyrus implicated in processing faces</td><td>OT/AVP, DA</td></tr><tr><td>Executive function</td><td>Cognitive control network: prefrontal cortex, anterior cingulate cortex, anterior insula, striatum, posterior parietal cortex<br>Working memory: dorsolateral prefrontal (DLPFC), posterior cingulate and parietal cortices</td><td>GABA, MAOA</td></tr><tr><td>Weak central coherence</td><td>Neurobiological underpinnings are not yet fully understood. R DLPFC, parietal cortex, R ventral occipital cortex (vOcc) [115]; broadly consistent with long-range under-connectivity and short-range over-connectivity</td><td>ND</td></tr><tr><td>Systemizing</td><td>Not tested</td><td></td></tr><tr><td>Top-down processing/predictive coding</td><td>Predictive coding in perception/cognition assumes a hierarchical processing stream and the interplay between feed-forward (bottom-up) and backward (top-down) connections. In a related model predominantly bottom-up-directed gamma-band oscillations are controlled by predominantly top-down-directed alpha-beta-band influences. Not directly tested in ASD.</td><td>DA, Ach, NMDA signalling</td></tr></tbody></table>

Act acetylcholine, AVP arginine vasopressin, DA dopamine, GABA gamma-aminobutyric acid, MAOA monoamine oxidase, NMDA N-methyl-D-aspartate, ND not determined, OT oxytocin, 5-HT 5-hydroxytryptamine, serotoni
ratio in seed connectivity analyses and may increase ef-
fect size estimation and statistical power [78]. As
motion-related noise can produce spurious correlations
throughout the brain [79], this is particularly relevant
for connectivity analyses in children and clinical popula-
tions who may systematically move more in the scanner
than typically developing adults. Multiple functional net-
works have been identified that are characterised by co-
herent patterns of intrinsic activity between ‘nodes’ that
resemble patterns of activity that are engaged during
particular cognitive functions. This includes the ‘default
mode network’ and networks implicated in dorsal atten-
tion, fronto-parietal control, and motor functions [80].
We aim to identify subgroups with hyper- and hypo-
connectivity within and across these networks [81, 82]
and examine whether they differ in symptom presenta-
tions and/or aetiology.

**Electroencephalography (EEG)** EEG is a promising biomarker modality with potential clinical utility because of its suitability across broad age and ability ranges, relative low cost, ease of administration, and widespread availability [83, 84]. Its high temporal resolution complements better spatial resolution offered by fMRI. Our EEG methods follow the recent guidelines of recording, analysis, and interpretation of EEG data in autism research [85]. MRI data from the same participants can be used to derive personalised anatomical priors for cortical source reconstruction approaches. We derive two complementary indices: First, using event-related potential (ERP) and event-related oscillation (ERO) paradigms, we study differences in ERP components and EROs that contribute to different sets of neurocognitive processes, such as face processing (P1, N170 components), preattentive change detection (mismatch negativity, MMN), or novelty detection (P3a). Second, we use frequency-based analyses to investigate differences in functional activity, variability, and connectivity across all frequency bands (sub-delta to gamma) during resting-state recordings and while passively viewing social and non-social videos. For example, the neurochemical basis of neural firing in the gamma band range depends on interactions between excitatory and inhibitory neurotransmitter concentrations and may therefore serve as a proxy measure of E/I imbalances [86]. Functional connectivity analyses examine differences in short- and long-range synchronisation within and between brain networks and complement connectivity analyses from resting-state fMRI.

Biochemical biomarkers

Alterations in the immune system, mitochondrial func-
tion, oxidative stress pathways, and several neurotrans-
mitter systems have previously been reported in ASD
[87]. For example, increased serotonin blood levels are

the most consistently replicated biochemical abnormality
found in ASD [88] with approximately 27% of individ-
uals showing significant elevations [89]. As 5-HT eleva-
tions appear to be more prevalent in pre- than in post-
pubertal ASD samples [90], we will determine the utility
of blood serotonin as a biomarker from childhood to
adulthood.

Genetic markers

We acquire blood samples from the participant, and—
where possible—both biological parents, for genomic ana-
lyses. First, in collaboration with the Autism Speaks
MSSNG project (https://www.mss.ng), we carry out
whole-genome sequencing of multiplex (families with two
or more individuals with ASD) and simplex families
(where only one person has ASD) to assess the combin-
ation of inherited and de novo genetic variation (rare and
common variants, coding and non-coding variants) that
may confer risk for ASD or specific traits linked to ASD.
Second, we aim to identify pathways associated with ASD
and assign each individual to particular molecular path-
ways based on their entire mutation profile. In addition,
data will be pooled with other international initiatives, to
improve the ability to identify new ASD-risk genes.

Environmental risk factors

Despite the high heritability of ASD, recent findings in-
dicate that environmental risk factors, notably those act-
ing pre- and perinatally [91, 92], might play a larger role
than previously assumed (e.g. maternal immune activa-
tion [93], prenatal steroid exposure [94], and gestational
diabetes [95]). Therefore, we gather retrospective infor-
mation on perinatal factors, including any maternal ill-
ness/infection, medication, alcohol/drug use, stressful
life events, complications during pregnancy/delivery, as
well as potentially protective factors, such as the use of
vitamins/nutrients.

Parent-phenotyping and family psychiatric history

In both biological parents, we administer dimensional
measures of the ASD phenotype and assess personality
traits linked to ASD (empathising/systematising), com-
monly co-occurring psychiatric conditions, and IQ.

Using a semi-structured interview, we also obtain
comprehensive information on the psychiatric history of
first- and second-degree relatives. This addresses the fact
that many ASD-risk genes also confer familial vulner-
ability for a range of other neurodevelopmental/neuro-
psychiatric disorders and subclinical traits [96].

Hair samples

We collect hair roots from participants and first-degree rel-
atives. They are subsequently frozen to generate induced
pluripotent stem cells (iPSCs) from selected donors with a
particular genomic and/or phenotypic profile. These cell lines help to identify convergent and divergent morphological, cellular, and molecular mechanisms underpinning ASD (subgroups) and for drug screening [97].

## Central database/data access

The central database comprises three layers: First, raw data from all recruitment centres (and the on-line questionnaire platform) are uploaded onto the central database using a secured web-interface. Second, for neuroimaging pre-processing and quality control procedures, analysis teams access the raw data via sftp, carry out the necessary analyses locally, and upload quality controlled (QC)/pre-processed data. The final data set is ‘read-only’. A web-based interface enables users to access the database using personalized login details to search, filter, and download data. The EU-AIMS database is currently accessible for internal users but will subsequently be opened to the wider scientific community.

## Statistical analysis plan

Table 3 outlines the governance structure of EU-AIMS LEAP and describes steps undertaken to increase transparency, standardisation, and reproducibility.

We are using two complementary approaches to identify stratification biomarkers for ASD subtypes. Power calculations are provided in Additional file 2.

## Stratification by participant characterisation criteria

For each measure, we will first test for overall case-control differences and then stratify the sample by age, IQ, sex, and the presence of comorbidities. To investigate age effects in, for example, brain anatomy, resting-state connectivity, or cognitive skills, we first create ‘cross-sectional developmental trajectories’ or ‘growth charts’ for the typically developing (TD) group that test for linear and nonlinear (e.g. quadratic) developmental patterns and determine the typical variability at a particular age [98]. Then, we use confidence intervals around the TD trajectory to assess for each individual with ASD whether, and by how far, he or she falls outside the range of performance expected for their age group. This will help determine whether the abnormality is only detected at a certain developmental stage, or in a subgroup of individuals with ASD across ages. We will also compare several trajectories simultaneously using mixed design linear regression models [98] to establish whether in the ASD group, performance develops with delay or is uneven across domains or component processes. Cross-sectional age-related patterns will be compared to longitudinal (within person) trajectories once follow-up data are available.

Sex differences have previously been reported both in typical development and ASD groups at multiple levels, including serum biomarkers, brain structure and function,

<caption>**Table 3** Governance structure of LEAP, pre-registration, quality control, and reporting of findings</caption>

Data analysis is split into expert core analysis groups, broadly defined by data modality (e.g. clinical measures, cognition, EEG, structural MRI, functional MRI, etc.). Each group leads core analyses and coordinates modality-relevant exploratory bottom-up projects. Core analysis groups are closely linked to each other and to ‘cross-cutting’ interest groups (e.g. sex differences, excitatory-inhibitory balance, etc.).

**Registration of projects:** All individual projects (whether they are part of core-analyses or bottom-up projects) are pre-registered on an internal website and shared among the group. Project information includes lead and senior investigators, active collaborators, primary and secondary project goals, and outlines core measures and methodologies. Individual login details to the central EU-AIMS data-base is given upon project review and approval.

**Quality control, standardisation of definitions and analyses:** To maximise coherence and comparability between projects, expert groups lead on modality-specific quality control procedures, which are documented and shared. Where applicable, processing and analysis scripts are also shared to increase transparency and enable replication. Expert groups provide study-wide recommendations, including, for example, a core set of clinical outcome measures, the use of specific covariates, particular analysis approaches pertaining to a given data modality, procedures to correct for multiple-comparisons (e.g. permutations), a priori decisions as to whether/when the data set should be split into a test/replication sample (depending on whether exact or approximate external validation data sets are available). For example, for cognitive analyses, IQ is not recommended to be entered as co-variate, as in the present cohort IQ is partially collinear with group status [116]. For all but machine learning approaches, the data set is not split into test/replication (e.g. 70:30%) data sets, as for cross-domain or cross-modal analyses data loss due to missing values is expected, the number and size of empirically derived subgroups are a priori unknown, and therefore the replication data set likely has limited power in replicating findings. In these instances, internal cross-validation strategies (e.g. bootstrapping) should be used. For neuroimaging analyses, core analysis groups carry out centralised pre-processing using a homogeneous automated motion detection algorithm and several quality control procedures, based on consensus agreement on specific parameters, as well as first level values, e.g. of cortical thickness/surface area. For second-level neuroimaging analyses, parametric and non-parametric permutation-based inference methods will be applied depending on the distribution properties of the data. While parametric analyses offer the advantage of efficiency and reproducibility if the underlying distribution assumptions are met, non-parametric approaches offer greater robustness when normality assumptions are violated. These efforts are aimed at increasing consistency between individual projects/analyses, reducing duplication of efforts, and to allow LEAP researchers to benefit from each other’s expertise. In addition, we aim to create a culture that discourages practices such as ‘undisclosed analytic flexibility’, i.e. one uses multiple approaches for one analysis question but only reports the ‘best’ results (‘fishing, *p* value hunting’). However, to strike a balance between standardisation and supporting novel/different approaches, all LEAP researchers can access raw data, use different pre-processing methods or outcome measures, as long as these choices are a priori justified in a project proposal and/or the number of analyses performed are reported and appropriately corrected for.

**Standardised framework for reporting and evaluating biomarkers:** Each project gives summary statistics about effect size, frequency and severity of abnormalities, sensitivity, specificity and—where applicable—cut-offs for dimensional stratification biomarkers. These criteria were identified as a priority for the validation of biomarkers by the European Medicines Agency and follow efforts made to increase consistency in reporting and evaluating case-control studies (see STROBE, http://strobe-statement.org/index.php?id=available-checklists) and clinical trials (see CONsolidation of Standards for Reporting Trials, CONSORT [117]).
<caption>**Table 3** Governance structure of LEAP, pre-registration, quality control, and reporting of findings (Continued)</caption>

Increased transparency of analyses and findings by depositing a summary of results: EU-AIMS researchers will deposit for each registered project a summary of results upon completion. The aim is to increase transparency of findings from planned analyses, including 'negative results', which are both less frequently written-up for publication and currently more difficult to publish in peer-reviewed journals than positive results [112].

several aspects of cognition, and clinical symptom presentation [16]. Likewise, IQ or psychiatric comorbidities may significantly impact on brain and cognitive profile. Hence, we will test diagnosis-by-sex models to identify potentially sex-specific biomarkers and explore whether neurocognitive or neurobiological abnormalities vary with IQ or the presence of psychiatric comorbidities, using both dimensional and categorical approaches. We will also consider potentially mediating (e.g. sleep problems) or moderating factors, such as handedness (lateralisation), medication, and the narrow vs. broader ASD spectrum (ADI-R/ADOS-2 cut-offs).

Progress has also been made in developing machine learning techniques for neuroimaging data in order to make clinically relevant predictions [99, 100]. Previous proof-of-concept data show that multivariate pattern classification approaches using structural MRI data discriminated individuals with ASD from healthy controls and non-autistic neurodevelopmental disorders with 90% accuracy [101]. We will apply multivariate approaches to see whether they can discriminate a priori defined subtypes (sex, comorbidities).

To test the potential value of each candidate marker as a 'surrogate end-point', we will use correlation and regression analyses to establish whether it relates to or predicts symptom severity (overall, or in a particular domain) or level of adaptive behaviour [102]. For each measure, we will report *p* values adjusted for the number of these core analyses, as well as nominally significant *p* values (to enable comparison with previous studies), effect sizes, and descriptive information on frequency and severity of deficits. For quantitative stratification markers to be of clinical utility, it will be essential to delineate reference values and cut-offs to aid the interpretation of individual scores.

## Stratification by unsupervised, data-driven approaches

The second approach uses data-driven multivariate analysis techniques to identify subgroups based on the pattern of the data itself.

For example, cluster analyses are a widely used set of techniques to divide data into prototypical groups based on only the data points and their relationships to one another. Input variables could be multiple cognitive [103], eye-tracking indices [104], EEG values, or a combination of values from different data types. The optimal

number of (meaningful) clusters can be determined based on height differences in a cluster tree, while cluster robustness will be evaluated using cross-validation techniques, such as bootstrapping.

Normative modelling approaches have also recently been extended to model biological variation across the entire study sample or a typical population [105]. Gaussian process regression is used to predict a set of biological responses (e.g. structural indoor connectivity indices) from a set of clinically relevant covariates (e.g. quantitative cognitive or symptom scores), while estimating predictive confidence for every prediction. This approach enables identification of individuals who are outliers within this distribution and to quantify the degree of deviation in relation to specific symptom domains.

Functional data analysis (FDA) takes advantage of trial level data, using curves or trajectories as observational units (for example, eye-tracking gaze paths over time, individual ERP waveforms over the course of the experiment), rather than signals averaged across trials. One recent EEG study reported increased variability of task-related activity in ASD [106]. By combining this approach with a robust multi-level clustering method, recent findings showed distinct learning patterns in particular ASD subgroups [107].

We will also apply recently developed unsupervised techniques to identify meaningful subtypes from the structural and functional neuroimaging data [100]. Further extensions of these methods enable combining different data types (e.g. connectivity indices derived from DTI and resting-state EEG and fMRI) [108], which may further increase specificity/sensitivity of classifiers. Mandatory for these approaches is splitting the data into training and test data sets to avoid 'overfitting' and to establish how well the classifiers can predict to which subgroup a new individual belongs.

Molecular biomarkers are potentially of particularly high value to predict treatment response. We will use novel network-based stratification approaches similar to those that have recently been validated in cancer research to identify tumour subtypes that are predictive of patient survival or response to therapy [109]. This method integrates genomic information from each individual with functional gene networks (e.g. protein-protein interaction), leveraging prior knowledge to stratify patients in subgroups with specific molecular profiles. We then aim to map those molecular subgroups to biological pathways, structural and functional biomarkers, and clinical symptom profiles.

## Longitudinal follow-up

To test the value of candidate stratification markers in predicting symptom progression, we will initially track the relationship between changes in the neurobiological/
cognitive measure and clinical or behaviour indices at 12–24 months follow-up. In addition, we are seeking additional funding for a third assessment wave to construct for each individual developmental trajectories at multiple levels. This will enable us to ascertain whether subgroups whose (social-communicative, RRBI) symptoms improve, remain the same, or worsen over development [110] differ in terms of their neurobiological/ cognitive profile at a given time or the rate of changes (e.g. arrested, uneven across component processes) across particular developmental stages.

## Twin data

Twin data are analysed by applying a statistical framework of multiply adjusted (conditional) linear regressions based on generalised estimations equations (GEE) and allowing both categorical and dimensional ASD outcomes. In addition to the GEE model, an additive genetics, common environment, and unique environmental (ACE) model will be computed to determine heritability estimates. For all analyses, probability estimates for different twin groups will be included, based on the population-based twin cohorts, which allows generalizability of the results.

## Biomarker validation

We will adopt biomarker validation criteria and steps similar to those employed in other biomedical fields, such as oncology, where biomarkers are ‘fit for purpose’, i.e. used in clinical practice [111]. Key criteria against which candidate stratification biomarkers will be validated are performance characteristics (accuracy and reliability) of the measure, reliability in relating to a particular clinical endpoint/clinical symptoms, and its prognostic and/or predictive value. For stratification markers of a priori defined subgroups (e.g. sex, comorbidity), accuracy (i.e. sensitivity and specificity, positive and negative predictive value) can be established using receiver operating characteristic (ROC) curves. For subgroups derived from data-driven, unsupervised approaches, external validation is essential as these groups do not necessarily differ in terms of their clinical profile. They may be validated by demonstrating their biological plausibility (i.e. that they have different genetic causes or molecular mechanisms) or functional value (that they differ in terms of their developmental trajectory or respond differentially to a given treatment). The latter cannot be tested in observational studies. Instead, the marker will need to be included in the design of treatment studies or clinical trials in order to compare responders and non-responders in terms of their biomarker characteristics [112]. To ascertain reproducibility, replication in independent samples is essential. For this purpose, we are sharing our protocols and SOPs with other interested international research groups with whom we also have formal data-sharing agreements. They

currently include the Australian Cooperative Research Centres (CRC), the French Fondation FondaMental, the Chinese Key 973 program, the Foundation for the National Institutes of Health (FNIH) Autism Biomarker Consortium, and the Province of Ontario Neurodevelopmental Disorders (POND) network. To investigate whether any of these stratification markers are specific to ASD we have aligned several measures with parallel European networks focused on ADHD, obsessive-compulsive disorder, and conduct disorder (MATRICS, TACTICS, NeuroIMAGE [113]).

## Results

### Demographic information of the baseline cohort and assessment rates

Recruitment and assessment of the baseline case-control cohort was carried out between January 2014 (first subject first visit, FSFV) and August 2016, except for schedule D, where recruitment and assessment are ongoing. Follow-up assessments began in September 2015, and all assessments (including schedule D baseline visits) are scheduled to be completed by August 2017. As per protocol, the twins at KI (schedule E) are only seen at one time point. Also, adults at UCBM are only seen at one time point. At the time of writing (08 April 2017), 448 participants have completed their follow-up assessments. Across study sites, retention rates range between 80.3 and 96.2%. (KCL 96.2%, RUNMC 84.7%, UMCU 86.8%, UCAM 87.8%, CIMH 80.3%).

### Cohort characteristics

Tables 4 and 5 give an overview of the baseline sample composition. The ASD and TD groups do not differ in terms of their sex composition overall or by schedule. However, the TD group has on average significantly higher verbal, performance and full-scale IQs than the ASD group (see Charman et al., under review). This was primarily driven by fewer TD individuals with IQs in the lower average range (i.e. 75–90). Age and IQ were not correlated in either group.

### Data acquisition rates

For MRI measures, acquisition rates in the ASD group ranged from 93% (structural scan) to 47% (emotion processing functional scan) and in the TD group from 96 to 60%. This difference in acquisition rates between sequences is largely explained by our hierarchy of level 1 (core) to level 3 (optional) measures, such that level 3 measures were always omitted first (e.g. when scanning started late, technical problems were encountered, or the participant expressed that he/she wanted to stop the scan session). For cognitive tests, acquisition rates ranged between 92–86% in the ASD group and 97–87% in the TD group. For EEG measures, acquisition rates in the ASD group ranged between 83–75% and 80–79%
<table><caption>**Table 4** LEAP participant characteristics; case-control cohort, by sex and schedule</caption><thead><tr><th rowspan="2"></th><th rowspan="2"></th><th colspan="2">Total</th><th colspan="2">Adults</th><th colspan="2">Adolescents</th><th colspan="2">Children</th><th colspan="2">Mild ID</th></tr><tr><th>ASD</th><th>TD/ID</th><th>ASD</th><th>TD</th><th>ASD</th><th>TD</th><th>ASD</th><th>TD</th><th>ASD</th><th>ID</th></tr></thead><tbody><tr><td rowspan="3">Sex</td><td>N</td><td>437</td><td>300</td><td>142</td><td>109</td><td>126</td><td>94</td><td>101</td><td>68</td><td>68</td><td>29</td></tr><tr><td>Males (%)</td><td>72.3</td><td>65</td><td>72.5</td><td>67</td><td>77</td><td>69.1</td><td>71.3</td><td>61.8</td><td>64.7</td><td>51.7</td></tr><tr><td>Females (%)</td><td>27.7</td><td>35</td><td>27.5</td><td>33</td><td>23</td><td>30.9</td><td>28.7</td><td>38.2</td><td>35.3</td><td>48.3</td></tr><tr><td rowspan="3">Age<br>(in years)</td><td>M</td><td>16.68</td><td>17.22</td><td>22.79</td><td>23.10</td><td>14.86</td><td>15.33</td><td>9.40</td><td>9.52</td><td>18.09</td><td>19.30</td></tr><tr><td>SD</td><td>5.80</td><td>5.94</td><td>3.37</td><td>3.27</td><td>1.73</td><td>1.73</td><td>1.58</td><td>1.54</td><td>4.27</td><td>4.97</td></tr><tr><td>Range</td><td>6.08–30.60</td><td>6.24–30.78</td><td>18.02–30.60</td><td>18.07–30.78</td><td>12.07–17.90</td><td>12.04–17.99</td><td>6.08–11.97</td><td>6.24–11.98</td><td>11.50–30.19</td><td>12.92–30.24</td></tr><tr><td rowspan="3">Full-scale<br>IQ</td><td>M</td><td>97.61</td><td>104.57</td><td>103.99</td><td>109.15</td><td>101.59</td><td>106.58</td><td>105.29</td><td>111.46</td><td>65.84</td><td>63.39</td></tr><tr><td>SD</td><td>19.74</td><td>18.26</td><td>14.82</td><td>12.60</td><td>15.68</td><td>13.18</td><td>14.76</td><td>12.69</td><td>7.70</td><td>8.00</td></tr><tr><td>Range</td><td>40<sup>a</sup>–148</td><td>50–142</td><td>76–148</td><td>76–142</td><td>75–143</td><td>77–140</td><td>74–148</td><td>76–142</td><td>40<sup>a</sup>–74</td><td>50–74</td></tr></tbody></table>

ASD autism spectrum disorder, TD typically developing, Mild ID intellectual disability

in the TD group. These lower acquisition rates for EEG measures reflect the fact that one site (UCAM) did not acquire EEG data. For eye-tracking, acquisition rates of the four main task sets ranged between 91–86% and 91–87% in the ASD and TD groups, respectively. Two tasks that were later added to the protocol (change detection, emotion matching) had lower acquisition rates. Blood samples were acquired in 68% of ASD participants and 73% of TD participants and ‘trios’ (i.e. participant, biological father, and biological mother) in 29% of people with ASD. Saliva was acquired in those individuals who did not wish to give a blood sample, 39% of people with ASD and 30% of TD people. Urine was given by 82% of participants in both the ASD and TD groups, and hair samples in 43% of people with ASD and 35% of people with TD.

Additional file 3 shows the data acquisition rates across the different assessment modalities and split by group and schedules.

## Discussion

### ‘Lessons learnt’ and future directions

The scale and level of integrated phenotypic and genomic characterisation of the LEAP cohort is unprecedented in ASD research. Within a 5-year period, we have been able to comprehensively assess a large cohort of children, adolescents, and young adults from 6 to 30 years at two time points. As the final sample slightly exceeds the original recruitment target, the study (accounting for missing data and data loss after QC procedures) has the power to detect subgroups with medium effect sizes.

However, we also wish to acknowledge limitations of the study, and ‘share lessons’ learnt regarding the study design, recruitment, and data acquisition.

**Study design** It is important to allow sufficient time for study set-up, piloting of tasks, development of standard operating procedures (SOP), and training prior to commencing data collection. This includes dedicated periods

<table><caption>**Table 5** LEAP participant characteristics; twin cohort</caption><thead><tr><th rowspan="2"></th><th rowspan="2"></th><th colspan="2">MZ/ DZ twin pairs (at least one ASD sibling)</th><th colspan="2">TD twins</th></tr><tr><th>Twin 1: ASD</th><th>Twin 2: ASD or TD</th><th>Twin 1</th><th>Twin 2</th></tr></thead><tbody><tr><td rowspan="3">Diagnosis<br>Sex</td><td>N</td><td>36</td><td>36</td><td>15</td><td>15</td></tr><tr><td>ASD (%)</td><td>100</td><td>66.7</td><td>71.5</td><td>65.8</td></tr><tr><td>Males:female (%)</td><td>61.5:38.4</td><td>70.2:29.9</td><td>56.3:43.7</td><td>53.3:46.7</td></tr><tr><td rowspan="3">Age (in years)</td><td>M</td><td>15.9</td><td>15.9</td><td>16.8</td><td>16.9</td></tr><tr><td>SD</td><td>4.5</td><td>4.5</td><td>2.9</td><td>2.9</td></tr><tr><td>Range</td><td>6–27</td><td>6–27</td><td>12–21</td><td>12–21</td></tr><tr><td rowspan="3">Full-scale IQ</td><td>M</td><td>94.1</td><td>94.2</td><td>103.6</td><td>103.7</td></tr><tr><td>SD</td><td>19.5</td><td>19.0</td><td>13.7</td><td>12.6</td></tr><tr><td>Range</td><td>40–122</td><td>58–130</td><td>76–124</td><td>79–126</td></tr></tbody></table>

<footnote>ªThere are 3 individuals with a full-scale IQ <50</footnote>
for developing QC and data processing pipeline SOPs. As most grants have a timeline of 5 years, the development of new measures, such as cognitive tests, neuroimaging paradigms or clinical scales (including piloting, validation, establishing test-retest reliability) is difficult to integrate in this schedule. For (European) studies carried out in different countries in which different languages are spoken, time for translation/back-translation (of some measures) needs to be factored in. Therefore, in LEAP, we predominantly used well-established tests (but adapted tasks where needed, carried out test-retest reliability studies of the fMRI tasks, and optimised acquisition protocols)—perhaps at the cost of including more novel tests or emergent domains. LEAP is one of the few biomarker studies that covers a broad age range. Therefore, one selection criterion of tasks was their suitability across the entire age/ability range of the cohort. An alternative approach could be to use tasks with different age-appropriate versions; however, with regard to the most prominent ASD neurocognitive domains, such tests are currently largely missing.

We deliberately used few participant exclusion criteria, and LEAP is one of the few biomarker—and more specifically neuroimaging—studies that includes people with ASD and mild intellectual disability. However, we did exclude individuals with moderate, severe, and profound ID. This decision was largely made because at the start of the study, it was deemed difficult to use some of the same measures/tests in individuals with severe ID, including MRI scanning (without sedation). However, we are currently carrying out a companion single-site study (EU-AIMS Synaptic Gene Project, SynaG) that focuses on individuals with rare monogenic forms of ASD (e.g. SHANK3), most of whom have severe-to-profound ID.

**Recruitment** We recruited individuals with an existing clinical diagnosis of ASD using a range of different avenues. This, together with the fact that people with moderate-to-profound ID were excluded and that we deliberately over-recruited females means that the cohort may not be representative of the ASD population. Recruitment of individuals with mild ID has proven to be challenging. We also found that a relatively high proportion of individuals with ASD that were recruited into schedule D based on an initial screener had IQ higher than 70 but lower adaptive behaviour. Likewise, recruitment of a population-representative TD control group, specifically, individuals with below-average IQ (e.g. between 75 and 90) was found to be a challenge. Future studies may require specific recruitment strategies to recruit this population.

**Data acquisition** In order to collect high-quality data, building in standardisation at every level on the way is

crucial. In our experience, investing in joint training for research teams across sites and face-to-face meetings has proven invaluable. We established QC procedures for data entry and checking and included a proportion of double data entry to identify systematic errors/inconsistencies across sites. Furthermore, communication is key, including Principal Investigators, Postdocs, PhD students, and Research Assistants. For example, our study operations manager hosts weekly telephone calls with researchers from all study sites to ensure consistency in data acquisition, identify problems early, and trouble shoot. Periodically checking/analysing data (not only after the pilot phase) is essential to ensure that no errors creep in after, for example, a script update or scanner upgrade, and to detect any errors as early as possible. We found facebook and twitter to be useful for recruitment calls and to tell families about study progress, events, relevant papers or findings, and to stay in contact. However, we believe that our very good to excellent retention rates are primarily due to the ability of the research teams to make the study visits comfortable and a positive experience for the participants and families, despite our comprehensive study protocol.

## Conclusion

We expect that planned core analyses will enable us to confirm, reject, and refine existing neurocognitive and neurobiological hypotheses (e.g. regarding case-control differences). Data-driven, unsupervised techniques hold promise to identifying ‘new’ ASD subgroups based on their shared cognitive and/or neurobiological/neurochemical or genetic profile. By integrating diverse multi-level analyses, we hope to attain a better picture of how different aetiologies (e.g. genetically driven molecular subgroups) and neurobiological and clinical heterogeneity map onto one another. Validation and qualification of these markers will be crucial to determine their potential usefulness as ‘enrichment markers’ for clinical trials. Ultimately, the clinical utility of a stratification marker will lie in its value to predict, for a particular person, how their symptoms progress, and whether or not they may benefit from a specific treatment or intervention. We expect that the findings generated in this study will be important steps in bringing us closer to developing precision medicines approaches for ASD.

## Additional files

**Additional file 1:** Summary of study protocol, by schedule*. (DOCX 72 kb)

**Additional file 2:** Data acquisition rates of baseline assessments, by data modality. (DOCX 786 kb)

**Additional file 3:** Power calculations. (DOCX 1019 kb)
## Abbreviations

ADHD: Attention-deficit/hyperactivity disorder; ADI-R: Autism Diagnostic Interview-Revised; ADOS: Autism Diagnostic Observation Schedule; AQ: Autism Spectrum Quotient; ASBQ: Adult Social Behaviour Questionnaire; ASD: Autism Spectrum Disorder; BOLD: Blood-oxygen-level dependent; CIMH: Central Institute of Mental Health; DAWBA: Development and Well-being Assessment; DTI: Diffusion tensor imaging; E/I: Excitatory-Inhibitory; EEG: Electroencephalography; EF: Executive Function; EMA: European Medicines Agency; EPI: Echo-planar imaging; ERO: Event-related oscillation; ERP: Event-related potential; EU-AIMS: European Autism Interventions—A Multicentre Study for Developing New Medications; FDA: Functional data analysis; fMRI: Functional magnetic resonance imaging; ICD-10: International Statistical Classification of Diseases and Related Health Problems, 10th Revision; ID: Intellectual disability; ipSC: Induced pluripotent stem cells; IQ: Intelligent quotient; KCL: King's College London; LEAP: Longitudinal European Autism Project; MMN: Mismatch negativity; MRI: Magnetic resonance imaging; MSSNG: https://www.mss.ng; P: Parent-report; RBS-R: Repetitive Behavior Scale-Revised; RDOc: Research Domain Criteria; ROC: Receiver Operating Characteristic; RRB: Repetitive and Restricted Behaviours; RUNMC: Radboud University Nijmegen Medical Centre; S: Self-report; Sftp: Secure file transfer protocol; SOP: Standard operating procedure; SRS-2: Social Responsiveness Scale, 2nd Edition; TD: Typically Developing; ToM: Theory of mind; UCAM: Autism Research Centre, University of Cambridge; UCBM: University Campus Bio-Medico; UMCU: University Medical Centre Utrecht; WCC: Weak central coherence

## Acknowledgements

We thank all participants and their families for participating in this study.

## Funding

This work was supported by EU-AIMS (European Autism Interventions), which receives support from the Innovative Medicines Initiative Joint Undertaking under grant agreement no. 115300, the resources of which are composed of financial contributions from the European Union's Seventh Framework Programme (grant FP7/2007-2013), from the European Federation of Pharmaceutical Industries and Associations companies' in-kind contributions and from Autism Speaks.

## Availability of data and materials

Data collected in EU-AIMS LEAP are stored and curated at the EU-AIMS database. The database is only accessible to EU-AIMS members until study end and will subsequently be opened to the wider scientific community.

## Authors' contributions

EL, TC, LM, EJHJ, JA, BA, ToB, SBC, CB, MB, DB, SB, TB, BC, FDA, GD, SD, CE, VF, PG, DG, LH, JH, RJH, MHJ, PK, MCL, XLD, MVL, DJL, RM, AML, CM, BO, GP, AMP, RS, ES, JT, RT, HT, SCRW, MPZ, WS, DGM, and JKB designed the study, developed data acquisition and/or analysis protocols. JA, CB, SA, SB, CB, YdB, DC, IC, JF, JI, HH, RH, PG, NM, LO, ANVR, BR, JS, ASJC, and CW collected the data. EL wrote the first and final draft. TC, EJHJ, JB, ToB, SBC, SB, TB, BC, GM, SD, DG, LMH, MHJ, MCL, BO, GP, AMP, ASJC, ES, HT, WS, DGM, and JKB contributed to writing the manuscript. All authors read and approved the final manuscript

## Competing interests

WS, XLD, PG, JH, and LMH are employees at F. Hoffmann-La Roche Ltd. GP is an employee at Janssen.
AML has received consultant fees and travel expenses from Alexza Pharmaceuticals, AstraZeneca, Bristol-Myers Squibb, Defined Health, Decision Resources, Desitin Arzneimittel, Elsevier, F. Hoffmann-La Roche, Gerson Lehrman Group, Grupo Ferrer, Les Laboratoires Servier, Lilly Deutschland, Lundbeck Foundation, Outcome Sciences, Outcome Europe, PriceSpective, and Roche Pharma and has received speaker's fees from Abbott, AstraZeneca, BASF, Bristol-Myers Squibb, GlaxoSmithKline, Janssen-Cilag, Lundbeck, Pfizer Pharma, and Servier Deutschland.
JKB has been a consultant to/member of advisory board of/and/or speaker for Janssen Cilag BV, Eli Lilly, Shire, Lundbeck, Roche, and Servier.
TB served in an advisory or consultancy role for Actelion, Hexal Pharma, Lilly, Medice, Novartis, Oxford outcomes, Otsuka, PCM scientific, Shire and Viforpharma. He received conference support or speaker's fee by Medice, Novartis and Shire. He is/is has been involved in clinical trials conducted by Shire and Viforpharma. He received royalties from Hogrefe, Kohlhammer, CIP

Medien, and Oxford University Press. The present work is unrelated to the above grants and relationships.

The other authors declare that they have no competing interests.

## Consent for publication

Consent for publication was obtained from all participants prior to the study.

## Ethics approval and consent to participate

Ethical approval for this study was obtained through ethics committees at each site.

<table><thead><tr><th>Site</th><th>Ethics committee</th><th>ID/ reference no.</th></tr></thead><tbody><tr><td>KCL</td><td>London-Central and Queen Square Health Research Authority</td><td>13/LO/</td></tr><tr><td>UCAM</td><td>Research Ethics Committee</td><td>1156</td></tr><tr><td>RUNMC</td><td>Radboud universitair medisch centrum</td><td>2013/455</td></tr><tr><td>UMCU</td><td>Instituut Waarborging Kwaliteit en Veiligheid<br>Commissie Mensgebonden Onderzoek<br>Regio Arnhem-Nijmegen (Radboud University Medical Centre<br>Institute Ensuring Quality and Safety<br>Committee on Research Involving Human Subjects<br>Arnhem-Nijmegen)</td><td></td></tr><tr><td>CIMH</td><td>UMM Universitätsmedizin Mannheim, Medizinische Ethik Kommission<br>II (UMM University Medical Mannheim, Medical Ethics Commission II)</td><td>2014-<br>540N-MA</td></tr><tr><td>UCBM</td><td>Universita Campus Bio-Medica De Roma Comitato Etico<br>(University Campus Bio-Medical Ethics Committee De Roma)</td><td>18/14<br>PAR<br>ComET<br>CBM</td></tr><tr><td>KI</td><td>Centrala Etikprovningsnamnden (Central Ethical Review Board)</td><td>32-2010</td></tr></tbody></table>

## Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Author details

¹Sackler Institute for Translational Neurodevelopment, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK. ²Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK. ³Clinical Child Psychology, Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK. ⁴Centre for Brain and Cognitive Development, Birkbeck, University of London, Henry Wellcome Building, Malet Street, London WC1E 7HX, UK. ⁵Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK. ⁶Autism Research Centre, Department of Psychiatry, University of Cambridge, Douglas House, 18b Trumpington Road, Cambridge CB2 8AH, UK. ⁷Department of Psychology, The School of Philosophy, Psychology, and Language Sciences, University of Edinburgh, Dugald Stewart Building, 3 Charles Street, Edinburgh EH8 9AD, UK. ⁸University Campus Bio-Medico, via Álvaro del Portillo, 21, Rome, Italy. ⁹Department of Psychiatry, Brain Center Rudolf Magnus, University Medical Center Utrecht, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands. ¹⁰Child and Adolescent Psychiatry, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, JS, 68159 Mannheim, Germany. ¹¹Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen Medical Centre, Kapittelweg 29, 6525 EN Nijmegen, The Netherlands. ¹²Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric Hospital, University of Zürich, Neumünsterallee 9, 8032 Zürich, Switzerland. ¹³Center for Neurodevelopmental Disorders at Karolinska Institutet (KIND), Stockholm, Sweden. ¹⁴Human Genetics and Cognitive Functions Unit, Institut Pasteur, 25 Rue du Docteur Roux, Paris Cedex 15, France. ¹⁵Centre for Autism, School of Psychology and Clinical Language Sciences, University of Reading, Whiteknights, Reading RG6 6AL, UK. ¹⁶Department of Child and Adolescent
Psychiatry, Psychosomatics and Psychotherapy, University Hospital Frankfurt am Main, Goethe University, Deutschordenstrasse 50, 60528 Frankfurt, Germany. ¹⁷Neurospin Centre CEA, Saclay, 91191 Gif sur Yvette, France.
¹⁸Roche Pharma Research and Early Development, Neuroscience, Ophthalmology and Rare Diseases, Roche Innovation Center Basel, Grenzacherstrasse 124, B.001 N.667, CH-4070 Basel, Switzerland. ¹⁹Regulatory Affairs, Product Development, F. Hoffmann-La Roche Pharmaceuticals, Grenzacherstrasse 124, CH-4070 Basel, Switzerland. ²⁰Department of Neuroscience, Uppsala University, Uppsala, Sweden. ²¹Department of Radiology, Icahn School of Medicine at Mount Sinai, NY, USA. ²²Child and Youth Mental Health Collaborative, Centre for Addiction and Mental Health and The Hospital for Sick Children, Department of Psychiatry, University of Toronto, 80, Workman Way, Toronto, ON M6J 1H4, Canada. ²³Center for Applied Neuroscience, Department of Psychology, University of Cyprus, PO Box 205371678 Nicosia, Cyprus. ²⁴Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, 68159 Mannheim, Germany. ²⁵Janssen Research & Development, 1125 Trenton Harbourton Road, Titusville, NJ 08560, USA.
²⁶Child and Adolescent Neuropsychiatry Unit, Gaetano Martino University Hospital, University of Messina, Via Consolare Valeria 1, I-98125 Messina, Italy.
²⁷Social, Genetic and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology and Neuroscience, King's College London, Denmark Hill, London, UK. ²⁸Department of Child and Adolescent Psychiatry, Institute of Psychology, Psychiatry and Neuroscience, King's College London, De Crespigny Park, Denmark Hill, London SE5 8AF, UK.

Received: 15 November 2016 Accepted: 19 May 2017

Published online: 23 June 2017

## References

1. Centers for Disease Control and Prevention. Prevalence of autism spectrum disorders—Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. MMWR Surveill Summ. 2012;61:1–19.

2. Kanner L. Autistic disturbances of affective contact. Nerv Child. 1943;2:217–50.

3. Asperger H. Die "Autistischen Psychopathen" im Kindesalter. Archiv fuer Psychiatrie und Nervenkrankheiten. 1944;117:76–136.

4. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (Fifth ed.). Arlington: American Psychiatric Publishing; 2013.

5. Charman T. Variability in neurodevelopmental disorders: evidence from autism. In: Riba D, Van Herwegen J, editors. Applied Research and Key Issues in Neurodevelopmental Disorders. Routledge Psychology Press; 2015. p. 117–40.

6. Charman T, Jones CR, Pickles A, Simonoff E, Baird G, Happe F. Defining the cognitive phenotype of autism. Brain Res. 2011;1380:10–21.

7. Bourgeron T. From the genetic architecture to synaptic plasticity in autism spectrum disorder. Nat Rev Neurosci. 2015;16:551–63.

8. Sahin M, Sur M. Genes, circuits, and precision therapies for autism and related neurodevelopmental disorders. Science. 2015;350:921–9.

9. Geschwind DH. Advances in autism. Annu Rev Med. 2009;60:367–80.

10. Cuthbert BN, Insel TR. Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Med. 2013;11:126.

11. Button KS, Ioannidis JP, Mokrysz C, Nosek BA, Flint J, Robinson ES, Munafo MR. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14:365–76.

12. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2:e124.

13. Ioannidis JP. How to make more published research true. PLoS Med. 2014; 11:e1001747.

14. Murphy D, Spooren W. EU-AIMS: a boost to autism research. Nat Rev Drug Discov. 2012;11:815–6.

15. Loth E, Spooren W, Murphy DG, Consortium E-A. New treatment targets for autism spectrum disorders: EU-AIMS. Lancet Psychiatry. 2014;1:413–5.

16. Lai MC, Lombardo MV, Auyeung B, Chakrabarti B, Baron-Cohen S. Sex/ gender differences and autism: setting the scene for future research. J Am Acad Child Adolesc Psychiatry. 2015;54:11–24.

17. Bolte S, Willfors C, Berggren S, Norberg J, Poltrago L, Mevel K, Coco C, Fransson P, Borg J, Sitnikov R, et al. The roots of autism and ADHD twin study in Sweden (RATSS). Twin Res Hum Genet. 2014;17:164–76.

18. Loth E, Spooren W, Ham LM, Isaac MB, Auriche-Benichou C, Banaschewski T, Baron-Cohen S, Broich K, Bolte S, Bourgeron T, et al. Identification and

validation of biomarkers for autism spectrum disorders. Nat Rev Drug Discov. 2016;15:70–3.

19. Simonoff E, Pickles A, Charman T, Chandler S, Loucas T, Baird G. Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample. J Am Acad Child Adolesc Psychiatry. 2008;47:921–9.

20. Wong AY, Hsia Y, Chan EW, Murphy DG, Simonoff E, Buitelaar JK, Wong IC. The variation of psychopharmacological prescription rates for people with autism spectrum disorder (ASD) in 30 countries. Autism Res. 2014;7:543–54.

21. Frazier TW, Shattuck PT, Narendorf SC, Cooper BP, Wagner M, Spitznagel EL. Prevalence and correlates of psychotropic medication use in adolescents with an autism spectrum disorder with and without caregiver-reported attention-deficit/hyperactivity disorder. J Child Adolesc Psychopharmacol. 2011;21:571–9.

22. Rutter M, Caspi A, Moffitt TE. Using sex differences in psychopathology to study causal mechanisms: unifying issues and research strategies. J Child Psychol Psychiatry. 2003;44:1092–115.

23. Lord C, Petkova E, Hus V, Gan W, Lu F, Martin DM, Ousley O, Guy L, Bernier R, Gerdts J, et al. A multisite study of the clinical diagnosis of different autism spectrum disorders. Arch Gen Psychiatry. 2012;69:306–13.

24. Constantino JN, Hudziak JJ, Todd RD. Deficits in reciprocal social behavior in male twins: evidence for a genetically independent domain of psychopathology. J Am Acad Child Adolesc Psychiatry. 2003;42:458–67.

25. Hartman CA, Luteijn E, Serra M, Minderaa R. Refinement of the Children's Social Behavior Questionnaire (CSBQ): an instrument that describes the diverse problems seen in milder forms of PDD. J Autism Dev Disord. 2006; 36:325–42.

26. Bodfish JW, Symons FJ, Parker DE, Lewis MH. Varieties of repetitive behavior in autism: comparisons to mental retardation. J Autism Dev Disord. 2000;30: 237–43.

27. Evans DW, Uljarevic M, Lusk LG, Loth E, Frazier T. Development of two new dimensional measures of restricted and repetitive behaviors in parents and children. J Am Acad Child Adolesc Psychiatry. 2017;56(1):51–8.

28. Tomchek SD, Dunn W. Sensory processing in children with and without autism: a comparative study using the short sensory profile. Am J Occup Ther. 2007;61:190–200.

29. Ausderau K, Sideris J, Furlong M, Little LM, Bulluck J, Baranek GT. National survey of sensory features in children with ASD: factor structure of the sensory experience questionnaire (3.0). J Autism Dev Disord. 2014;44:915–25.

30. Baron-Cohen S, Wheelwright S, Skinner R, Martin J, Clubley E. The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J Autism Dev Disord. 2001;31:5–17.

31. Baron-Cohen S, Hoekstra RA, Knickmeyer R, Wheelwright S. The autism-spectrum quotient (AQ)—adolescent version. J Autism Dev Disord. 2006;36: 343–50.

32. Goodman R, Ford T, Richards H, Gatward R, Meltzer H. The development and well-being assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry. 2000;41:645–55.

33. Sparrow S, Cicchetti DV, Balla DA: *Vineland adaptive behavior scales. 2nd ed.* Circle Pines, MN: American. Guidance Service Inc.; 2005

34. Bird HR, Shaffer D, Fisher P, Gould MS, Staghezza B, Chen JY, Hoven C. The Columbia-Impairment-Scale (Cis)—pilot findings on a measure of global impairment for children and adolescents. Int J Methods Psychiatr Res. 1993;3:167–76.

35. Geschwind DH, Levitt P. Autism spectrum disorders: developmental disconnection syndromes. Curr Opin Neurobiol. 2007;17:103–11.

36. Rubenstein JL, Merzenich MM. Model of autism: increased ratio of excitation/inhibition in key neural systems. Genes Brain Behav. 2003;2:255–67.

37. Baron-Cohen S, Leslie A, Frith U. Does the autistic child have a "theory of mind"? Cognition. 1985;21:37–46.

38. Begeer S, Bernstein DM, van Wijhe J, Scheeren AM, Koot HM. A continuous false belief task reveals egocentric biases in children and adolescents with autism spectrum disorders. Autism. 2012;16:357–66.

39. Senju A, Southgate V, White S, Frith U. Mindblind eyes: an absence of spontaneous theory of mind in Asperger syndrome. Science. 2009;325:883–5.

40. Abell F, Happe F, Frith U. Do triangles play tricks? Attribution of mental states of animated shapes in normal and abnormal development. Cogn Dev. 2000;15:1–16.
41. Sucksmith E, Allison C, Baron-Cohen S, Chakrabarti B, Hoekstra RA. Empathy and emotion recognition in people with autism, first-degree relatives, and controls. Neuropsychologia. 2013;51:98-105.

42. Palermo R, O'Connor KB, Davis JM, Irons J, McKone E. New tests to measure individual differences in matching and labelling facial expressions of emotion, and their association with ability to recognise vocal emotions and facial identity. PLoS One. 2013;8:e68126.

43. Hariri AR, Mattay VS, Tessitore A, Kolachana B, Fera F, Goldman D, Egan MF, Weinberger DR. Serotonin transporter genetic variation and the response of the human amygdala. Science. 2002;297:400-3.

44. Klin A, Jones W, Schultz R, Volkmar F. The enactive mind, or from actions to cognition: lessons from autism. Philos Trans R Soc Lond B Biol Sci. 2003;358:345-60.

45. Chevallier C, Kohls G, Troiani V, Brodkin ES, Schultz RT. The social motivation theory of autism. Trends Cogn Sci. 2012;16:231-9.

46. Hill EL. Executive dysfunction in autism. Trends Cogn Sci. 2004;8:26-32.

47. Boyd BA, McBee M, Holtzclaw T, Baranek GT, Bodfish JW. Relationships among repetitive behaviors, sensory features, and executive functions in high functioning autism. Res Autism Spectr Disord. 2009;3:959-66.

48. Johnson MH. Executive function and developmental disorders: the flip side of the coin. Trends Cogn Sci. 2012;16:454-7.

49. Pugliese CE, Anthony L, Strang JF, Dudley K, Wallace GL, Kenworthy L. Increasing adaptive behavior skill deficits from childhood to adolescence in autism spectrum disorder: Role of Executive Function. J Autism Dev Disord. 2014;45(60):1579-87.

50. Sjowall D, Roth L, Lindqvist S, Thorell LB. Multiple deficits in ADHD: executive dysfunction, delay aversion, reaction time variability, and emotional deficits. J Child Psychol Psychiatry. 2013;54:619-27.

51. den Ouden HE, Daw ND, Fernandez G, Elshout JA, Rijpkema M, Hoogman M, Franke B, Cools R. Dissociable effects of dopamine and serotonin on reversal learning. Neuron. 2013;80:1090-100.

52. Happe F, Frith U. The weak coherence account: detail-focused cognitive style in autism spectrum disorders. J Autism Dev Disord. 2006;36:5-25.

53. Baron-Cohen S. Empathizing, systemizing, and the extreme male brain theory of autism. Prog Brain Res. 2010;186:167-75.

54. Baron-Cohen S, Richler J, Bisarya D, Gurunathan N, Wheelwright S. The systemizing quotient: an investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philos Trans R Soc Lond B Biol Sci. 2003;358:361-74.

55. Loth E, Gomez JC, Happe F. Do high-functioning people with autism spectrum disorder spontaneously use event knowledge to selectively attend to and remember context-relevant aspects in scenes? J Autism Dev Disord. 2011;41:945-61.

56. Pellicano E, Burr D. When the world becomes 'too real': a Bayesian explanation of automatic perception. Trends Cogn Sci. 2012;16:504-10.

57. Summerfield C, Egner T, Greene M, Koechlin E, Mangels J, Hirsch J. Predictive codes for forthcoming perception in the frontal cortex. Science. 2006;314:1311-4.

58. Sinha P, Kjelgaard MM, Gandhi TK, Tsourides K, Cardinaux AL, Pantazis D, Diamond SP, Held RM. Autism as a disorder of prediction. Proc Natl Acad Sci U S A. 2014;111:15220-5.

59. Nystrom P, Gredeback G, Bolte S, Falck-Ytter T, team E. Hypersensitive pupillary light reflex in infants at risk for autism. Mol Autism. 2015;6:10.

60. Klin A, Shultz S, Jones W. Social visual engagement in infants and toddlers with autism: early developmental transitions and a model of pathogenesis. Neurosci Biobehav Rev. 2015;50:189-203.

61. Klin A, Jones W, Schultz R, Volkmar F, Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002;59:809-16.

62. Putnam PT, Roman JM, Zimmerman PE, Gothard KM. Oxytocin enhances gaze-following responses to videos of natural social behavior in adult male rhesus monkeys. Psychoneuroendocrinology. 2016;72:47-53.

63. Depue RA, Morrone-Strupinsky JV. A neurobehavioral model of affiliative bonding: implications for conceptualizing a human trait of affiliation. Behav Brain Sci. 2005;3:313-50.

64. Daly EM, Deeley Q, Ecker C, Craig M, Hallahan B, Murphy C, Johnston P, Spain D, Gillan N, Brammer M, et al. Serotonin and the neural processing of facial emotions in adults with autism: an fMRI study using acute tryptophan depletion. Arch Gen Psychiatry. 2012;69:1003-13.

65. Courchesne E, Campbell K, Solso S. Brain growth across the life span in autism: age-specific changes in anatomical pathology. Brain Res. 2011;1380:138-45.

66. Belmonte MK, Allen G, Beckel-Mitchener A, Boulanger LM, Carper RA, Webb SJ. Autism and abnormal development of brain connectivity. J Neurosci. 2004;24:9228-31.

67. Ecker C, Bookheimer SY, Murphy DG. Neuroimaging in autism spectrum disorder: brain structure and function across the lifespan. Lancet Neurol. 2015;14:1121-34.

68. Panizzon MS, Fennema-Notestine C, Eyler LT, Jernigan TL, Prom-Wormley E, Neale M, Jacobson K, Lyons MJ, Grant MD, Franz CE, et al. Distinct genetic influences on cortical surface area and cortical thickness. Cereb Cortex. 2009;19:2728-35.

69. Wierenga LM, Langen M, Oranje B, Durston S. Unique developmental trajectories of cortical thickness and surface area. Neuroimage. 2014; 15:120-6.

70. Ecker C, Ronan L, Feng Y, Daly E, Murphy C, Ginestet CE, Brammer M, Fletcher PC, Bullmore ET, Suckling J, et al. Intrinsic gray-matter connectivity of the brain in adults with autism spectrum disorder. Proc Natl Acad Sci U S A. 2013;110:13222-7.

71. Catani M, Dell'Acqua F, Budisavljevic S, Howells H, Thiebaut de Schotten M, Froudist-Walsh S, D'Anna L, Thompson A, Sandrone S, Bullmore ET, et al. Frontal networks in adults with autism spectrum disorder. Brain. 2016;139: 616-30.

72. Delmonte S, Balsters JH, McGrath J, Fitzgerald J, Brennan S, Fagan AJ, Gallagher L. Social and monetary reward processing in autism spectrum disorders. Mol Autism. 2012;3:7.

73. Castelli F, Frith C, Happe F, Frith U. Autism, Asperger syndrome and brain mechanisms for the attribution of mental states to animated shapes. Brain. 2002;125:1839-49.

74. Meyer-Lindenberg A, Nichols T, Callicott JH, Ding J, Kolachana B, Buckholtz J, Mattay VS, Egan M, Weinberger DR. Impact of complex genetic variation in COMT on human brain function. Mol Psychiatry. 2006;11:867-877, 797.

75. Plichta MM, Schwarz AJ, Grimm O, Morgen K, Mier D, Haddad L, Gerdes AB, Sauer C, Tost H, Esslinger C, et al. Test-retest reliability of evoked BOLD signals from a cognitive-emotive fMRI test battery. Neuroimage. 2012;60:1746-58.

76. Moessnang C, Schaefer A, Bilek E, Roux P, Otto K, Baumeister S, Hohmann S, Poustka L, Brandeis D, Banaschewski T, et al. Specificity, reliability and sensitivity of social brain responses during spontaneous mentalizing. Soc Cogn Affect Neurosci. 2016;11:1687-97.

77. Kundu P, Inati SJ, Evans JW, Luh WM, Bandettini PA. Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI. Neuroimage. 2012;60:1759-70.

78. Lombardo MV, Auyeung B, Holt RJ, Waldman J, Ruigrok AN, Mooney N, Bullmore ET, Baron-Cohen S, Kundu P: Improving effect size estimation and statistical power with multi-echo fMRI and its impact on understanding the neural systems supporting mentalizing. Neuroimage. 2016;142:55-66.

79. Power JD, Barnes KA, Snyder AZ, Schlaggar BL, Petersen SE. Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. Neuroimage. 2012;59:2142-54.

80. Smith SM, Miller KL, Moeller S, Xu J, Auerbach EJ, Woolrich MW, Beckmann CF, Jenkinson M, Andersson J, Glasser MF, et al. Temporally-independent functional modes of spontaneous brain activity. Proc Natl Acad Sci U S A. 2012;109:3131-6.

81. Di Martino A, Yan CG, Li Q, Denio E, Castellanos FX, Alaerts K, Anderson JS, Assaf M, Bookheimer SY, Dapretto M, et al. The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol Psychiatry. 2014;19:659-67.

82. Hahamy A, Behrmann M, Malach R. The idiosyncratic brain: distortion of spontaneous connectivity patterns in autism spectrum disorder. Nat Neurosci. 2015;18:302-9.

83. Banaschewski T, Brandeis D. Annotation: what electrical brain activity tells us about brain function that other techniques cannot tell us—a child psychiatric perspective. J Child Psychol Psychiatry. 2007;48:415-35.

84. McPartland JC. Considerations in biomarker development for neurodevelopmental disorders. Curr Opin Neurol. 2016;29:118-22.

85. Webb SJ, Bernier R, Henderson HA, Johnson MH, Jones EJ, Lerner MD, McPartland JC, Nelson CA, Rojas DC, Townsend J, Westerfield M: Guidelines and best practices for electrophysiological data collection, analysis and reporting in autism. J Autism Dev Disord. 2013;45(2):425-43.

86. Buzsaki G, Wang XJ. Mechanisms of gamma oscillations. Annu Rev Neurosci. 2012;35:203-25.

87. Palmieri L, Persico AM. Mitochondrial dysfunction in autism spectrum disorders: cause or effect? Biochim Biophys Acta. 1797;2010:1130-7.
88. Schain RJ, Freedman DX. Studies on 5-hydroxyindole metabolism in autistic and other mentally retarded children. J Pediatr. 1961;58:315-20.

89. Gabriele S, Sacco R, Persico AM. Blood serotonin levels in autism spectrum disorder: a systematic review and meta-analysis. Eur Neuropsychopharmacol. 2014;24:919-29.

90. McBride PA, Anderson GM, Hertzig ME, Snow ME, Thompson SM, Khait VD, Shapiro T, Cohen DJ. Effects of diagnosis, race, and puberty on platelet serotonin levels in autism and mental retardation. J Am Acad Child Adolesc Psychiatry. 1998;37:767-76.

91. Patterson PH. Maternal infection and immune involvement in autism. Trends Mol Med. 2011;17:389-94.

92. Mandy W, Lai MC. Annual research review: the role of the environment in the developmental psychopathology of autism spectrum condition. J Child Psychol Psychiatry. 2016;57:271-92.

93. Estes ML, McAllister AK. Alterations in immune cells and mediators in the brain: it's not always neuroinflammation! Brain Pathol. 2014;24:623-30.

94. Baron-Cohen S, Auyeung B, Norgaard-Pedersen B, Hougaard DM, Abdallah MW, Melgaard L, Cohen AS, Chakrabarti B, Ruta L, Lombardo MV. Elevated fetal steroidogenic activity in autism. Mol Psychiatry. 2015;20:369-76.

95. Xiang AH, Wang X, Martinez MP, Walthall JC, Curry ES, Page K, Buchanan TA, Coleman KJ, Getahun D. Association of maternal diabetes with autism in offspring. JAMA. 2015;313:1425-34.

96. Moreno-de-Luca A, Myers SM, Challman TD, Moreno-de-Luca D, Evans DW, Ledbetter DH. Developmental brain dysfunction: revival and expansion of old concepts based on new genetic evidence. Lancet Neurol. 2013;12:406-14.

97. Cocks G, Curran S, Gami P, Uwanogho D, Jeffries AR, Kathuria A, Lucchesi W, Wood V, Dixon R, Ogilvie C, et al. The utility of patient specific induced pluripotent stem cells for the modelling of autistic spectrum disorders. Psychopharmacology (Berl). 2014;231:1079-88.

98. Thomas MS, Annaz D, Ansari D, Scerif G, Jarrold C, Karmiloff-Smith A. Using developmental trajectories to understand developmental disorders. J Speech Lang Hear Res. 2009;52:336-58.

99. Ecker C, Murphy D. Neuroimaging in autism—from basic science to translational research. Nat Rev Neurol. 2014;10:82-91.

100. Wolfers T, Buitelaar JK, Beckmann CF, Franke B, Marquand AF. From estimating activation locality to predicting disorder: A review of pattern recognition for neuroimaging-based psychiatric diagnostics. Neurosci Biobehav Rev. 2015;57:328-49.

101. Ecker C, Marquand A, Mourao-Miranda J, Johnston P, Daly EM, Brammer MJ, Maltezos S, Murphy CM, Robertson D, Williams SC, Murphy DG. Describing the brain in autism in five dimensions—magnetic resonance imaging-assisted diagnosis of autism spectrum disorder using a multiparameter classification approach. J Neurosci. 2010;30:10612-23.

102. Hampel H, Frank R, Broich K, Teipel SJ, Katz RG, Hardy J, Herholz K, Bokde AL, Jessen F, Hoessler YC, et al. Biomarkers for Alzheimer's disease: academic, industry and regulatory perspectives. Nat Rev Drug Discov. 2010; 9:560-74.

103. Lombardo MV, Lai M-C, Auyeung B, Holt RJ, Allison C, Smith P, Chakrabarti B, Ruigrok ANV, Suckling J, Bullmore E, et al. Unsupervised data-driven stratification of mentalizing heterogeneity in autism. Sci Rep. 2016;6:35333.

104. Campbell DJ, Shic F, Macari S, Chawarska K. Gaze response to dyadic bids at 2 years related to outcomes at 3 years in autism spectrum disorders: a subtyping analysis. J Autism Dev Disord. 2014;44:431-42.

105. Marquand AF, Rezek I, Buitelaar J, Beckmann CF. Understanding heterogeneity in clinical cohorts using normative models: beyond case-control studies. Biol Psychiatry. 2016;80:552-61.

106. Milne E, Scope A, Pascalis O, Buckley D, Makeig S. Independent component analysis reveals atypical electroencephalographic activity during visual perception in individuals with autism. Biol Psychiatry. 2009;65:22-30.

107. Jeste SS, Kirkham N, Senturk D, Hasenstab K, Sugar C, Kupelian C, Baker E, Sanders AJ, Shimizu C, Norona A, et al. Electrophysiological evidence of heterogeneity in visual statistical learning in young children with ASD. Dev Sci. 2015;18:90-105.

108. Hinrichs C, Singh V, Xu G, Johnson SC, Alzheimers Disease Neuroimaging I. Predictive markers for AD in a multi-modality framework: an analysis of MCI progression in the ADNI population. Neuroimage. 2011;55:574-89.

109. Hofree M, Shen JP, Carter H, Gross A, Ideker T. Network-based stratification of tumor mutations. Nat Methods. 2013;10:1108-15.

110. Fountain C, Winter AS, Bearman PS. Six developmental trajectories characterize children with autism. Pediatrics. 2012;129:e1112-1120.

111. Lee JW, Devanarayan V, Barrett YC, Weiner R, Allinson J, Fountain S, Keller S, Weinryb I, Green M, Duan L, et al. Fit-for-purpose method development and validation for successful biomarker measurement. Pharm Res. 2006;23:312-28.

112. Prata D, Mechelli A, Kapur S. Clinically meaningful biomarkers for psychosis: a systematic and quantitative review. Neurosci Biobehav Rev. 2014;45:134-41.

113. von Rhein D, Mennes M, van Ewijk H, Groenman AP, Zwiers MP, Oosterlaan J, Heslenfeld D, Franke B, Hoekstra PJ, Faraone SV, et al. The NeurolIMAGE study: a prospective phenotypic, cognitive, genetic and MRI study in children with attention-deficit/hyperactivity disorder. Design and descriptives. Eur Child Adolesc Psychiatry. 2014;24(3):265-81.

114. Scott-Van Zeeland AA, Dapretto M, Ghahremani DG, Poldrack RA, Bookheimer SY. Reward processing in autism. Autism Res. 2010;3:53-67.

115. Ring HA, Baron-Cohen S, Wheelwright S, Williams SC, Brammer M, Andrew C, Bullmore ET. Cerebral correlates of preserved cognitive skills in autism: a functional MRI study of embedded figures task performance. Brain. 1999; 122(Pt 7):1305-15.

116. Miller GA, Chapman JP. Misunderstanding analysis of covariance. J Abnorm Psychol. 2001;110:40-8.

117. Novack GD. The CONSORT statement for publication of controlled clinical trials. Ocul Surf. 2004;2:45-6.

Submit your next manuscript to BioMed Central and we will help you at every step:

* We accept pre-submission inquiries

* Our selector tool helps you to find the most relevant journal

* We provide round the clock customer support

* Convenient online submission

* Thorough peer review

* Inclusion in PubMed and all major indexing services

* Maximum visibility for your research

Submit your manuscript at
www.biomedcentral.com/submit

BioMed Central