Individual Brain Charting,a high-resolution fMRI dataset
for cognitive mapping of the human brain
Ana Luı́sa Pinho
Parietal Team, Inria
CEA, Paris-Saclay University
France@ALuisaPinho

The 5th CiNet Conference
Osaka, Japan
21st of February 2019

Background and motivations
In cognitive neuroscience:⇐⇒Brain systems

Mental functions

Background and motivations
In cognitive neuroscience:⇐⇒Brain systems

Mental functions

I tackle one psychological domain

Background and motivations
In cognitive neuroscience:⇐⇒Brain systems

Mental functions

I tackle one psychological domain
I be specific enough to accurately isolate brain

processes

Background and motivations
In cognitive neuroscience:⇐⇒Brain systems

Mental functions

I tackle one psychological domain
I be specific enough to accurately isolate brain

processes⇓
Very hard to achieve!
Lack of generality.

Background and motivations
In cognitive neuroscience:⇐⇒Brain systems

Task-fMRI experiments allow to:I link brain systems to behavior
I map neural activity at mm-scale

Mental functions

Features of the IBC dataset

I High-resolution fMRI data

(1.5mm)Features of the IBC dataset

I High-resolution fMRI data

(1.5mm)I TR = 2s

Features of the IBC dataset

I High-resolution fMRI data(1.5mm)
I TR = 2s
I Task-wise dataset:
I

Many tasks

Features of the IBC dataset

I High-resolution fMRI data(1.5mm)
I TR = 2s
I Task-wise dataset:
II

Many tasks
Fixed cohort - 13 healthy adults

Features of the IBC dataset

I High-resolution fMRI data(1.5mm)
I TR = 2s
I Task-wise dataset:

Many tasks
Fixed cohort - 13 healthy adults
I Fixed environmentII

NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil

Features of the IBC dataset

I High-resolution fMRI data(1.5mm)
I TR = 2s
I Task-wise dataset:

Many tasks
Fixed cohort - 13 healthy adults
I Fixed environmentII

I Inclusion of other MRI modalities

NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil

Features of the IBC dataset

I High-resolution fMRI data(1.5mm)
I TR = 2s
I Task-wise dataset:

Many tasks
Fixed cohort - 13 healthy adults
I Fixed environmentII

I Inclusion of other MRI modalities
I Not a longitudinal study!

NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil

TasksA task is:
I a well-controlled sequence of behavioral operations

TasksA task is:
I a well-controlled sequence of behavioral operations

Paradigms:
I block-design

TasksA task is:
I a well-controlled sequence of behavioral operations

Paradigms:
I block-design
I naturalistic stimuli

TasksA task is:
I a well-controlled sequence of behavioral operations

Paradigms:
I block-design
I naturalistic stimuli

Long-range cognitive order:
Perception⇒High-cognitionFirst release
Tasks
I ARCHI tasks
Standard
SpatialI Social
I EmotionalII

I HCP tasks
EmotionGambling
I MotorI Language
I Relational
I Social
I Working Memory
II

I RSVP Language

I Sensory processing:
Retinotopy
Tonotopy
I Somatotopy
II

I High-cognitive order:
Calculation
Language
I Social cognition
I Theory-of-mindIIFirst release
Tasks
I ARCHI tasks
Standard
SpatialI Social
I EmotionalII

I HCP tasks

I Sensory processing:
Retinotopy
Tonotopy
I Somatotopy
II

I 59 independent conditions
EmotionI High-cognitive order:
Gambling
I Calculation
I MotorI Language
I Language
I Social cognition
I Relational
I Theory-of-mind
I Social
I Working Memory
II

I RSVP Language

Behavioral protocols
Software Tools:

Presentation

Behavioral protocols
Software Tools:

Presentation

Protocols available on:
hbp-brain-charting/public
hbp-brain-charting/public protocols
protocolsBehavioral protocols
Software Tools:

I More public repositories of behavioral protocols toreproduce experiments!
Presentation
I Normatives to describe the experimental paradigms!

Protocols available on:
hbp-brain-charting/public
hbp-brain-charting/public protocols
protocols

Storage of raw MRI data

Link

Storage of raw MRI data

Linkds000244
Link

Storage of raw MRI dataLinkds000244
Link

Data organization: BIDS Specification

Analysis pipelineAnalysis pipeline
Python package of the IBC analysis pipeline
available here:
hbp-brain-charting/public
hbp-brain-charting/public analysis
analysis codecodePublication of data descriptor

doi.org/10.1038/sdata.2018.105
doi.org/10.1038/sdata.2018.105

Results

Post-processed data

Collection id=4438
LinkGroup-level z-maps
qFDR < 0.05

Post-processed data

Collection id=4438
LinkGroup-level z-maps
qFDR < 0.05

Brain coverage

pFWE < 0.05

Group-level F-map

80
40
0-40

x=-43

x=-28

x=-13

x=12x=27

Comprehensive brain coverage of functional activity
already in the first release!

-80Activation similarity fits task similarity

archi standard

1

archi standard

archi emotional
hcp language
hcp social
hcp gamblinghcp motor
hcp emotion
hcp relational
hcp wmarchi emotional
hcp language
hcp social
hcp gamblinghcp motor
hcp emotion
hcp relationalhcp wm

rsvp language

0 rsvp languagearcharchii stanarch dardi sp
arc atialarch hi socihcpi emo all tihcphacpnguoangal
gamsoc e
hc b ial
hhcpcp epmmolitnog
rela otio r
ti nh onalrsvp cp wm
languagearchi spatialarchi social

stanarch dardi sparch atialarch i socihcpi emo all tihcphacpnguoangal
gamsoc e
hc b ial
hhcpcp epmmolitnog
rela otio r
ti nh onalrsvp cp wm
languagearchi spatialarchi social

10IBC reproduces ARCHI and HCP

nmreltio
acter-inial
soc

ARCHI contrasts
0.8
0.6
0.4
0.2

IBC contrasts

HCP contrasts

otipuonni vs srigthonsghe.mratnory
ati
ont u dal fa riglheft ffooet vesnt ovmvs. mpro ce le t h oo v . a s. mo at
ce imft handt vss. any rewtioh
sanm nhotosinaggend vs.. any motard
riz senon ten pflacoel imvs.vs.vss. aanyy mootiioon
tal s ce bac imagvis hany m tionoeoemcehec nternead dy iimaagee vusa. lpme mo ottiionn
ntaker ce ing mage vs. an atutlion
cngbv
yral
soc olbeft suboar eadvs. 2-eb vss. any imhinge
ial jecor r trad vslefingsen ac . anny imaage-in t g igh cti . vt h vs te k v y im ge
ex faltseraras t h on ertand. cnhces. 0imaage
pre e- ct pinan vs ica v ec lis -b ge
ssifalsbelion g vd v sa.cse l csh. r kertenackon e-bief m s. s. hcante ecigh bo ing
faicnteeliestoortioonrieanddesncekertbhaarde tntiof tay v vsnta pavs. reaoand
rus n le s. m. r tio lm fix di rd
ty vs. vs. ecandn ju or atingvs. ge m ha omdg baon
gendeechnis mmecknd r aan tic oti nt
er ssist st on
asses ic tory
esssm alemeentnt

story vs. mathsocial-interaction motion vs. random motion
punishement vs. reward
tongue vs. any motion
right foot vs. any motion
left foot vs. any motion
right hand vs. any motion
left hand vs. any motion
face image vs. shape outline
relational processing vs. visual matchingtool image vs. any image
place image vs. any image
face image vs. any image
body image vs. any image
2-back vs. 0-backsentence reading vs. sentence listening
sentence reading vs. checkerboard
left hand vs. right handhorizontal checkerboard vs. vertical checkerboard
mental subtraction vs. sentence reading
saccades vs. fixation
left or right hand vs. hand palm or backobject grasping vs. orientation judgment
social-interaction motion vs. random motion
false-belief story vs. mechanistic story
false-belief tale vs. mechanistic tale
expression intention vs. gender assessment
face trusty vs. gender assessment

0.00.20.40.6

Variability of Functional Signatures

Group-level z-maps
qFDR < 0.05

Variability of Functional Signatures
read sentence vs. read words
read sentence vs. read jabberwocky
read words vs. read pseudowords
punishement vs. reward

read words vs. consonant strings

face image vs. shape outline

read pseudowords vs. consonant strings

face trusty vs. gender assessment

2-back vs. 0-back

expression intention vs. gender assessment

body image vs. any image

false-belief tale vs. mechanistic tale

face image vs. any image

false-belief story vs. mechanistic story

place image vs. any imagesocial-interaction motion vs. random motion

tool image vs. any image

object grasping vs. orientation judgment

social-interaction motion vs. random motion

left or right hand vs. hand palm or backrelational processing vs. visual matchingsaccades vs. fixation

story vs. mathmental subtraction vs. sentence readingleft hand vs. any motion

horizontal checkerboard vs. vertical checkerboard

right hand vs. any motion

left hand vs. right handleft foot vs. any motion

sentence reading vs. checkerboard

right foot vs. any motion

sentence reading vs. sentence listening
0.00.1

0.2

0.3

0.4

tongue vs. any motion
0.0

0.1

0.2

Average and standard deviation of map correlation across subjects

0.3

0.4

Effect of subject and task on brain activity
qFDR < 0.05

Group-level z-maps
Subject effect
LLRR

28
140-14y=-50

x=10Condition effect
Lz=10LR-28

R37
190-19y=-50

x=10z=10-37

Effect of subject and task on brain activity
qFDR < 0.05Group-level z-maps
Subject effect
LLRR

28
140-14y=-50x=10-28
I IBC data suitable forz=10
cognitive andindividual-brain modeling!

Condition effect
LLRR

37
190-19y=-50

x=10z=10-37

Future releases

Next release is coming up soon!
I Passive-Watching of Naturalistic Scenes
I Retinotopy
I Movie WatchingFuture releases

Next release is coming up soon!
I Passive-Watching of Naturalistic Scenes
I Retinotopy
I Movie Watching

Other releases:
I Anatomical data + Resting-StateI Chronesthesia, Positive-Incentive Value, Theory-of-Mind, VisualShort-Term Memory, Enumeration, Self-Reference Effect,Tonotopy and more...

Concluding remarks
I Data acquisition till 2022

Concluding remarks
I Data acquisition till 2022
I Final dataset: 50 acquisitions per participant

Concluding remarks
I Data acquisition till 2022
I Final dataset: 50 acquisitions per participant
I Encoding models for cognitive mapping

Thanks!

Bertrand Thirion...and to
the IBC volunteers!!!

Thanks!

Bertrand Thirion...and to
the IBC volunteers!!!