# Presentation of the project 'Narps Open Pipeline'

Jeremy Lefort-Besnard, Camille Maumet, Boris Clenet, Elodie Germani

## ► To cite this version:

Jeremy Lefort-Besnard, Camille Maumet, Boris Clenet, Elodie Germani. Presentation of the project 'Narps Open Pipeline'. 2023 - Neuro Openscience Workshop, Nov 2023, Paris, France. 2023. hal-04286609

HAL Id: hal-04286609

https://inria.hal.science/hal-04286609v1

Submitted on 15 Nov 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons CC BY 4.0 - Attribution - International License
<figure><img src="image_2.png" /></figure>

NARPS

Open Pipelines Project

<figure><img src="image_3.png" /><figcaption>Camille
Maumet</figcaption></figure>

<figure><img src="image_4.png" /><figcaption>Boris
Clenet</figcaption></figure>

<figure><img src="image_5.png" /><figcaption>Elodie
Germani Lefort-Besnard
Jeremy</figcaption></figure>

<figure><img src="image_6.png" /></figure>
Analytical variability has often been overlooked assuming it was negligible compared to other sources of variability

<figure><img src="image_7.png" /></figure>
Analytical variability has often been overlooked assuming it was negligible compared to other sources of variability

<figure><img src="image_8.png" /></figure>

In 2020 a landmark paper in Nature challenged this status-quo:

nature

Explore content v

About the journal v

Publish with us v

Subscribe

nature > articles > article

Article | Published: 20 May 2020

**Variability in the analysis of a single neuroimaging dataset by many teams**

Rotem Botvinik-Nezer, Felix Holzmeister, Colin F. Camerer, Anna Dreber, Juergen Huber, Magnus

Johannesson, Michael Kirchler, Roni Iwanir, Jeanette A. Mumford, R. Alison Adcock, Paolo Avesani, Blazej

M. Baczkowski, Aahana Bajracharya, Leah Bakst, Sheryl Ball, Marco Barilari, Nadège Bault, Derek Beaton,

Julia Beitner, Roland G. Benoit, Ruud M. W. J. Berkers, Jamil P. Bhanji, Bharat B. Biswal, Sebastian

Bobadilla-Suarez, ... Tom Schonberg

+ Show authors

Nature 582, 84–88 (2020) | Cite this article

55k

Accesses

427

Citations

2057

Altmetric

Metrics
Analytical variability has often been overlooked assuming it was negligible compared to other sources of variability

In 2020 a landmark paper in Nature challenged this status-quo:

<figure><img src="image_9.png" /></figure>

nature

Explore content v

About the journal v

Publish with us v

Subscribe

nature > articles > article

Article | Published: 20 May 2020

**Variability in the analysis of a single neuroimaging dataset by many teams**

Rotem Botvinik-Nezer, Felix Holzmeister, Colin F. Camerer, Anna Dreber, Juergen Huber, Magnus Johannesson, Michael Kirchler, Roni Iwanir, Jeanette A. Mumford, R. Alison Adcock, Paolo Avesani, Blazej M. Baczkowski, Aahana Bajracharya, Leah Bakst, Sheryl Ball, Marco Barilari, Nadège Bault, Derek Beaton, Julia Beitner, Roland G. Benoit, Ruud M. W. J. Berkers, Jamil P. Bhanji, Bharat B. Biswal, Sebastian Bobadilla-Suarez, ... Tom Schonberg 🐭 + Show authors

Johannesson, Michael Kirchler, Roni Iwanir, Jeanette A. Mumford, R. Alison Adcock, Paolo Avesani, Blazej M. Baczkowski, Aahana Bajracharya, Leah Bakst, Sheryl Ball, Marco Barilari, Nadège Bault, Derek Beaton,

Julia Beitner, Roland G. Benoit, Ruud M. W. J. Berkers, Jamil P. Bhanji, Bharat B. Biswal, Sebastian Bobadilla-Suarez, ... Tom Schonberg 🐭

Bobadilla-Suarez, ... Tom Schonberg 🐭 + Show authors

Nature 582, 84–88 (2020) | Cite this article

<figure><img src="image_10.png" /></figure>

Nature 582, 84–88 (2020) | Cite this article

55k

Accesses

427 Citations

2057

Altmetric

Metrics

70 expert teams (200 scientists) – Same yes/no research questions – Same dataset
Each team built a different pipeline
Each team built a different pipeline

Differences in pipelines led to contradictory findings
Each team built a different pipeline

Differences in pipelines led to contradictory findings

<figure><img src="image_11.png" /></figure>

Figures from Botvinik-Nezer, R., Holzmeister, F., Camerer, C.F. et al. Variability in the analysis of a single neuroimaging dataset by many teams. Nature 582, 84–88 (2020). https://doi.org/10.1038/s41586-020-2314-9
Each team built a different pipeline

Differences in pipelines led to contradictory findings

<figure><img src="image_12.png" /></figure>

Figures from Botvinik-Nezer, R., Holzmeister, F., Camerer, C.F. et al. *Variability in the analysis of a single neuroimaging dataset by many teams*. Nature 582, 84–88 (2020). https://doi.org/10.1038/s41586-020-2314-9
<figure><img src="image_13.png" /></figure>

NARPS

Open Pipelines Project

Create a codebase reproducing the 70 pipelines of the NARPS study and share
this as an open resource for the community
<figure><img src="image_14.png" /></figure>

NARPS

Open Pipelines Project

Create a codebase reproducing the 70 pipelines of the NARPS study and share
this as an open resource for the community

<figure><img src="image_15.png" /></figure>

Github.com/Inria-Empenn/narps_open_pipelines
<figure><img src="image_16.png" /></figure>

## Github.com/Inria-Empenn/narps_open_pipelines

Use a NARPS pipeline for your project:

<figure><img src="image_17.png" /></figure>
<figure><img src="image_18.png" /></figure>

## Github.com/Inria-Empenn/narps_open_pipelines

Use a NARPS pipeline for your project:

<figure><img src="image_19.png" /></figure>

Contribute to NARPS Open Pipelines:

<figure><img src="image_20.png" /></figure>

<figure><img src="image_21.png" /></figure>
<figure><img src="image_22.png" /></figure>

NARPS

Open Pipelines Project

<figure><img src="image_23.png" /><figcaption>Camille
Maumet</figcaption></figure>

<figure><img src="image_24.png" /><figcaption>Boris
Clenet</figcaption></figure>

<figure><img src="image_25.png" /><figcaption>Elodie
Germani</figcaption></figure>

<figure><img src="image_26.png" /><figcaption>Jeremy
Lefort-Besnard</figcaption></figure>

This project is supported by Région Bretagne (Boost MIND) and by Inria (Exploratory action GRASP)
<figure><img src="image_27.png" /></figure>

<figure><img src="image_28.png" /><figcaption>Camille
Maumet</figcaption></figure>

<figure><img src="image_29.png" /><figcaption>Boris
Clenet</figcaption></figure>

<figure><img src="image_30.png" /><figcaption>Elodie
Germani</figcaption></figure>

<figure><img src="image_31.png" /><figcaption>Jeremy
Lefort-Besnard</figcaption></figure>

This project is supported by Région Bretagne (Boost MIND) and by Inria (Exploratory action GRASP)

This project receives contributions by Rémi Gau and during events such as OHBM Brainhack 2022 and 2023, e-ReproNim FENS NENS Cluster Brainhack 2023, ORIGAMI lab hackathon 2023 by :
Arshitha Basavaraj, Trang Cao, Anna Menacher, Liz Bushby, Michael Dayan, Aimee Westbrook, Yaroslav Halchenko, Paul Taylor
<figure><img src="image_32.png" /></figure>

NARPS

Open Pipelines Project

<figure><img src="image_33.png" /><figcaption>Camille
Maumet</figcaption></figure>

<figure><img src="image_34.png" /><figcaption>Boris
Clenet</figcaption></figure>

<figure><img src="image_35.png" /><figcaption>Elodie
Germani</figcaption></figure>

<figure><img src="image_36.png" /><figcaption>Jeremy
Lefort-Besnard</figcaption></figure>

This project is supported by Région Bretagne (Boost MIND) and by Inria (Exploratory action GRASP)

This project receives contributions by Rémi Gau and during events such as OHBM Brainhack 2022 and 2023, e-ReproNim FENS NENS Cluster Brainhack 2023, ORIGAMI lab hackathon 2023 by :

Arshitha Basavaraj, Trang Cao, Anna Menacher, Liz Bushby, Michael Dayan, Aimee Westbrook, Yaroslav Halchenko, Paul Taylor

Come meet us and/or contribute during our next brainhack sessions:

- Monthly Narps Open hours

- Marseille brainhack 2023

- OHBM brainhack 2024