Proceedings of the OHBM Brainhack 2022

Stefano Moia, Hao-Ting Wang, Anibal S. Heinsfeld, Dorota Jarecka, Yu Fang

Yang, Stephan Heunis, Michele Svanera, Benjamin De Leener, Andrea

Gondová, Sin Kim, et al.

► To cite this version:

Stefano Moia, Hao-Ting Wang, Anibal S. Heinsfeld, Dorota Jarecka, Yu Fang Yang, et al. Proceedings of the OHBM Brainhack 2022. OHBM Brainhack 2022, Jun 2022, Glasgow and online, France. Aperture Neuro, 2024, 10.52294/001c.92760. http://hal-04478342v2

HAL Id: hal-04478342

https://inria.hal.science/hal-04478342v2

Submitted on 4 Apr 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
Proceedings of the OHBM Brainhack 2022

Stefano Moia¹,²,*, Hao-Ting Wang³, Anibal S. Heinsfeld⁴,⁵, Dorota Jarecka⁶, Yu Fang Yang⁷, Stephan Heunis⁸, Michele Svanera⁹, Benjamin De Leener¹⁰,¹¹,¹², Andrea Gondová¹³,¹⁴, Sin Kim¹⁵, Arshitha Basavaraj¹⁶, Johanna M.M. Bayer¹⁷,¹⁸, Roza G. Bayrak¹⁹, Pierre-Louis Bazin²⁰,²¹, Isil Poyraz Bilgin³,²², Steffen Bollmann²³,²⁴, Daniel Borek²⁵, Valentina Borghesani²⁶, Trang Cao²⁷, Gang Chen²⁸, Alejandro De La Vega²⁹, Sebastian Dresbach³⁰, Philipp Ehses³¹, Jan Ernsting³²,³³,³⁴, Inès Esteves³⁵, Oscar Ferrante³⁶, Kelly G. Garner³⁷, Rémi Gau³⁸, Elodie Germani³⁹, Tara Ghafari³⁶, Satrajit S. Ghosh⁶,⁴⁰, Sarah E. Goodale⁴¹, Cassandra D. Gould van Praag⁴²,⁴³, Samuel Guay⁴⁴, Omer Faruk Gulban³⁰,⁴⁵, Yaroslav O. Halchenko⁴⁶, Michael Hanke⁸,⁴⁷, Peer Herholz⁴⁸, Katja Heuer⁴⁹, Felix Hoffstaedter⁵⁰,⁵¹, Ruoqi Huang⁵², Renzo Huber⁵³, Ole Jensen⁵⁶, Kan Keeratimahat⁵⁴, Julian Q. Kosciessa⁵⁵, Sladjana Lukic⁵⁶, Neville Magielse⁵⁷,⁵⁸,⁵⁹, Christopher J. Markiewicz⁶⁰, Caroline G. Martin⁶¹, Camille Maumet³⁹, Anna Menacher⁶², Jeff Mentch⁶,⁶³, Christian Mönch⁶⁴, Shammi More⁸,⁴⁷, Leonardo Muller-Rodriguez⁶⁵,⁶⁶, Samuel A. Nastase⁶⁷, Eliana Nicolaisen-Sobesky⁸, Dylan M. Nielson⁶⁸, Christopher R. Nolan³⁷, François Paugam⁶⁹,⁷⁰, Pedro Pinheiro-Chagas⁷¹, Ana Luísa Pinho⁷²,⁷³, Alessandra Pizzuti⁵³,⁷⁴, Benjamin Poldrack⁶⁵, Benedikt A. Poser⁵³, Roberta Rocca⁷⁵, Jacob Sanz-Robinson⁷⁶, Kelvin Sarink³³, Kevin R. Sitek⁷⁷, Nadine Spychala⁷⁸, Rüdiger Stirnberg³¹, Michał Szczepanik⁸, Mohammad Torabi⁷⁹, Roberto Toro⁸⁰, Sebastian G.W. Urchs⁸¹, Sofie L. Valk²¹,⁸²,⁸³, Adina S. Wagner⁸,⁸⁴, Laura K. Waite⁸, Alexander Q. Waite⁸, Lea Waller⁸⁵, Tyler J. Wishard⁸⁶,⁸⁷, Jianxiao Wu⁸,⁴⁷, Yuchen Zhou⁸⁸, Janine D. Bijsterbosch⁸⁹, The Physioly Community

¹ Neuro-X Institute, École Polytechnique Fédérale de Lausanne, ² Department of Radiology and Medical Informatics, Faculty of Medicine, University of Geneva, ³ Centre de recherche de l'Institut universitaire de gériatrie de Montréal, ⁴ Department of Psychology, Center for Perceptual Systems, The University of Texas at Austin, ⁵ Department of Computer Science, The University of Texas at Austin, ⁶ McGovern Institute for Brain Research, Massachusetts Institute of Technology, ⁷ Division of Experimental Psychology and Neuropsychology, Department of Education and Psychology, Freie Universität Berlin, ⁸ Institute of Neuroscience and Medicine, Research Centre Jülich, ⁹ Centre for Cognitive Neuroimaging, School of Psychology & Neuroscience University of Glasgow, ¹⁰ Institute of Biomedical Engineering, Polytechnique Montreal, ¹¹ CHU Sainte-Justine Research Center, University of Montreal, ¹² Department of Computer Engineering and Software Engineering, Polytechnique Montreal, ¹³ UNIACT, NeuroSpin, CEA, Université Paris-Saclay, ¹⁴ NeuroDiderot, Inserm, Université Paris Cité, ¹⁵ Brain and Cognitive Engineering, Korea Advanced Institute of Science and Technology, ¹⁶ Data Science and Sharing Team (DSST), Intramural Research Program, National Institute of Mental Health, ¹⁷ Centre for Youth Mental Health, University of Melbourne, ¹⁸ Orygen, Melbourne, ¹⁹ Department of Computer Science, Vanderbilt University, ²⁰ University of Amsterdam, ²¹ Max Planck Institute for Human Cognitive and Brain Science, ²² Machine Learning Department and the Neuroscience Institute, Carnegie Mellon University, ²³ School of Information Technology and Electrical Engineering, University of Queensland, ²⁴ Centre for Innovation in Biomedical Imaging Technology, University of Queensland, ²⁵ Department of Data Analysis, Faculty of Psychology and Educational Sciences, Ghent University, ²⁶ Department of Psychology, Faculty of Psychology and Science of Education, University of Geneva, ²⁷ School of Psychological Sciences, Monash University, ²⁸ Scientific and Statistical Computing Core, Department of Health and Human Services, National Institute of Mental Health. ²⁹ Department of Psychology, University of Texas at Austin, ³⁰ Maastricht University, ³¹ German Center for Neurodegenerative Diseases, ³² Institute for Geoinformatics, University of Münster, ³³ Institute for Translational Psychiatry, University of Münster, ³⁴ Faculty of Mathematics and Computer Science, University of Münster, ³⁵ ISR-Lisboa and Department of Bioengineering, Instituto Superior Técnico - Universidade de Lisboa, ³⁶ Centre for Human Brain Health, School of Psychology, University of Birmingham, ³⁷ School of Psychology, The University of New South Wales, ³⁸ Institut de recherche en sciences psychologique, Université catholique de Louvain, ³⁹ Inria, CNRS, University of Rennes, ⁴⁰ Department of Otolaryngology - Head and Neck Surgery, Harvard Medical School, ⁴¹ Department of Biomedical Engineering, Vanderbilt University, ⁴² Alan Turing Institute, ⁴³ Department of Psychiatry, Oxford University, ⁴⁴ Department of Psychology, Université de Montréal, ⁴⁵ Brain Innovation (Netherlands), ⁴⁶ Department of Psychological and Brain Sciences, Dartmouth College, ⁴⁷ Medical Faculty, Heinrich Heine University Düsseldorf, ⁴⁸ Montreal Neurological Institute and Hospital, McGill University, ⁴⁹ Institut Pasteur, Université Paris Cité, ⁵⁰ Institute of Neuroscience and Medicine (INM-7), Research Centre Jülich, ⁵¹ Institute of Systems Neuroscience, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, ⁵² University of Toronto, ⁵³ Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, ⁵⁴ Nuffield Department of Population Health, University of Oxford, ⁵⁵ Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, ⁵⁶ Ruth S. Ammon College of Education and Health Sciences, Department of Communication Sciences and Disorders, Adelphi University, ⁵⁷ Institute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Center Jülich, ⁵⁸ Otto Hahn Cognitive Neurogenetics Group, Max Planck Institute for Human Cognitive and Brain Sciences, ⁵⁹ Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, ⁶⁰ Stanford University, ⁶¹ Vanderbilt University, ⁶² Department of Statistics, University of Oxford, ⁶³ Program in Speech and Hearing Bioscience and Technology, Harvard University, ⁶⁴ Research Center Jülich, ⁶⁵ Psychoinformatics Lab, Forschungszentrum Julich, ⁶⁶ Cambridge Institute for Music Therapy Research, Anglia Ruskin University, ⁶⁷ Princeton Neuroscience Institute, Princeton University, ⁶⁸ Machine Learning Team, National Institute of Mental Health, ⁶⁹ University of Montreal, ⁷⁰ Mila - Quebec Artificial Intelligence Institute, ⁷¹ Department of Neurology, Memory and Aging Center, University of California, ⁷² Western Institute for Neuroscience, Western University, ⁷³ Department of Computer Science, Faculty of Science, Western University, ⁷⁴ Brain Innovation, Maastricht, ⁷⁵ Department of Culture, Cognition, and Computation, School of Culture and Society, Aarhus University, ⁷⁶ Neuroscience, McGill University, ⁷⁷ Department of Communication Science and Disorders, School of Health and Rehabilitation Sciences, University of Pittsburgh, ⁷⁸ Department of Informatics, University of Sussex, ⁷⁹ Graduate Program in Biological and Biomedical Engineering, McGill University, ⁸⁰ Unité de Neuroanatomie Appliquée et Théorique, Institut Pasteur, Université Paris Cité, ⁸¹ NeuroDataSciene - ORIGAMI lab, Montreal Neurological Institute-Hospital, McGill University, ⁸² Institute of Neuroscience and Medicine (INM-7: Brain & Behaviour), Research Centre Jülich, ⁸³ Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, ⁸⁴ Department of Psychology, Heinrich Heine University Düsseldorf, ⁸⁵ Department of Psychiatry and Neurosciences CCM, Charité Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, ⁸⁶ Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, ⁸⁷ Department of Neurology, Washington University in St. Louis, ⁸⁸ Department of Psychology, Carnegie Mellon University, ⁸⁹ Department of Radiology, Washington University in St. Louis

<footnote>a Corresponding Author
Stefano Moia
s.moia.research@gmail.com</footnote>
OHBM Brainhack 2022 took place in June 2022. The first hybrid OHBM hackathon, it had an in-person component taking place in Glasgow and three hubs around the globe to improve inclusivity and fit as many timezones as possible. In the buzzing setting of the Queen Margaret Union and of the virtual platform, 23 projects were presented after development. Following are the reports of 14 of those, as well as a recapitulation of the organisation of the event.

## INTRODUCTION

The Organisation of Human Brain Mapping BrainHack (shortened to OHBM Brainhack herein) is a yearly satellite event of the main OHBM meeting, organised by the Open Science Special Interest Group following the model of Brainhack hackathons.¹ Where other hackathons set up a competitive environment based on outperforming other participants' projects, Brainhacks foster a collaborative environment in which participants can freely collaborate and exchange ideas within and between projects.

This edition of the OHBM Brainhack, that ran across the world over four days, was particularly special for two reasons: it celebrated the tenth year anniversary of Brainhack, and, like the main OHBM conference, it was the first edition to feature an in-person event after two years of virtual events. For this reasons, the whole organisation rotated around five main principles:

1. Providing a hybrid event incorporating the positive aspects of in-person and virtual events alike,

2. Celebrating the 10th anniversary of the Brainhack by bringing back newcomer-friendly hands-on hacking and learning experience, enhancing the Hacktrack and formatting the Traintrack as a collection of materials to consult beforehand and as spontaneous meetings of the participants aimed to learn together,

3. Bridging the gap between the Brainhack community and the main neuroimaging software developer groups, e.g. AFNI, FSL, SPM,

4. Due to amount of work required to meet the previous three principles, incorporating from the beginning a team of core organisers with a democratic approach to organisation, with a member in charge of an aspect of the event,

5. Brainhack event organisation should always be experimental, trying different solutions and formats to find a way to improve Brainhack events overall.

After a quick explanation of each main contribution of the core team, the next pages are dedicated to the summaries of the projects that were developed during the four days of hacking.

## 1. HACKTRACK

Dorota Jarecka, Yu-Fang Yang, Hao-Ting Wang, Stefano Moia

The key component of each Brainhack is hacking. The hacking part, known as hacktrack, is where attendees collaborate on projects and explore their own ideas. There are 4 elements of hacktrack that were organised: project submission, project pitch, hacking period and project summary. For the project submission, we used the GitHub issue submission process that was used during recent years. We updated and simplified a project template from previous years and asked project leaders to open an issue for each project. Each issue after quick check was approved by the moderators and automatic workflows written by the team were responsible for sending project descriptions to the Brainhack page and setting Discord's channels. We received 38 projects that were submitted using this system. The project pitch was set for the morning of the first day and everyone had 2 minutes to talk about the suggested project and possible collaborations. After the pitches people had a chance to talk to each other and join the projects they were interested in. This year, we tried to maximise the time for hacking by providing a sparse schedule for talks.

The closing ceremony of the Brainhack featured 23 project reports, in which teams talked about their experiences and described the work they accomplished.

This edition we allowed remote attendance from other locations. We organised three hubs aiming to cover all time zones, including 1) Asia-Pacific, 2) Glasgow, Europe, Middle East, and Africa, and 3) the Americas, to foster inclusiveness in the hybrid conference format. We also ensured that each hub had one live streamed session with the physical hub in Glasgow.

## 2. TRAINTRACK

Yu-Fang Yang, Dorota Jarecka

Traintrack is the educational component of Brainhack events. The aim is to introduce tools and skills for attendees to start hacking. Unlike conventional scientific educational workshops centred around lectures and talks, data science skills are better learned through hands-on experience than lectures. With the Brainhack community growing mature,
the community has developed their own curated educa-
tional material. *Brainhack School* has supplied high-quality
content for independent study on a variety of themes.

This year, we combine the collaborative nature of brain-
hack projects and educational content to reimagine the for-
mat of traintack. Thus, we replaced tutorial lectures in the
previous editions with curated online educational contents,
released them prior to the main event, and attempted to
integrate them with the hacktrack projects. This format
also provides more time (i.e. schedule) and space (i.e. min-
imising large space not used for hacking) for attendees to
self-organise. Participants were encouraged to form study
groups on five suggested topics: 1) setting up your system
for analysis 2) python for data analysis, 3) machine learning
for neuroimaging, 4) version control systems, 5) cloud re-
source. The curated content was advertised on the main
hackathon website. One dedicated channel was created on
the hackathon Discord server. Individuals could determine
the nature of their experiences and the skills they liked to
acquire. Participants could form their own study group and
on any selected topic. We would like to continue the exper-
imentation on this format in the coming year.

3. PLATFORMS, WEBSITE, AND IT

Anibal Solon Heinsfeld

Trying to bring a positive experience for both virtual and in-person attendees, we implemented several integrated solutions to ease communication in the different phases of the Hackathon, focusing on a single platform for the main event.

The first solution was the project's advertisement, in which the community promotes their projects, the goals for the Hackathon, and relevant information to get people interested and set to collaborate. To do so, we used the Github Issues feature in the Hackathon repository as the entrance for projects. Github Issues has been proven to be accepted by the community that relies on Github for code versioning, and was a successful approach in past hackathons.

In this edition, we were able to use Github Issue forms, a beta feature in Github. Past use of issues for project registration relies on Markdown code to specify which information the hacker needs to provide. However, the code can be easily broken and changed, which makes it harder to parse the information in automated setups. Towards this issue, the Issue Form can lower the barrier when submitting a project. By specifying form fields for the participants to fill, they faced a common web form instead of a Markdown editor, bringing more structure to their inputs and not requiring them to write code. After the organisers' quick validation, the project information was provided to the rest of the system. Per an automated pipeline, this information was compiled into the website.

The second solution was the central platform for real-
time communication, namely Discord. For the first time us-
ing the platform for an OHBM Hackathon, Discord showed
potential in bringing an all-in-one solution. Its track record

with different communities and their formats was an es-
sential prospect for the success of a hybrid hackathon, to-
gether with the different ways of communicating provided
by the platform. Specifically, Discord offered chat and au-
dio/video channels, with fine-tuned controls on permis-
sions to see a channel, speak and use the camera, and send
messages. With these features, we were able to create ex-
periences for the attendants, such as text channels for con-
solidating information about the hackathon, main stages
controlled by the hub hosts, a channel to join projects and
hubs, and integrated text & voice channels for each project.
The main stage was connected to a laptop in the venue,
providing synchronous streaming for announcements, pro-
ject pitches and progress reports for those participating vir-
tually. The project channels were automatically created to-
gether with the Github Issues. However, given the thriving
number of projects, the Discord server was replete with
project channels. Such a scenario was overwhelming for
the attendants, especially for those approaching Discord
for the first time. To ameliorate this issue, a main projects
channel was created, so attendants could automatically join
projects via related emoji reactions. The project channels
were of public access; however, only displayed upon joining
the project. Besides initial technical hiccups, the platform
proved a good alternative for such an event format.

These integrated solutions smoothed the organisation of
the event, the virtual platform provided great support for
the on-line participants. However, there was not a lot of in-
teraction between in-person and online participants, and
projects were mainly either virtual or in-person (with few
exceptions). This is probably because hybrid hacking pro-
vides challenges for organisation and attendants alike, even
just in the physical limitations of being able to have a video
conference with a split team. It is important to consider,
however, that this was also the first in-person event for
many participants, who preferred in-person interaction and
collaboration rather than the same on-line interaction that
characterised such events in the previous two years.

4. PROJECT REPORTS

The peculiar nature of a Brainhack¹ reflects in the nature of
the projects developed during the event, that can span very
different types of tasks. While most projects feature more
'hackathon-style' software development, in the form of im-
proving software integration (Section 4.4), API refactoring
(Section 4.11), or creation of new toolboxes and platforms
(Sections 4.9, 4.10 and 4.13), the inclusion of newcomers
and participants with less strong software development
skills can foster projects oriented to user testing (Sections
4.3 and 4.9) or documentation compilation (Section 4.12).
The scientific scopes of Brainhacks were reflected in projects revolving around data exploration (Sections 4.1 and 4.7) or model development (Section 4.13), or adding aspects of open science practices (namely, the Brain Imaging Data Structure) to toolboxes (Sections 4.6 and 4.14). Finally, fostering a collaborative environment and avoiding pitching projects against each others not only opens up the possibility for participants to fluidly move between different
groups, but also to have projects which sole aim is support-
ing other projects (Section 4.2), learning new skills with en-
tertaining tasks (Section 4.5), or fostering discussions and
conversations among participants to improve the adoption
of open science practices (Section 4.8).

Following are the 14 submitted reports of the 23 projects
presented at project wrap-up during the OHBM Brainhack.

4.1. EXPLORING THE AHEAD BRAINS TOGETHER

Alessandra Pizzuti, Sebastian Dresbach, Satrajit Ghosh,
Katja Heuer, Roberto Toro, Pierre-Louis Bazin

4.1.1. INTRODUCTION

One of the long-standing goals of neuroanatomy is to com-
pare the cyto- and myeloarchitecture of the human brain.
The recently made available 3D whole-brain post-mortem
data set provided by Alkemade and colleagues² includes
multiple microscopy contrasts and 7-T quantitative multi-
parameter MRI reconstructed at 200µm from two human
brains. Through the co-registration across MRI and mi-
croscopy modalities, this data set provides a unique direct
comparison between histological markers and quantitative
MRI parameters for the same human brain. In this Brain-
Hack project, we explored this dataset, focusing on: (i) data
visualization in online open science platforms, (ii) data in-
tegration of quantitative MRI with microscopy, (iii) data
analysis of cortical profiles from a selected region of inter-
est.

4.1.2. RESULTS

Visualization and annotation of large neuroimaging data
sets can be challenging, in particular for collaborative data
exploration. Here we tested two different infrastructures:

BrainBox https://brainbox.pasteur.fr/, a web-based visual-
alization and annotation tool for collaborative manual de-
lineation of brain MRI data, see e.g. Heuer and colleagues,³
and Dandi Archive https://dandiarchive.org/, an online
repository of microscopy data with links to Neuroglancer
https://github.com/google/neuroglancer. While Brainbox
could not handle the high resolution data well, Neu-
roglancer visualization was successful after conversion to
the Zarr microscopy format (Figure 1A).

To help users explore the original high-resolution mi-
croscopy sections, we also built a python notebook to auto-
matically query the stains around a given MNI coordinate
using the Nighres toolbox⁴ (Figure 1B).

For the cortical profile analysis we restricted our analysis
on S1 (BA3b) as a part of the somato-motor area from one
hemisphere of an individual human brain. S1 is rather thin
(~2mm) and it has a highly myelinated layer 4 (see arrow
Figure 1C). In a future step, we are aiming to characterize
differences between S1 (BA3b) and M1 (BA4). For now, we
used the MRI-quantitative-R1 contrast to define, segment
the region of interest and compute cortical depth mea-
surement. In ITK-SNAP⁵ we defined the somato-motor area
by creating a spherical mask (radius 16.35mm) around the
'hand knob' in M1. To improve the intensity homogeneity

of the qMRI-R1 images, we ran a bias field correction (N4Bi-
asFieldCorrection,⁶). Tissue segmentation was restricted to
S1 and was obtained by combining four approaches: (i) fsl-
fast⁷ for initial tissues probability map, (ii) semiautomatic
histogram fitting in ITK-SNAP, (iii) Segmentator,⁸ and (iv)
manual editing. We used the LN2 LAYERS program from
LAYNII open source software⁹ to compute the equi-vol-
ume cortical depth measurements for the gray matter. Fi-
nally, we evaluated cortical depth profiles for three quan-
titative MRI contrasts (R1, R2, proton density) and three
microscopy contrasts (thionin, bieloschowsky, parvalbu-
min) by computing a voxel-wise 2D histogram of image in-
tensity (Figure 1C). Some challenges are indicated by ar-
rows 2 and 3 in the lower part of Figure 1C.

From this Brainhack project, we conclude that the rich-
ness of the data set must be exploited from multiple points
of view, from enhancing the integration of MRI with mi-
croscopy data in visualization software to providing op-
timized multi-contrast and multi-modality data analysis
pipeline for high-resolution brain regions.

4.2. BRAINHACK CLOUD

Steffen Bollmann, Isil Poyraz Bilgin, Peer Herholz, Rémi Gau, Samuel Guay, Johanna Bayer

Today's neuroscientific research deals with vast amounts
of electrophysiological, neuroimaging and behavioural
data. The progress in the field is enabled by the widespread
availability of powerful computing and storage resources.
Cloud computing in particular offers the opportunity to
flexibly scale resources and it enables global collaboration
across institutions. However, cloud computing is currently
not widely used in the neuroscience field, although it could
provide important scientific, economical, and environmen-
tal gains considering its effect in collaboration and sus-
tainability.¹⁰,¹¹ One problem is the availability of cloud
resources for researchers, because Universities commonly
only provide on-premise high performance computing re-
sources. The second problem is that many researchers lack
the knowledge on how to efficiently use cloud resources.
This project aims to address both problems by providing
free access to cloud resources for the brain imaging com-
munity and by providing targeted training and support.

A team of brainhack volunteers (https://brainhack.org/
brainhack cloud/admins/ team/) applied for Oracle Cloud
Credits to support open-source projects in and around
brainhack with cloud resources. The project was generously
funded by Oracle Cloud for Research¹² with $230,000.00
AUD from the 29th of January 2022 until the 28th of Jan-
uary 2024. To facilitate the uptake of cloud computing in
the field, the team built several resources (https://brain-
hack.org/brainhack cloud/tutorials/) to lower the entry bar-
riers for members of the Brainhack community.

During the OHBM 2022 Brainhack, the team gave a pre-
sentation to share the capabilities that cloud computing of-
fers to the Brainhack community, how they can place their
resource requests and where they can get help. In total 11
projects were onboarded to the cloud and supported in their
specific use cases: One team utilised the latest GPU archi-
<figure><img src="image_2.png" /><figcaption>Figure 1. A) Neuroglancer visualization, B) section query notebook, C) Cortical ROI and corresponding depth histograms extracted from the different contrasts available.</figcaption></figure>

tecture to take part in the Anatomical Tracings of Lesions After Stroke Grand Challenge. Others developed continuous integration tests for their tools using for example a full Slurm HPC cluster in the cloud to test how their tool behaves in such an environment.

Another group deployed the Neurodesk.org¹³ project on a Kubernetes cluster to make it available for a student cohort to learn about neuroimage processing and to get access to all neuroimaging tools via the browser. All projects will have access to these cloud resources until 2024 and we are continuously onboarding new projects onto the cloud (https://brainhack.org/brainhack_cloud/docs/request/).

The Brainhack Cloud team plans to run a series of training modules in various Brainhack events throughout the year to reach researchers from various backgrounds and increase their familiarity with the resources provided for the community while providing free and fair access to the computational resources. The training modules will cover how to use and access computing and storage resources (e.g., generating SSH keys), to more advanced levels covering the use of cloud native technology like software containers (e.g., Docker/Singularity), container orchestration (e.g., Kubernetes), object storage (e.g, S3), and infrastructure as code (e.g., Terraform).
<figure><img src="image_3.png" /><figcaption>Figure 2. A team of brainhack volunteers, applied for Oracle Cloud Credits to support open source projects in and around brainhack with powerful cloud resources on the Oracle Cloud: https://brainhack.org/brainhack_cloud/</figcaption></figure>

### 4.3. DATALAD CATALOG

Stephan Heunis, Adina S. Wagner, Alexander Q. Waite, Benjamin Poldrack, Christian Mönch, Julian Kosciessa, Laura Waite, Leonardo Muller-Rodriguez, Michael Hanke, Michał Szczepanik, Remi Gau, Yaroslav O. Halchenko

The importance and benefits of making research data Findable, Accessible, Interoperable, and Reusable are clear.¹⁴ But of equal importance is our ethical and legal obligations to protect the personal data privacy of research participants. So we are struck with this apparent contradiction: how can we share our data openly...yet keep it secure and protected?

To address this challenge: structured, linked, and machine-readable metadata presents a powerful opportunity. Metadata provides not only high-level information about our research data (such as study and data acquisition parameters) but also the descriptive aspects of each file in the dataset: such as file paths, sizes, and formats. With this metadata, we can create an abstract representation of the full dataset that is separate from the actual data content. This means that the content can be stored securely, while we openly share the metadata to make our work more FAIR.

In practice, the distributed data management system DataLad¹⁵ and its extensions for metadata handling and catalog generation are capable of delivering such solutions. datalad (https://github.com/datalad/datalad) can be used for decentralised management of data as lightweight, portable and extensible representations. datalad-metalad (https://github.com/datalad/datalad-metalad) can extract structured high- and low-level metadata and associate it with these datasets or with individual files. And at the end

of the workflow, datalad-catalog (https://github.com/datalad/datalad-catalog) can turn the structured metadata into a user-friendly data browser.

This hackathon project focused on the first round of user testing of the alpha version of datalad-catalog, by creating the first ever user-generated catalog (https://jkosciessa.github.io/datalad_cat_test). Further results included a string of new issues focusing on improving user experience, detailed notes on how to generate a catalog from scratch, and code additions to allow the loading of local web-assets so that any generated catalog can also be viewed offline.

### 4.4. DATALAD-DATAVERSE INTEGRATION

Benjamin Poldrack, Jianxiao Wu, Kelvin Sarink, Christopher J. Markiewicz, Alexander Q. Waite, Eliana Nicoïlaisen-Sobesky, Shammie More, Johanna Bayer, Jan Ernsting, Adina S. Wagner, Roza G. Bayrak, Laura K. Waite, Michael Hanke, Nadine Spychala

The FAIR principles¹⁴ advocate to ensure and increase the Findability, Accessibility, Interoperability, and Reusability of research data in order to maximize their impact.

Many open source software tools and services facilitate this aim. Among them is the Dataverse project.¹⁶ Dataverse is open source software for storing and sharing research data, providing technical means for public distribution and archival of digital research data, and their annotation with structured metadata. It is employed by dozens of private or public institutions worldwide for research data management and data publication. DataLad,¹⁵ similarly, is an open source tool for data management and data publication. It provides Git and git-annex based data versioning, prove-
nance tracking, and decentral data distribution as its core features. One of its central development drivers is to provide streamlined interoperability with popular data hosting services to both simplify and robustify data publication and data consumption in a decentralized research data management system.¹⁷ Past developments include integrations with the open science framework¹⁸ or webdav-based services such as sciebo, nextcloud, or the European Open Science Cloud.¹⁹

In this hackathon project, we created a proof-of-principle integration of DataLad with Dataverse in the form of the Python package datalad-dataverse (https://github.com/datalad/datalad-dataverse). From a technical perspective, main achievements include the implementation of a git-an nex special remote protocol for communicating with Data- verse instances, a new create-sibling-dataverse command that is added to the DataLad command-line and Python API by the datalad-dataverse extension, and standard research software engineering aspects of scientific software such as unit tests, continuous integration, and documentation.

From a research data management and user perspective, this development equips DataLad users with the ability to programatically create Dataverse datasets (containers for research data and their metadata on Dataverse) from DataLad datasets (DataLad's Git-repository-based core data structure) in different usage modes. Subsequently, DataLad dataset contents, its version history, or both can be published to the Dataverse dataset via a 'dataLad push' command. Furthermore, published DataLad datasets can be consumed from Dataverse with a 'dataLad clone' call. A mode parameter configures whether Git version history, version controlled file content, or both are published and determines which of several representations the Dataverse dataset takes. A proof-of-principle implementation for metadata annotation allows users to supply metadata in JSON format, but does not obstruct later or additional manual metadata annotation via Dataverse's web interface.

Overall, this project delivered the groundwork for further extending and streamlining data deposition and consumption in the DataLad ecosystem. With DataLad-Dataverse interoperability, users gain easy additional means for data publication, archival, distribution, and retrieval. Post-Brainhack development aims to mature the current alpha version of the software into an initial v0.1 release and distribute it via standard Python package indices.

## 4.5. EXPLODING BRAINS IN JULIA

Ömer Faruk Gülban, Leonardo Muller-Rodriguez

Particle simulations are used to generate visual effects (in movies, games, etc.). In this project, we explore how we can use magnetic resonance imaging (MRI) data to generate interesting visual effects by using (2D) particle simulations. Aside from providing an entertaining avenue to the interested participants, our project has further educational utility. For instance, anatomical MRI data analysis is done in two major frameworks: (1) manipulating fixed regularly spaced points in space (also known as Eulerian point of view), and (2) manipulating moving irregularly spaced

points in space (Lagrangian point of view). For instance, bias field correction is commonly done from Eulerian point of view (e.g. computing a bias field is similar to computing a particle velocity field in each frame of the explosions), whereas cortical surface inflation is commonly done from Lagrangian point of view of the MRI data (e.g. computing the inflated brain surface is similar to computing the new positions of particles in each frame of the explosion). Therefore, our project provides an educational opportunity for those who would like to peek into the deep computational and data structure manipulation aspects of MRI image analysis. We note that we already made two hackathon projects in 2020 (see below) and were first inspired by a blog post (https://nialtl.neocities.org/articles/mpm_guide.html) on the material point method.²⁰⁻²² Our additional aim in Brainhack 2022 is to convert our previous progress in Python programming language to Julia. The reason why we have moved to Julia language is because we wanted to explore this new programming language's potential for developing MRI image analysis methods as it has convenient parallelization methods that speeds-up the particle simulations (and any other advanced image manipulation algorithms).

Our previous efforts are documented at:

1. 2020 OpenMR Benelux: https://github.com/OpenMR-Benelux/openmrb2020-hackathon/issues/7

2. 2020 OHBM Brainhack: https://github.com/ohbm/hackathon2020/issues/124

3. Available within the following github repository: https://github.com/ofgulban/slowest-particle-simulator-on-earth

As a result of this hackathon project, we delivered a video compilation of our animations (Figure 3) which can be seen at https://youtu.be/_5ZDctWv5X4. We highlight that in addition to its educational value, our project provided stress relief by means of entertaining the participants after the pandemic. We believe that our project provides a blueprint for the future brainhacks where MRI science, computation, and education can be disseminated within an engaging and entertaining context. Our future efforts will involve sophisticated the particle simulations, the initial simulation parameters to generate further variations of the visual effects, and potentially synchronizing the simulation effects with musical beats.

<figure><img src="image_4.png" /><figcaption>Figure 3. A video compilation of brain explosions can be seen at https://youtu.be/_5ZDctWv5X4.</figcaption></figure>
## 4.6. FLUX: A PIPELINE FOR MEG ANALYSIS AND BEYOND

Oscar Ferrante, Tara Ghafari, Ole Jensen

FLUX²⁵ is an open-source pipeline for analysing magnetoencephalography (MEG) data. There are several toolboxes developed by the community to analyse MEG data. While these toolboxes provide a wealth of options for analyses, the many degrees of freedom pose a challenge for reproducible research. The aim of FLUX is to make the analyses steps and setting explicit. For instance, FLUX includes the state-of-the-art suggestions for noise cancellation as well as source modelling including pre-whitening and handling of rank-deficient data.

So far, the FLUX pipeline has been developed for MNE-Python²⁴ and FieldTrip²⁵ with a focus on the MEGIN/Elekta system and it includes the associated documents as well as codes. The long-term plan for this pipeline is to make it more flexible and versatile to use. One key motivation for this is to facilitate open science with the larger aim of fostering the replicability of MEG research.

These goals can be achieved in mid-term objectives, such as making the FLUX pipeline fully BIDS compatible and more automated. Another mid-term goal is to containerize the FLUX pipeline and the associated dependencies making it easier to use. Moreover, expanding the applications of this pipeline to other systems like MEG CTF, Optically Pumped Magnetometer (OPM) and EEG will be another crucial step in making FLUX a more generalized neurophysiological data analysis pipeline.

During the 2022 Brainhack, the team focused on incorporating the BIDS standard into the analysis pipeline using MNE_BIDS.²⁶ Consequently, an updated version of FLUX was released after the Brainhack meeting.

## 4.7. EVALUATING DISCREPANCIES IN HIPPOCAMPAL SEGMENTATION PROTOCOLS USING AUTOMATIC PREDICTION OF MRI QUALITY (MRIQC)

Jacob Sanz-Robinson, Mohammad Torabi, Tyler James Wishard

### 4.7.1. INTRODUCTION

Neuroimaging study results can vary significantly depending on the processing pipelines utilized by researchers to run their analyses, contributing to reproducibility issues. Researchers in the field are often faced with multiple choices of pipelines featuring similar capabilities, which may yield different results when applied to the same data.²⁷,²⁸ While these reproducibility issues are increasingly well-documented in the literature, there is little existing research explaining why this inter-pipeline variability occurs or the factors contributing to it. In this project, we set out to understand what data-related factors impact the discrepancy between popular neuroimaging processing pipelines.

### 4.7.2. METHOD

The hippocampus is a structure commonly associated with memory function and dementia, and the left hippocampus is proposed to have higher discriminative power for identifying the progression of Alzheimer's disease than the right hippocampus in multiple studies.²⁹ We obtained left hippocampal volumes using three widely-used neuroimaging pipelines: FSL 5.0.9,³⁰ FreeSurfer 6.0.0,³¹ and ASHS 2.0.0 PMC-T1 atlas.³² We ran the three pipelines on T1 images from 15 subjects from the Prevent-AD Alzheimer's dataset,³³ composed of cognitively healthy participants between the ages of 55-88 years old that are at risk of developing Alzheimer's Disease. We ran MRIQC³⁴ - a tool for performing automatic quality control and extracting quality measures from MRI scans - on the 15 T1 scans and obtained Image Quality Metrics (IQMs) from them. We then found the correlations between the IQMs and the pairwise inter-pipeline discrepancy of the left hippocampal volumes for each T1 scan.

### 4.7.3. RESULTS

We found that for The FSL-FreeSurfer and FSL-ASHs discrepancies, MRIQC's EFC measure produced the highest correlation, of 0.69 and 0.64, respectively. The EFC "uses the Shannon entropy of voxel intensities as an indication of ghosting and blurring induced by head motion".³⁵ No such correlations were found for the ASHS-FreeSurfer discrepancies. Figure 4 shows a scatter plot of the discrepancies in left hippocampal volume and EFC IQM for each pipeline pairing. The preliminary results suggest that FSL's hippocampal segmentation may be sensitive to head motion in T1 scans, leading to larger result discrepancies, but we require larger sample sizes to make meaningful conclusions. The code for our project can be found on GitHub at this link.

### 4.7.4. CONCLUSION AND NEXT STEPS

In this project, we investigated the correlation between MRIQC's IQMs and discrepancies in left hippocampal volume derived from three common neuroimaging pipelines on 15 subjects from the Prevent-AD study dataset. While our preliminary results indicate image ghosting and blurring induced by head motion may play a role in inter-pipeline result discrepancies, the next steps of the project will consist of computing the correlations on the full 308 subjects of the Prevent-AD dataset to investigate whether they persist with the full sample.

## 4.8. ACCELERATING ADOPTION OF METADATA STANDARDS FOR DATASET DESCRIPTORS

Cassandra Gould van Praag, Felix Hoffstaedter, Sebastian Urchs

We have used the space of the brainhack to discuss challenges that are hindering wide adoption of metadata standards in the neuroimaging community and to brainstorm possible solutions to accelerate it. Although our project was
<figure><img src="image_5.png" /><figcaption>Figure 4. Plots showing the association between left hippocampal volume discrepancies and MRIQC's EFC quality measure for each of the pipeline pairings.</figcaption></figure>

conceptual and we did not develop any tools during the project, the outcome of our discussions have directly influenced the development of tools such as neurobagel³⁶ (https://neurobagel.org/) after the brainhack.

Thanks to efforts of the neuroimaging community, not least the brainhack community,¹ datasets are increasingly shared on open data repositories like OpenNeuro³⁷ using standards like BIDS³⁸ for interoperability. As the amount of datasets and data repositories increases, we need to find better ways to search across them for samples that fit our research questions. In the same way that the wide adoption of BIDS makes data sharing and tool development easier, the wide adoption of consistent vocabulary for demographic, clinical and other sample metadata would make data search and integration easier. We imagine a future platform that allows cross dataset search and the pooling of data across studies. Efforts to establish such metadata standards have had some success in other communities,³⁹,

⁴⁰ but adoption in the neuroscience community so far has been slow.

We believe that an important social challenge for the wider adoption of metadata standards is that it is hard to demonstrate their value without a practical use case. We therefore think that rather than focusing on building better standards, in the short term we need to prioritize small, but functional demonstrations that help convey the value of these standards and focus on usability and ease of adoption. Having consistent names and format for even a few metadata variables like age, sex, and diagnosis already allows for interoperability and search across datasets. Selecting a single vocabulary that must be used for annotating e.g. diagnosis necessarily lacks some precision but avoids the need to align slightly different versions of the same terms. Accessible tools can be built to facilitate the annotation process of such a basic metadata standard. The best standard will be poorly adopted if there are no easy to use tools that implement it. Efforts like the neurobagel project (https://neurobagel.org/) are trying to implement this approach to demonstrate a simple working use case for cross dataset integration and search. Our goal is to use such simpler demonstrations to build awareness and create a community around the goal of consistent metadata adoption.

Our long term goal is to use the awareness of the value of shared metadata standards to build a community to curate the vocabularies used for annotation. The initially small number of metadata variables will have to be iteratively extended through a community driven process to determine what fields should be standardized to serve concrete use cases. Rather than creating new vocabularies the goal should be to curate a list of existing ones that can be contributed to where terms are inaccurate or missing. The overall goal of such a community should be to build consensus on and maintain shared standards for the annotation of neuroimaging metadata that support search and integration of data for an ever more reproducible and generalizable neuroscience.

## 4.9. THE NARPS OPEN PIPELINES PROJECT

Elodie Germani, Arshitha Basavaraj, Trang Cao, Rémi Gau, Anna Menacher, Camille Maumet

The goal of the NARPS Open Pipelines Project is to provide a public codebase that reproduces the 70 pipelines chosen by the 70 teams of the NARPS study.⁴¹ The project is public and the code hosted on GitHub at https://github.com/Inria-Empenn/narps_open_pipelines.

This project initially emerged from the idea of creating an open repository of fMRI data analysis pipelines (as used by researchers in the field) with the broader goal to study and better understand the impact of analytical variability. NARPS – a many-analyst study in which 70 research teams were asked to analyze the same fMRI dataset with their favorite pipeline – was identified as an ideal usecase as it provides a large array of pipelines created by different labs. In addition, all teams in NARPS provided extensive (textual) description of their pipelines using the COBIDAS⁴² guidelines. All resulting statistic maps were shared on Neu-
roVault⁴³ and can be used to assess the success of the re-
productions.

At the OHBM Brainhack 2022, our goal was to improve
the accessibility and reusability of the database, to facili-
tate new contributions and to reproduce more pipelines. We
focused our efforts on the first two goals. By trying to install
the computing environment of the database, contributors
provided feedback on the instructions and on specific is-
sues they faced during the installation. Two major improve-
ments were made for the download of the necessary data:
the original fMRI dataset and the original results (statis-
tic maps stored in NeuroVault) were added as submodules
to the GitHub repository. Finally, propositions were made
to facilitate contributions: the possibility to use of the Gi-
raffe toolbox⁴⁴ for contributors that are not familiar with
NiType⁴⁵ and the creation of a standard template to repro-
duce a new pipeline.

With these improvements, we hope that it will be easier
for new people to contribute to reproduction of new
pipelines. We hope to continue growing the codebase in the
future.

## 4.10. NEUROCAUSAL: DEVELOPMENT OF AN OPEN SOURCE PLATFORM FOR THE STORAGE, SHARING, SYNTHESIS, AND META-ANALYSIS OF NEUROPSYCHOLOGICAL DATA

Isil Poyraz Bilgin, Francois Paugam, Ruoqi Huang, Ana Luísa Pinho, Yuchen Zhou, Sladjana Lukic, Pedro Pinheiro-Chagas, Valentina Borghesani

Cognitive neuroscience has witnessed great progress
since modern neuroimaging embraced an open science
framework, with the adoption of shared principles,¹⁴ stan-
dards,³⁸ and ontologies,⁴⁶ as well as practices of meta-
analysis⁴⁷,⁴⁸ and data sharing.⁴³ However, while functional
neuroimaging data provide correlational maps between
cognitive functions and activated brain regions, its useful-
ness in determining causal link between specific brain re-
gions and given behaviors or functions is disputed.⁴⁹,⁵⁰ On
the contrary, neuropsychological data enable causal infer-
ence, highlighting critical neural substrates and opening
a unique window into the inner workings of the brain.⁵¹
Unfortunately, the adoption of Open Science practices in
clinical settings is hampered by several ethical, technical,
economic, and political barriers, and as a result, open plat-
forms enabling access to and sharing clinical (meta)data are
scarce.⁵²

With our project, NeuroCausal (https://neuro-causal.github.io/), we aim to build an online platform and community that allows open sharing, storage, and synthesis of clinical (meta) data crucial for the development of modern, transdiagnostic, accessible, and replicable (i.e., FAIR: Findability, Accessibility, Interoperability, and Reusability) neuropsychology. The project is organized into two infrastructural stages: first, published peer-reviewed papers will be scrapped to collect already available (meta)data; second, our platform will allow direct uploading of clinical (de-identified) brain maps and their corresponding metadata.

The meta-analysis pipeline developed for the first stage
of the project is inspired by and built upon the functional-
ities of NeuroQuery,⁴⁷ a successful large-scale neuroimag-
ing meta-analytic platform. The first stage is the devel-
opment of the code base allowing (1) downloading and
filtering of neuropsychological papers, (2) extraction of re-
ported brain lesion locations and their conversion into a
common reference space (3) extraction of clinical and be-
havioral symptoms and their translation into a common an-
notation scheme, (4) learning the causal mapping between
the neural and neuropsychological information gathered.

The second stage of the study aims at creating an online
platform that allows for the direct uploading of clinical
brain maps and their corresponding metadata. The plat-
form will provide a basic automated preprocessing and a
data-quality check pipeline, ensuring that all the ethical
norms regarding patient privacy are met. The platform will
automatically extract and synthesize key data to ultimately
create probabilistic maps synthesizing transdiagnostic in-
formation on symptom-structure mapping, which will be
dynamically updated as more data are gathered.

The nature of the project requires expertise in different
fields (from clinical neuroscience to computer science) in
order to overcome both technical and theoretical chal-
lenges. The OHBM Brainhack 2022 gave us the opportunity
to set the first stones. In small subteams, we worked on de-
veloping three key building blocks: (1) the input filtering
pipeline to ensure the downloaded papers are neuropsychyo-
logical in nature and offer causal symptomstructure map-
ping; (2) the extraction of key terms occurrences in the text
as to assess which neural space is reported (as they will
have to be converted to a common one), (3) the curation of
clinical ontology mapping specific neuropsychological bat-
teries and tasks to the cognitive term(s) they touch upon.
During the hackahton we worked on developing three key
building blocks in small subteams. First, we prepared an
input filtering pipeline to ensure that the downloaded pa-
pers are neuropsychological in nature (and thus offer causal
symptom-structure mapping): we count the occurrences of
clinically relevant terms, and papers are included only if
they pass an arbitrary threshold. Second, we coded a script
automatically returning for each paper information on the
neural spaced used (e.g., which atlas? MNI coordinates?), a
crucial step to enable future conversion to a common ref-
erence space. Finally, we curated a list of clinically relevant
terms and constructs (a clinical ontology) that maps spe-
cific neuropsychological batteries and tasks to the cognitive
term(s) they touch upon.

As we keep tackling our roadmap (Figure 5), we believe
our efforts will help promote open science practices in clin-
ical neuroscience to the benefit of both the neuroscientific
and the clinical communities.

## ACKNOWLEDGMENTS

The authors would like to thank Eric Earl, Samuel Guay,
Jerome Dockès, Bertrand Thirion, Jean Baptiste Poline,
Yaroslav Halchenko, Sara ElGebali and the whole Open Life
Science team for their help and support.
<figure><img src="image_6.png" /><figcaption>**Figure 5.** NeuroCausal: The future of neuropsychology, i.e. brain lesions-symptom mapping, will be transdiagnostic, open, and FAIR: we set out to provide the field with an open-source platform fostering storage, sharing, synthesis, and meta-analysis of clinical data.</figcaption></figure>

## 4.11. NEUROSCOUT: A PLATFORM FOR FAST AND FLEXIBLE RE-ANALYSIS OF (NATURALISTIC) FMRI STUDIES

Alejandro De La Vega, Roberta Rocca, Sam Nastase, Peer Horholz, Jeff Mentch, Kevin Sitek, Caroline Martin, Leonardo Muller-Rodriguez, Kan Keeratimahat, Dylan Nielson

Neuroscout is an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout's goal is to make it easy to analyze complex naturalistic fMRI datasets by providing an integrated platform for model specification and automated statistical modeling, reducing technical barriers. Importantly, Neuroscout is at its core a platform for reproducible analysis of fMRI data in general, and builds upon a set of open standards and specifications to ensure analyses are Findable, Accessible, Interoperable, and Reusable (FAIR).

In the OHBM Hackathon, we iterated on several important projects that substantially improved the general usability of the Neuroscout platform. First, we launched a revamped and unified documentation which links together all of the subcomponents of the Neuroscout platform (https://neuroscout.github.io/neuroscout-docs/). Second, we facilitated access to Neuroscout's data sources by simplifying the design of Python API, and providing high-level utility functions for easy programmatic data queries. Third, we updated a list of candidate naturalistic and non-naturalistic datasets amenable for indexing by the Neuroscout platform, ensuring the platform stays up to date with the latest public datasets.

In addition, important work was done to expand the types of analyses that can be performed with naturalistic data in the Neuroscout platform. Notably, progress was made in integrating Neuroscout with Himalaya, a library for efficient voxel wide encoding modeling with support for banded penalized regression. In addition, a custom imageonscalar analysis was prototyped on naturalistic stimuli via the publicly available naturalistic features available in the Neuroscout API. Finally, we also worked to improve documentation and validation for BIDS StatsModels, a specification for neuroimaging statistical models which underlies Neuroscout's automated model fitting pipeline.

## 4.12. PHYSIOPY - DOCUMENTATION OF PHYSIOLOGICAL SIGNAL BEST PRACTICES

Sarah E. Goodale, Ines Esteves, Roza G. Bayrak, Neville Magielse, Stefano Moia, Yu-Fang Yang, The Physiopy Community

Physiological data provides a representation of a subject's internal state with respect to peripheral measures (i.e., heart rate, respiratory rate, etc.). Recording physiological measures is key to gain understanding of sources of signal variance in neuroimaging data that arise from outside of the brain.⁵³ This has been particularly useful for functional magnetic resonance imaging (fMRI) research, improving fMRI time-series model accuracy, while also improving real-time methods to monitor subjects during scanning.⁵⁴,⁵⁵

Physiopy (https://github.com/physiopy) is an open and collaborative community, formed around the promotion of physiological data collection and incorporation in neu-
<figure><img src="image_7.png" /><figcaption>**Figure 6.** Left: Current version of the documentation homepage; Right: Physiopy Contributors</figcaption></figure>

roimaging studies. Physiopy is focused on two main objectives. The first is the community-based development of tools for fMRI-based physiological processing. At the moment, there are three toolboxes: *phys2bids* (physiological data storage and conversion to BIDS format,⁵⁶ *peakdet* (physiological data processing), and *phys2denoise* (fMRI denoising). The second objective is advancing the general knowledge of physiological data collection in fMRI by hosting open sessions to discuss best practices of physiological data acquisition, preprocessing, and analysis, and promoting community involvement. Physiopy maintains documentation with best practices guidelines stemming from these joint discussions and recent literature.

At the OHBM 2022 Brainhack, we aimed to improve our community documentation by expanding on best practices documentation, and gathering libraries of complementary open source software. This provides new users resources for learning about the process of physiological data collection as well as links to already available resources. The short-term goal for the Brainhack was to prepare a common platform (and home) for our documentation and repositories. We prioritised fundamental upkeep and content expansion, adopting Markdown documents and GitHub hosting to minimise barriers for new contributors. Over the course of the Brainhack, and with the joint effort within three hubs (Glasgow, EMEA and Americas), we were able to improve the current community website by rethinking its structure and adding fundamental content. This concerned who we are, contributions, and updated best practices, such as creating home pages, easy to find and navigate contribution tabs, adding new information from community best practices discussions as well as links to relevant software and datasets. Additionally, we aggregated the information scattered across different repositories, allowing important information for both the community and new collaborators to be accessible in a single location.

The long-term goals of the community are to develop and sustain knowledge and instruments for physiological signal adoption in f/MRI settings. Our aim is to facilitate the coming-together of researchers that are just starting to include physiological measures and experienced users.

This community will then provide consensus guidelines for standardised data collection and preprocessing. Building on what we have already achieved, we will continue to promote and document best practices. Further development is ongoing and anyone that is interested in physiological signal collection for f/MRI data, independently of their level and type of expertise, is highly encouraged to check Physiopy out, to join the community, or to contribute in any way.

### 4.13. HANDLING MULTIPLE TESTING PROBLEM THROUGH EFFECT CALIBRATION: IMPLEMENTATION USING PYMC

Lea Waller, Kelly Garner, Christopher R. Nolan, Daniel Borek, Gang Chen

#### 4.13.1. INTRODUCTION

Human brain imaging data is massively multidimensional, yet current approaches to modelling functional brain responses entail the application of univariate inferences to each voxel separately. This leads to the multiple testing problem and unrealistic assumptions about the data such as artificial dichotomization (statistically significant or not) in result reporting. The traditional approach of massively univariate analysis assumes that no information is shared across the brain, effectively making a strong prior assumption of a uniform distribution of effect sizes, which is unrealistic given the connectivity of the human brain. The consequent requirement for multiple testing adjustments results in the *calibration of statistical evidence* without considering the estimation of effect, leading to substantial information loss and an unnecessarily heavy penalty.

A more efficient approach to handling multiplicity focuses on the *calibration of effect estimation* under a Bayesian multilevel modeling framework with a prior assumption of, for example, normality across space.⁵⁷ The methodology has previously been implemented at the region level into the AFNI program RBA⁵⁸ using Stan through the R package brms.⁵⁹

We intend to achieve two goals in this project:
<figure><img src="image_8.png" /><figcaption>Figure 7. Validation of implementation using PyMC.</figcaption></figure>

(A) Posterior distributions of regionlevel behavior effects using brms. (B) Posterior distributions of region-level behavior effects using PyMC. (C) Posterior probabilities of the voxel-level effects being positive or negative, obtained using PyMC (plotted using Nilearn and overlaid in green with the NeuroQuery⁴⁷ map for the term "emotional faces").

1. To re-implement the methodology using PyMC to improve the performance and flexibility of the modeling approach.

2. To explore the possibility of analyzing voxel-level data using the multilevel modeling approach

### 4.13.2. IMPLEMENTATION USING PYMC

We used the dataset from Chen and colleagues⁵⁷ to validate our PyMC implementation. The data contain the subject-level response variable y and a predictor of the behavioral measure x from S = 124 subjects at R = 21 regions. The modeling framework is formulated for the data $y_{rs}$ of the sth subject at the rth region as below,

$$ 
\begin{aligned}
y_{rs} &\sim \mathbf{N}(\mu_{rs}, \sigma^2) \\
\mu_{rs} &= \alpha_0 + \alpha_1 x_s + \theta_{0r} + \theta_{1r} x_s + \eta_s \\
\begin{bmatrix} \theta_{0r} \\ \theta_{1r} \end{bmatrix} &\sim \mathbf{N}(0_{2 \times 1}, S_{2 \times 2}) \\
\eta_s &\sim \mathbf{N}(0, \tau^2)
\end{aligned}
$$
where $r = 1, 2, \dots, R$ and $s = 1, 2, \dots, S$

In the model, $\mu_{rs}$ and $\sigma$ are the mean effect and standard deviation of the sth subject at the rth region, $\alpha_0$ and $\alpha_1$ are the overall mean and slope effect across all regions and subjects, $\theta_{0r}$ and $\theta_{1r}$ are the mean and slope effect at the rth region, $\eta_s$ is the mean effect of the sth subject, $S_{2 \times 2}$ is the variance-covariance of the mean and slope effect at the rth region, and $\tau$ is the standard deviation of the sth subject's effect $\eta_s$.

We implemented this model using the PyMC probabilistic programming framework,⁶⁰ and the BAYesian Model-Building Interface (BAMBI).⁶¹ The latter is a high-level interface that allows for specification of multilevel models

using the formula notation that is also adopted by brms. A notebook describing the implementation is available here. Our PyMC implementation was successfully validated: as shown in Figure 7a and Figure 7b, the posterior distributions from the PyMC implementation matched very well with their counterparts from the brms output.

### 4.13.3. EXTENSION OF BAYESIAN MULTILEVEL MODELING TO VOXEL-LEVEL ANALYSIS

After exploring the model on the region level, we wanted to see if recent computational and algorithmic advances allow us to employ the multilevel modeling framework on the voxel level as well. We obtained the OpenNeuro dataset ds000117⁶² from an experiment based on a face processing paradigm. Using HALFpipe,⁶³ which is based on fMRIPrep,⁶⁴ the functional images were preprocessed with default settings and z-statistic images were calculated for the contrast “famous faces + unfamiliar faces versus 2 · scrambled faces”.

We applied the same modeling framework and PyMC code as for region-based analysis, but without the explanatory variable x in the model in Section 4.13.2. To reduce computational and memory complexity, the z-statistic images were downsampled to an isotropic resolution of 5mm. Using the GPU-based nuts numpyro sampler⁶⁵ with default settings, we were able to draw 2,000 posterior samples of the mean effect parameter for each of the 14,752 voxels. Sampling four chains took 23 minutes on four Nvidia Tesla V100 GPUs.

The resulting posterior probabilities are shown in Figure 7c overlaid with the meta-analytic map for the term “emotional faces”.
tional faces" obtained from NeuroQuery.⁴⁷ The posterior probability map is consistent with meta-analytic results, showing strong statistical evidence in visual cortex and amygdala voxels. The posterior probability maps also reveal numerous other clusters of strong statistical evidence for both positive and negative effects.

This implementation extension shows that large multi-level models are approaching feasibility, suggesting an exciting new avenue for statistical analysis of neuroimaging data. Next steps will be to investigate how to interpret and report these posterior maps, and to try more complex models that include additional model terms.

## ACKNOWLEDGEMENTS

Computation has been performed on the HPC for Research cluster of the Berlin Institute of Health.

## 4.14. MOSAIC FOR VASO FMRI

Renzo (Laurentius) Huber, Remi Gau, Rüdiger Stirnberg, Philipp Ehes, Ömer Faruk Gülban, Benedikt A. Poser

Vascular Space Occupancy (VASO) is a functional magnetic resonance imaging (fMRI) method that is used for high-resolution cortical layer-specific imaging.⁶⁶ Currently, the most popular sequence for VASO at modern SIEMENS scanners is the one by Stirnberg and Stöcker⁶⁷ from the DZNE in Bonn, which is employed at more than 30 research labs worldwide. This sequence concomitantly acquires fMRI BOLD and blood volume signals. In the SIEMENS' reconstruction pipeline, these two complementary fMRI contrasts are mixed together within the same time series, making the outputs counter-intuitive for users. Specifically:

* The 'raw' NIfTI converted time-series are not BIDS compatible (see https://github.com/bids-standard/bids-specification/issues/1001).

* The order of odd and even BOLD and VASO image TRs is unprincipled, making the ordering dependent on the specific implementation of NIfTI converters.

Workarounds with 3D distortion correction, results in interpolation artifacts. Alternative workarounds without MOSAIC decorators result in unnecessarily large data sizes.

In the previous Brainhack,¹ we extended the existing 3D-MOSAIC functor that was previously developed by Benedikt Poser and Philipp Ehes. This functor had been previously used to sort volumes of images by dimensions of echoes, times, by RF-channels, and by magnitude and phase signals. In this Brainhack, we successfully extended and validated this functor to also support the dimensionality of SETs (that is representing BOLD and VASO contrast).

We are happy to share the compiled SIEMENS ICE (Image Calculation Environment) functor that does this sorting. Current VASO users, who want to upgrade their reconstruction pipeline to get the MOSAIC sorting feature too, can reach out to Renzo Huber (RenzoHuber@gmail.com) or Rüdiger Stirnberg (Ruediger.Stirnberg@dzne.de).

Furthermore, Remi Gau, generated a template dataset that exemplifies how one could to store layer-fMRI VASO

<figure><img src="image_9.png" /><figcaption>**Figure 8.** Previously, most VASO sequences provided unsorted image series of MRI contrasts.</figcaption></figure>

This was not BIDS compatible and could suffer from gradient non-linearity artifacts in the scanner's MR-reconstruction pipeline. In Brainhack 2022, we adapted the SIEMENS reconstruction and to sort volume series by fMRI contrasts. This is BIDS compatible and does not require non-linearity corrections.

data. This includes all the meta data for 'raw' and 'derivatives'. Link to this VASO fMRI BIDS demo: https://gin.g-node.org/RemiGau/ds003216/src/bids.demo.

Acknowledgements: We thank Chris Rodgers for instructions on how to overwrite existing reconstruction binaries on the SIEMENS scanner without rebooting. We thank David Feinberg, Alex Beckett and Samantha Ma for helping in testing the new reconstruction binaries at the Feinberg-gatron scanner in Berkeley via remote scanning. We thank Maastricht University Faculty of Psychology and Neuroscience for supporting this project with 2.5 hours of 'development scan time'.

## 5. CONCLUSION AND FUTURE DIRECTIONS

Stefano Moia, Hao-Ting Wang

Approaching the organisation of an event as an experiment allows incredible freedom and dynamicity, albeit knowing that there will be risks and venues of improvement for the future.

The organisation managed to provide a positive onsite environment, aiming to allow participants to self-organise in the spirit of the Brainhack,¹ with plenty of moral - and physical - support.

The technical setup, based on heavy automatisation flow to allow project submission to be streamlined, was a fundamental help to the organisation team, that would benefit even more from the improvement of such automatisation flows.

This year, representatives of AFNI, FSL, and SPM (among the major neuroscience software developers) took part in the event, and their presence was appreciated both by other participants and themselves. In the future, connecting to more developers, not only from the MRI community, might improve the quality of the Brainhack even more.

The most challenging element of the organisation was setting up an hybrid event. While this element did not go as smoothly as it could have, this experimental setup seemed
to have worked, allowing the participation of about 70 par-
ticipants online. However, there is still a lot to improve for
a truly hybrid event. For instance, it is important to al-
low spaces (both in time and space) for participants on-site
to interact with online participants, and more attention,
time, volunteers, and equipment has to be put to achieve a
smooth online participation. For this reason, the Open Sci-
ence Special Interest Group instituted a position to have a
dedicated person for the hybridisation process. The other
challenge was to welcome newcomers into this heavily pro-
ject-development-oriented event. While newcomers man-

aged to collaborate with projects and self-organise to learn
open science related skills, this integration of pre-event
train track and beginner friendly process will benefit from
more attention.

Overall this OHBM Brainhack was a successful outcome
for the organisation team experiment, and we hope that our
findings will be helpful to future Brainhack events organi-
sations.

Submitted: October 09, 2023 CDT, Accepted: January 29, 2024
CDT

<figure><img src="image_10.png" /></figure>

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CCBY-4.0). View this license's legal deed at http://creativecommons.org/licenses/by/4.0 and legal code at http://creativecommons.org/licenses/by/4.0/legalcode for more information.
REFERENCES

1. Gau R, Noble S, Heuer K, et al. Brainhack: Developing a culture of open, inclusive, community-driven neuroscience. *Neuron*. 2021;109(11):1769-1775. doi:10.1016/j.neuron.2021.04.001

2. Alkemade A, Bazin PL, Balesar R, et al. A unified 3D map of microscopic architecture and MRI of the human brain. *Sci Adv*. 2022;8(17):1-10. doi:10.1126/sciadv.abj7892

3. Heuer K, Gulban OF, Bazin PL, et al. Evolution of neocortical folding: A phylogenetic comparative analysis of MRI from 34 primate species. *Cortex*. 2019;118(275):275-291. doi:10.1016/j.cortex.2019.04.011

4. Huntenburg JM, Steele CJ, Bazin PL. Nighres: processing tools for high-resolution neuroimaging. *GigaScience*. 2018;7(7). doi:10.1093/gigascience/giy082

5. Yushkevich PA, Piven J, Hazlett HC, et al. User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability. *NeuroImage*. 2006;31(3):1116-1128. doi:10.1016/j.neuroimage.2006.01.015

6. Cox RW. AFNI: Software for Analysis and Visualization of Functional Magnetic Resonance Neuroimages. *Computers and Biomedical Research*. 1996;29(3):162-173. doi:10.1006/cbmr.1996.0014

7. Smith SM, Jenkinson M, Woolrich MW, et al. Advances in functional and structural MR image analysis and implementation as FSL. *NeuroImage*. 2004;23:S208-S219. doi:10.1016/j.neuroimage.2004.07.051

8. Gulban OF, Schneider M, Marquardt I, Haast RAM, De Martino F. A scalable method to improve gray matter segmentation at ultra high field MRI. *PLoS ONE*. 2018;13(6):e0198335. doi:10.1371/journal.pone.0198335

9. Huber L (Renzo), Poser BA, Bandettini PA, et al. LayNii: A software suite for layer-fMRI. *NeuroImage*. 2021;237(May):118091. doi:10.1016/j.neuroimage.2021.118091

10. Apon AW, Ngo LB, Payne ME, Wilson PW. Assessing the effect of high performance computing capabilities on academic research output. *Empir Econ*. 2014;48(1):283-312. doi:10.1007/s00181-014-0833-7

11. Oracle cloud sustainability. https://www.oracle.com/uk/sustainability/greencloud/

12. Oracle for Research. Accessed July 19, 2022. http://docs.oracle.com/en/programs/research/

13. NeuroDesk. Accessed July 19, 2022. https://www.neurodesk.org/

14. Wilkinson MD, Dumontier M, Aalbersberg IJ, et al. The FAIR Guiding Principles for scientific data management and stewardship. en. *Sci Data*. 2016;3(1):160018.

15. Halchenko Y, Meyer K, Poldrack B, et al. DataLad: distributed system for joint management of code, data, and their relationship. *Journal of Open Source Software*. 2021;6(63):3262. doi:10.21105/joss.03262

16. King G. An introduction to the dataverse network as an infrastructure for data sharing. *Sociological Methods & Research*. 2007;36(2):173-199. doi:10.1177/0049124107306660

17. Hanke M, Pestilli F, Wagner AS, Markiewicz CJ, Poline JB, Halchenko YO. In defense of decentralized research data management. *Neuroforum*. 2021;0(0):271. doi:10.1515/nf-2020-0037

18. Hanke M, Poldrack B, Wagner AS, et al. datalad/ datalad-osf: Cleanup. Version 0.2.3. Published online March 2021.

19. Halchenko YO, Hanke M, Heunis S, et al. DataLad-next extension.

20. Jiang C, Selle A, Teran J. The Affine Particle-In-Cell Method Chenfanfu. *ACM Transactions on Graphics*. 1965;34(4):51.

21. Love E, Sulsky DL. An unconditionally stable, energy-momentum consistent implementation of the material-point method. *Computer Methods in Applied Mechanics and Engineering*. 2006;195(33-36):3903-3925. doi:10.1016/j.cma.2005.06.027

22. Stomakhin A, Schroeder C, Chai L, Teran J, Selle A. A material point method for snow simulation. *ACM Trans Graph*. 2013;32(4):1-10. doi:10.1145/2461912.2461948

23. Ferrante O, Liu L, Minarik T, et al. FLUX: A pipeline for MEG analysis. *NeuroImage*. 2022;253(119047):119047. doi:10.1016/j.neuroimage.2022.119047
24. Gramfort A, Luessi M, Larson E, et al. MNE software for processing MEG and EEG data. *NeuroImage*. 2014;86:446-460. doi:10.1016/j.neuroimage.2013.10.027

25. Oostenveld R, Fries P, Maris E, Schoffelen JM. FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. *Comput Intell Neurosci*. Published online 2011:1-9. doi:10.1155/2011/156869

26. Appelhoff S, Sanderson M, Brooks TL, et al. MNE-BIDS: Organizing electrophysiological data into the BIDS format and facilitating their analysis. *Journal of Open Source Software*. 2019;4(44):1896. doi:10.21105/joss.01896

27. Carp J. On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments. *Front Neurosci*. 2012;6(149). doi:10.3389/fnins.2012.00149

28. Kennedy DN, Abraham SA, Bates JF, et al. Everything matters: the ReproNim perspective on reproducible neuroimaging. *Front Neuroinform*. 2019;13(1). doi:10.3389/fninf.2019.00001

29. Schuff N, Woerner N, Boreta L, et al. MRI of hippocampal volume loss in early Alzheimer's disease in relation to ApoE genotype and biomarkers. *Brain*. 2009;132(4):1067-1077. doi:10.1093/brain/awp007

30. Patenaude B, Smith SM, Kennedy DN, Jenkinson M. A Bayesian model of shape and appearance for subcortical brain segmentation. *NeuroImage*. 2011;56(3):907-922. doi:10.1016/j.neuroimage.2011.02.046

31. Fischl B. FreeSurfer. *NeuroImage*. 2012;62(2):774-781. doi:10.1016/j.neuroimage.2012.01.021

32. Xie L, Wisse LEM, Pluta J, et al. Automated segmentation of medial temporal lobe subregions on in vivo T1-weighted MRI in early stages of Alzheimer's disease. *Human Brain Mapping*. 2019;40(12):3431-3451. doi:10.1002/hbm.24607

33. Tremblay-mercier J, Madjar C, Das S, et al. Open science datasets from PREVENT-AD, a longitudinal cohort of pre-symptomatic Alzheimer's disease. *NeuroImage: Clinical*. 2021;31(102733):102733. doi:10.1016/j.nicl.2021.102733

34. Esteban O, Birman D, Schaer M, Koyejo OO, Poldrack RA, Gorgolewski KJ. MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites. *PLoS ONE*. 2017;12(9):e0184661. doi:10.1371/journal.pone.0184661

35. MRIQC Documentation. Published 2020. http://s://mriqc.readthedocs.io/en/stable/iqms/t1w.html

36. Urchs S, Dai A, Armoza J, Jahanpour A, Bhagwat N, Poline JB. neurobagelapi. Version 0.2.0.

37. Markiewicz CJ, Gorgolewski KJ, Feingold F, et al. The OpenNeuro resource for sharing of neuroscience data. *Elife*. 2021;10.10.10.7554/elife.71774

38. Gorgolewski KJ, Auer T, Calhoun VD, et al. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. *Sci Data*. 2016;3(1). doi:10.1038/sdata.2016.44

39. Field D, Garrity G, Gray T, et al. The minimum information about a genome sequence (MIGS) specification. en. *Nat Biotechnol*. 2008;26(5):541-547.

40. Stang PE, Ryan PB, Racoosin JA, et al. Advancing the science for active surveillance: rationale and design for the Observational Medical Outcomes Partnership. en. *Ann Intern Med*. 2010;153(9):600-606.

41. Botvinik-nezer R, Holzmeister F, Camerer CF, et al. Variability in the analysis of a single neuroimaging dataset by many teams. en. 2020(26).

42. Nichols TE, Das S, Eickhoff SB, et al. Best practices in data analysis and sharing in neuroimaging using MRI. *Nat Neurosci*. 2017;20(3):299-303. doi:10.1038/nn.4500

43. Gorgolewski KJ, Varoquaux G, Rivera G, et al. NeuroVault.org: a web-based repository for collecting and sharing unthresholded statistical maps of the human brain. *Front Neuroinform*. 2015;9:9. doi:10.3389/fninf.2015.00008

44. van Mourik T. GiraffeToolBox.

45. Gorgolewski K. Nipype: a flexible, lightweight and extensible neuroimaging data processing framework in Python. en. *Frontiers in Neuroinformatics*. 2017(15).

46. Poldrack RA, Kittur A, Kalar D, et al. The Cognitive Atlas: Toward a Knowledge Foundation for Cognitive Neuroscience. *Front Neuroinform*. 2011;5:5. doi:10.3389/fninf.2011.00017

47. Dockès J, Poldrack RA, Primet R, et al. NeuroQuery, comprehensive meta-analysis of human brain mapping. *eLife*. Published online 2020:9.

48. Yarkoni T, Poldrack RA, Nichols TE, Van Essen DC, Wager TD. Large-scale automated synthesis of human functional neuroimaging data. *Nat Methods*. 2011;8(8):665-670. doi:10.1038/nmeth.1635
49. Weber MJ, Thompson-schill SL. Functional neuroimaging can support causal claims about brain function. *J Cogn Neurosci.* 2010;22(11):2415-2416. doi:10.1162/jocn.2010.21461

50. Siddiqi SH, Kording KP, Parvizi J, Fox MD. Causal mapping of human brain function. *Nat Rev Neurosci.* 2022;23(6):361-375. doi:10.1038/s41583-022-00583-8

51. Price CJ. The evolution of cognitive models: From neuropsychology to neuroimaging and back. *Cortex*. 2018;107:37-49. doi:10.1016/j.cortex.2017.12.020

52. Larivière S, Paquola C, Park B yong, et al. The ENIGMA Toolbox: multiscale neural contextualization of multisite neuroimaging datasets. *Nat Methods*. 2021;18(7):698-700. doi:10.1038/s41592-021-01186-4

53. Chen JE, Lewis LD, Chang C, et al. Resting-State "Physiological Networks." *NeuroImage*. 2020;213(116707):116707. doi:10.1016/j.neuroimage.2020.116707

54. Bulte D, Wartolowska K. Monitoring Cardiac and Respiratory Physiology during FMRI. *NeuroImage*. 2017;154:81-91. doi:10.1016/j.neuroimage.2016.12.001

55. Caballero-gaudes C, Reynolds RC. Methods for Cleaning the BOLD fMRI Signal. *NeuroImage*. 2017;154:128-149. doi:10.1016/j.neuroimage.2016.12.018

56. Alcalá D, Ayyagari A, Bottenhorn K, et al. physiopy/phys2bids: BIDS formatting of physiological recordings.

57. Chen G, Xiao Y, Taylor PA, et al. Handling Multiplicity in Neuroimaging through Bayesian Lenses with Multilevel Modeling. *Neuroinform.* 2019;17(4):515-545. doi:10.1007/s12021-018-9409-6

58. Chen G, Taylor PA, Stoddard J, Cox RW, Bandettini PA, Pessoa L. Sources of Information Waste in Neuroimaging: Mishandling Structures, Thinking Dichotomously, and Over-Reducing Data. *Aperture Neuro*. 2022;2(5):1-22. doi:10.52294/apertureneuro.2022.2.zrji8542

59. Bürkner PC. **brms**: An R Package for Bayesian Multilevel Models Using *Stan. J Stat Soft.* 2017;80(1):1-28. doi:10.18637/jss.v080.i01

60. Salvatier J, Wiecki TV, Fonnesbeck C. Probabilistic programming in Python using PyMC3. *PeerJ Computer Science*. 2016;2:e55.

61. Capretto T, Piho C, Kumar R, Westfall J, Yarkoni T, Martin OA. Bambi: A simple interface for fitting Bayesian linear models in Python.

62. Wakeman DG, Henson RN. A multi-subject, multi-modal human neuroimaging dataset. *Sci Data*. 2015;2(1). doi:10.1038/sdata.2015.1

63. Waller L, Erk S, Pozzi E, et al. NIGMA HALFpipe: Interactive, reproducible, and efficient analysis for resting-state and task-based fMRI data. *Human Brain Mapping*. 2022;43(9):2727-2742. doi:10.1002/hbm.25829

64. Esteban O, Markiewicz CJ, Blair RW, et al. fMRIPrep: a robust preprocessing pipeline for functional MRI. *en. Nature Methods*. 2019;16(1):111-116.

65. Phan D, Pradhan N, Jankowiak M. Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro. Published online December 2019.

66. Huber L, Finn ES, Chai Y, et al. Layer-dependent functional connectivity methods. *Progress in Neurobiology*. 2021;207:101835. doi:10.1016/j.pneurobio.2020.101835

67. Stirnberg R, Stöcker T. Segmented K-Space Blipped-Controlled Aliasing in Parallel Imaging (Skipped-CAIPI) for High Spatiotemporal Resolution Echo Planar Imaging. *Magnetic Resonance in Med.* 2020;85(3):1540-1551. doi:10.1002/mrm.28486