Bridging Big Data: Procedures for Combining Non-equivalent Cognitive Measures from the ENIGMA Consortium
Authors: Kennedy Eamonn , Vadlamani Shashank , Lindsey Hannah M , Lei Pui-Wa , Jo-Pugh Mary , Adamson Maheen , Alda Martin , Alonso-Lana Silvia , Ambrogi Sonia , Anderson Tim J , Arango Celso , Asarnow Robert F , Avram Mihai , Ayesa-Arriola Rosa , Babikian Talin , Banaj Nerisa , Bird Laura J , Borgwardt Stefan , Brodtmann Amy , Brosch Katharina , Caeyenberghs Karen , Calhoun Vince D , Chiaravalloti Nancy D , Cifu David X , Crespo-Facorro Benedicto , Dalrymple-Alford John C , Dams-O’Connor Kristen , Dannlowski Udo , Darby David , Davenport Nicholas , DeLuca John , Diaz-Caneja Covadonga M , Disner Seth G , Dobryakova Ekaterina , Ehrlich Stefan , Esopenko Carrie , Ferrarelli Fabio , Frank Lea E , Franz Carol , Fuentes-Claramonte Paola , Genova Helen , Giza Christopher C , Goltermann Janik , Grotegerd Dominik , Gruber Marius , Gutierrez-Zotes Alfonso , Ha Minji , Haavik Jan , Hinkin Charles , Hoskinson Kristen R , Hubl Daniela , Irimia Andrei , Jansen Andreas , Kaess Michael , Kang Xiaojian , Kenney Kimbra , Keřková Barbora , Khlif Mohamed Salah , Kim Minah , Kindler Jochen , Kircher Tilo , Knížková Karolina , Kolskår Knut K , Krch Denise , Kremen William S , Kuhn Taylor , Kumari Veena , Kwon Jun Soo , Langella Roberto , Laskowitz Sarah , Lee Jungha , Lengenfelder Jean , Liebel Spencer W , Liou-Johnson Victoria , Lippa Sara M , Løvstad Marianne , Lundervold Astri , Marotta Cassandra , Marquardt Craig A , Mattos Paulo , Mayeli Ahmad , McDonald Carrie R , Meinert Susanne , Melzer Tracy R , Merchán-Naranjo Jessica , Michel Chantal , Morey Rajendra A , Mwangi Benson , Myall Daniel J , Nenadić Igor , Newsome Mary R , Nunes Abraham , O’Brien Terence , Oertel Viola , Ollinger John , Olsen Alexander , de la Foz Victor Ortiz García , Ozmen Mustafa , Pardoe Heath , Parent Marise , Piras Fabrizio , Piras Federica , Pomarol-Clotet Edith , Repple Jonathan , Richard Geneviève , Rodriguez Jonathan , Rodriguez Mabel , Rootes-Murdy Kelly , Rowland Jared , Ryan Nicholas P , Salvador Raymond , Sanders Anne-Marthe , Schmidt Andre , Soares Jair C , Spalleta Gianfranco , Španiel Filip , Stasenko Alena , Stein Frederike , Straube Benjamin , Thames April , Thomas-Odenthal Florian , Thomopoulos Sophia I , Tone Erin , Torres Ivan , Troyanskaya Maya , Turner Jessica A , Ulrichsen Kristine M , Umpierrez Guillermo , Vilella Elisabet , Vivash Lucy , Walker William C , Werden Emilio , Westlye Lars T , Wild Krista , Wroblewski Adrian , Wu Mon-Ju , Wylie Glenn R , Yatham Lakshmi N , Zunta-Soares Giovana B , Thompson Paul M , Tate David F , Hillary Frank G , Dennis Emily L , Wilde Elisabeth A 
Published: January 2023

Investigators in neuroscience have turned to Big Data to address replication and reliability issues by increasing sample sizes, statistical power, and representativeness of data. These efforts unveil new questions about integrating data arising from distinct sources and instruments. We focus on the most frequently assessed cognitive domain - memory testing - and demonstrate a process for reliable data harmonization across three common measures. We aggregated global raw data from 53 studies totaling N = 10,505 individuals. A mega-analysis was conducted using empirical bayes harmonization to remove site effects, followed by linear models adjusting for common covariates. A continuous item response theory (IRT) model estimated each individual’s latent verbal learning ability while accounting for item difficulties. Harmonization significantly reduced inter-site variance while preserving covariate effects, and our conversion tool is freely available online. This demonstrates that large-scale data sharing and harmonization initiatives can address reproducibility and integration challenges across the behavioral sciences.

Teaser

We present a global effort to devise harmonization procedures necessary to meaningfully leverage big data.