DOI: 10.5281/zenodo.13759829
title: NFED-fmri

description: # A large-scale fMRI dataset in response to short naturalistic facial expressions videosNaturalistic facial expressions dataset (NFED),a large-scale dataset of whole-brain functional magnetic resonance imaging (fMRI) responses to 1,320 short (3s) facial expression video clips.NFED offers researchers fMRI data that enables them to investigate the neural mechanisms involved in processing emotional information communicated by facial expression videos in real-world environments.The dataset contains raw data, pre-processed volume data,pre-processed  surface data and suface-based analyzed data.To get more details, please refer to the paper at {website} and the dataset at https://openneuro.org/datasets/ds005047## Preprocess procedureThe MRI data were preprocessed by using Kay et al, combining code written in MATLAB and certain tools from FreeSurfer, SPM,and FSL(http://github.com/kendrickkay).We used FreeSurfer software (http://surfer.nmr.mgh.harvard.edu) to construct the pial and white surfaces of participants from the T1 volume. Additionally, we established an intermediate gray matter surface between the pial and the white surfaces for all participants.**code: ./volume_pre-process/**Detailed usage notes are available in codes, please read carefully and modify variables to satisfy your customed environment.## GLM of main experimentWe performed a single-trial GLM(GLMsingle),a advanced denoising toolbox in MATLAB used to improve single-trial BOLD response estimates, to model the time-series data in surface forma from the pre-processed fMRI data of each participant. Three specific amplitudes of responses (i.e., beta values) were estimated by modeling the BOLD response in relation to each video onset from 1 to 3 seconds in 1 second steps.Using GLMsingle in the manner described above, the BOLD responses evoked by each video were assessed in the run of each session. In total, we extracted 2(repetitions) x 3 (seconds) beta estimates for each video condition in the training set,and 10 (repetitions) x 3(seconds) estimated beta values for each video condition in the testing set.**code: ./GLMsingle-main-experiment/matlab/examples.m**#### retinotopic mappingThe fMRI data from the the population receptive field experiment were analyzed by a pRF model implemented in the analyzePRF toolbox (http://cvnlab.net/analyzePRF/) to characterize individual retinotopic representation. Make sure to download required software mentioned in the code.**code: ./Functional-localizer-experiment-analysis/s4a_analysis_prf.m**#### fLoc experimentWe used GLMdenoise,a data-driven denoising method,to analyze the pre-processed fMRI data from the fLoc experiment.We used a "condition-split" strategy to code the 10 stimulus categories, splitting the trials related to each category into individual conditions in each run. Six response estimates (beta values) for each category were produced by using six condition-splits.To quantify selectivity for various categories and domains,we computed t-values using the GLM beta values after fitting the GLM.The regions of interest with category selectivity for each participant were defined by using the resulting maps.**code: ./Functional-localizer-experiment-analysis/s4a_analysis_floc.m**## Validation### Basic quality control**code: ./validation/FD/FD.py****code: ./validation/tSNR/tSNR.py**### noise cellingThe data are available at  https://openneuro.org/datasets/ds005047."./validation/code/noise_celling/sub-xx" store the intermediate files required for running the program**code: ./validation/noise_celling/Noise_Ceiling.py**### Correspondence between human brain and DCNNThe data are available at  https://openneuro.org/datasets/ds005047.We combined the data from main experiment and functional localizer experiments to build an encoding model to replicate the hierarchical correspondences of representation between the brain and the DCNN. The encoding models were built to map artificial representations from each layer of the pre-trained VideoMAEv2 to neural representations from each area of the human visual cortex as defined in the multimodal parcellation atlas.**code: ./validation/dnnbrain/**### Semantic metadata of action and expression labels reveal that NFED can encode temporal and spatial stimuli features in the brainThe data are available at  https://openneuro.org/datasets/ds005047."./validation/code/semantic_metadata/xx_xx_semantic_metadata" store the intermediate files required for running the program.**code: ./validation/semantic_metadata/**### GLMsingle-main-experimentThe data are available at  https://openneuro.org/datasets/ds005047."./validation/code/noise_celling/sub-xx" store the intermediate files required for running the program**code: ./validation/noise_celling/Noise_Ceiling.py**## results The results can be viewed at  "https://openneuro.org/datasets/ds005047/derivatives/validation/results/brain_map_individual".## Whole-brain mappingThe whole-brain data mapped to the cerebral cortex as obtained from the technical validation.**code: ./show_results_allbrain/Showresults.m**## Mannually prepared environmentWe provide the *requirements.txt* to install python packages used in these codes. However, some packages like *GLM* and *pre-processing* require external dependecies and we have provided the packages in the corresponding file.## stimuliThe video stimuli used in the NFED experiment are saved in the "stimuli_1" and "stimuli_2" folders.