DOI: 10.5061/dryad.np4hs
title: Data from: Reconstructing the spectrotemporal modulations of real-life sounds from fMRI response patterns

description: Ethological views of brain functioning suggest that sound representations
 and computations in the auditory neural system are optimized finely to
 process and discriminate behaviorally relevant acoustic features and
 sounds (e.g., spectrotemporal modulations in the songs of zebra finches).
 Here, we show that modeling of neural sound representations in terms of
 frequency-specific spectrotemporal modulations enables accurate and
 specific reconstruction of real-life sounds from high-resolution
 functional magnetic resonance imaging (fMRI) response patterns in the
 human auditory cortex. Region-based analyses indicated that response
 patterns in separate portions of the auditory cortex are informative of
 distinctive sets of spectrotemporal modulations. Most relevantly, results
 revealed that in early auditory regions, and progressively more in
 surrounding regions, temporal modulations in a range relevant for speech
 analysis (∼2–4 Hz) were reconstructed more faithfully than other temporal
 modulations. In early auditory regions, this effect was
 frequency-dependent and only present for lower frequencies (&lt;∼2
 kHz), whereas for higher frequencies, reconstruction accuracy was higher
 for faster temporal modulations. Further analyses suggested that auditory
 cortical processing optimized for the fine-grained discrimination of
 speech and vocal sounds underlies this enhanced reconstruction accuracy.
 In sum, the present study introduces an approach to embed models of neural
 sound representations in the analysis of fMRI response patterns.
 Furthermore, it reveals that, in the human brain, even general purpose and
 fundamental neural processing mechanisms are shaped by the physical
 features of real-world stimuli that are most relevant for behavior (i.e.,
 speech, voice).
description: Exp1_S1aThis data file contains functional MRI data of subject 1 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for test runs 1-2 and for training runs 1-2. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S1bThis data file contains functional MRI data of subject 1 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for training runs 3-6 and the structural MRI data (T1w and PD contrast, nifti format, de-faced). For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S2aThis data file contains functional MRI data of subject 2 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for test runs 1-2 and training runs 1-2. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S2bThis data file contains functional MRI data of subject 2 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for training runs 3-6 and the structural MRI data (T1w and PD contrast, nifti format, de-faced). For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S3aThis data file contains functional MRI data of subject 3 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for test runs 1-2 and training runs 1-2. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S3bThis data file contains functional MRI data of subject 3 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for training runs 3-6 and the structural MRI data (T1w and PD contrast, nifti format, de-faced). For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S4aThis data file contains functional MRI data of subject 4 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for test runs 1-2 and training runs 1-2. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S4bThis data file contains functional MRI data of subject 4 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for training runs 3-6 and the structural MRI data (T1w and PD contrast, nifti format, de-faced). For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S5aThis data file contains functional MRI data of subject 5 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for test runs 1-2 and training runs 1-2. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”Exp1_S5bThis data file contains functional MRI data of subject 5 in Experiment 1. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) for training runs 3-6 and the structural MRI data (T1w and PD contrast, nifti format, de-faced). For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment1”DesignProtocolsStimuli_Experiment1This data set includes the stimuli (.wav) and files describing the stimulation protocols (.prt) used during the functional runs (training and testing) of all subjects in Experiment1. See related ReadMe file.Exp2_S1_Session1aThis data file contains functional MRI data of subject 1 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 1-4. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S1_Session1bThis data file contains functional MRI data of subject 1 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 5-6, and the structural MRI data (T1w and PD contrast, nifti format, de-faced). For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S1_Session2aThis data file contains functional MRI data of subject 1 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 1-3. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S1_Session2bThis data file contains functional MRI data of subject 1 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 4-6, the structural MRI data (T1w, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S2_Session1aThis data file contains functional MRI data of subject 2 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 1-4. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S2_Session1bThis data file contains functional MRI data of subject 2 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 5-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S2_Session2aThis data file contains functional MRI data of subject 2 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 1-3. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S2_Session2bThis data file contains functional MRI data of subject 2 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 4-6, the structural MRI data (T1w, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S3_Session1aThis data file contains functional MRI data of subject 3 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 1-4. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S3_Session1bThis data file contains functional MRI data of subject 3 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 5-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S3_Session2aThis data file contains functional MRI data of subject 3 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 1-3. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S3_Session2bThis data file contains functional MRI data of subject 3 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 4-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S4_Session1aThis data file contains functional MRI data of subject 4 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 1-4. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S4_Session1bThis data file contains functional MRI data of subject 4 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 5-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S4_Session2aThis data file contains functional MRI data of subject 4 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 1-3. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S4_Session2bThis data file contains functional MRI data of subject 4 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 4-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S5_Session1aThis data file contains functional MRI data of subject 5 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 1-4. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S5_Session1bThis data file contains functional MRI data of subject 5 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 1, runs 5-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S5_Session2aThis data file contains functional MRI data of subject 5 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 1-3. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”Exp2_S5_Session2bThis data file contains functional MRI data of subject 5 in Experiment 2. Specifically, the data file contains the functional MRI time series (EPI T2*w, nifti format) of Session 2, runs 4-6, the structural MRI data (T1w and PD contrast, nifti format, de-faced), and reversed phase encoded (AP-PA) images for distortion correction. For details on stimuli and experimental design please see the data file: “DesignProtocolsStimuli_Experiment2”DesignProtocolsStimuli_Experiment2This data set includes the stimuli and files describing the stimulation protocols used during the functional runs of all subjects in Experiment 2.