PenguinMan/ARXIV huggingface dataset:
Dynamic selective auditory attention detection using RNN and reinforcement learning
Authors: Geravanchizadeh, M.; Roushan, H.
Category: neuroscience
Date: 2021-08-09

The cocktail party phenomenon describes the ability of the human brain to focus auditory attention on a particular stimulus while ignoring other acoustic events. Selective auditory attention detection (SAAD) is an important issue in the development of brain-computer interface systems and cocktail party processors. This paper proposes a new dynamic attention detection system to process the temporal evolution of the input signal. The proposed dynamic SAAD is modeled as a sequential decision-making problem, which is solved by recurrent neural network (RNN) and reinforcement learning methods of Q-learning and deep Q-learning. Among different dynamic learning approaches, the evaluation results show that the deep Q-learning approach with RNN as agent provides the highest classification accuracy (94.2%) with the least detection delay. The proposed SAAD system is advantageous, in the sense that the detection of attention is performed dynamically for the sequential inputs. Also, the system has the potential to be used in scenarios, where the attention of the listener might be switched in time in the presence of various acoustic events.
Perceptual restoration fails to recover unconscious processing for smooth eye movements after occipital stroke
Authors: Kwon, S.; Fahrenthold, B. K.; Cavanaugh, M. R.; Huxlin, K. R.; Mitchell, J. F.
Category: neuroscience
Date: 2022-04-29

The visual pathways that guide actions do not necessarily mediate conscious perception. Patients with primary visual cortex (V1) damage lose conscious perception but often retain unconscious abilities (e.g. blindsight). Here, we asked if saccade accuracy and post-saccadic following responses (PFRs) that automatically track target motion upon saccade landing are retained when conscious perception is lost. We contrasted these behaviors in the blind and intact-fields of 11 chronic V1-stroke patients, and in 8 visually-intact controls. Saccade accuracy was relatively normal in all cases. Stroke patients also had normal PFR in their intact-fields, but no PFR in their blind-fields. Thus, V1 damage did not spare the unconscious visual processing necessary for automatic, post-saccadic smooth eye movements. Importantly, visual training that recovered motion perception in the blind-field did not restore the PFR, suggesting a clear dissociation between pathways mediating perceptual restoration and automatic actions in the V1-damaged visual system.
Multistage classification identifies altered cortical phase- and amplitude-coupling in Multiple Sclerosis
Authors: Siems, M.; Tuennerhoff, J.; Ziemann, U.; Siegel, M.
Category: neuroscience
Date: 2022-07-07

Distinguishing groups of subjects or experimental conditions in a high-dimensional feature space is a common goal in modern neuroimaging studies. Successful classification depends on the selection of relevant features as not every neuronal signal component or parameter is informative about the research question at hand. Here, we developed a novel unsupervised multistage analysis approach that combines dimensionality reduction, bootstrap aggregating and multivariate classification to select relevant neuronal features. We tested the approach by identifying changes of brain-wide electrophysiological coupling in Multiple Sclerosis. Multiple Sclerosis is a demyelinating disease of the central nervous system that can result in cognitive decline and physical disability. However, related changes in large-scale brain interactions remain poorly understood and corresponding non-invasive biomarkers are sparse. We thus compared brain-wide phase- and amplitude-coupling of frequency specific neuronal activity in relapsing-remitting Multiple Sclerosis patients (n = 17) and healthy controls (n = 17) using magnetoencephalography. Our analysis approach allowed us to identify systematic and non-redundant changes of both phase- and amplitude-coupling in the diseased brain. Changes included both, increased and decreased neuronal coupling in wide-spread, bilateral neuronal networks across a broad range of frequencies. These changes allowed to successfully classify patients and controls with an accuracy of 84%. Furthermore, classification confidence predicted behavioral scores of disease severity. In sum, our results unravel systematic changes of large-scale phase- and amplitude coupling in Multiple Sclerosis. Furthermore, our results establish a new analysis approach to efficiently contrast high-dimensional neuroimaging data between experimental groups or conditions.

HighlightsO_LIA novel multistage approach to analyze high-dimensional neuronal coupling data.
C_LIO_LIApplication to MEG recordings in relapsing-remitting Multiple Sclerosis patients.
C_LIO_LIIdentification of altered phase- and amplitude-coupling in Multiple Sclerosis.
C_LIO_LIClassification of patients and controls with 84% accuracy.
C_LIO_LIClassification confidence predicts behavioral scores of disease severity.
C_LI
Targeted Memory Reactivation of Face-Name LearningDepends on Ample and Undisturbed Slow-Wave Sleep
Authors: Whitmore, N. W.; Bassard, A. M.; Paller, K. A.
Category: neuroscience
Date: 2021-02-18

Face memory, including the ability to recall the name of a familiar person, is often crucial in social interactions, and like many other memory functions, it may rely on sleep. We investigated whether targeted memory reactivation during sleep could improve associative and perceptual aspects of face memory. Participants studied 80 face-name pairs, and then a subset of spoken names was presented unobtrusively during a daytime nap. This reactivation preferentially improved recall for those face-name pairs, as modulated by two factors related to sleep quality. That is, the memory benefit was positively correlated with the duration of stage N3 sleep (slow-wave sleep) and with the extent to which cues presented during SWS did not produce a sleep disruption indexed by increased alpha-band electroencephalographic activity in the 5 seconds after a cue. Follow-up analyses showed that a memory benefit from presenting spoken names during sleep was evident in participants with high amounts of SWS or with low amounts of sleep disruption. We conclude that sleep reactivation can strengthen memory for specific face-name associations and that the effectiveness of reactivation depends on uninterrupted N3 sleep.
Harmonised segmentation of neonatal brain MRI
Authors: Grigorescu, I.; Vanes, L.; Uus, A.; Batalle, D.; Cordero-Grande, L.; Nosarti, C.; Edwards, D.; Hajnal, J.; Modat, M.; Deprez, M.
Category: neuroscience
Date: 2021-02-18

Deep learning based medical image segmentation has shown great potential in becoming a key part of the clinical analysis pipeline. However, many of these models rely on the assumption that the train and test data come from the same distribution. This means that such methods cannot guarantee high quality predictions when the source and target domains are dissimilar due to different acquisition protocols, or biases in patient cohorts. Recently, unsupervised domain adaptation (DA) techniques have shown great potential in alleviating this problem by minimizing the shift between the source and target distributions, without requiring the use of labelled data in the target domain. In this work, we aim to predict tissue segmentation maps on T2-weighted (T2w) magnetic resonance imaging (MRI) data of an unseen preterm-born neonatal population, which has both different acquisition parameters and population bias when compared to our training data. We achieve this by investigating two unsupervised DA techniques with the objective of finding the best solution for our problem. We compare the two methods with a baseline fully-supervised segmentation network and report our results in terms of Dice scores obtained on our ground truth test dataset. Moreover, we analyse tissue volumes and cortical thickness (CT) measures of the harmonised data on a subset of the population matched for gestational age (GA) at birth and postmenstrual age (PMA) at scan. Finally, we demonstrate the applicability of the harmonised cortical gray matter maps with an analysis comparing term and preterm-born neonates and a proof-of-principle investigation of the association between CT and a language outcome measure.
Sharing happy stories increases interpersonal closeness mediated by enhancing interpersonal brain synchronization
Authors: Enhui, X.; Qin, Y.; Keshuang, L.; Nastase, S. A.; Ruqian, Z.; Ning, W.; Xianchun, L.
Category: neuroscience
Date: 2021-02-18

Our lives revolve around sharing stories with others. Expressing emotion (i.e., happy and sad) is an essential characteristic of sharing stories and could enhance the similarity of story comprehension across speaker-listener pairs. The Emotions as Social Information Model (EASI) suggests that emotional communication may influence interpersonal closeness, but the effect of sharing emotional (happy/sad) stories on interpersonal closeness remains poorly understood. Here, one speaker watched emotional videos and communicated the content of the videos to thirty-two listeners (happy/sad/neutral group). Both speaker and listeners neural activities were recorded using EEG. After listening, we assessed the interpersonal closeness between the speaker and listeners. Compared to the sad group, sharing happy stories showed a better recall quality and a higher rating of interpersonal closeness.

Meanwhile, the happy group showed higher interpersonal brain synchronization (IBS) in the prefrontal cortex (PFC) and temporal cortex (specifically TPJ) than the sad group. Moreover, such IBS mediated the relationship between the quality of sharing stories and interpersonal closeness, and happy emotion moderated this mediation model. The magnitude of IBS differentiated high interpersonal closeness from low interpersonal closeness. Exploratory analysis using support vector regression showed that the IBS could also predict the ratings of interpersonal closeness in left-out subjects. These results suggest that IBS could serve as an indicator of whether sharing emotional stories facilitate interpersonal closeness. These findings improve our understanding of sharing emotional information among individuals that guide behaviors during interpersonal interactions.
The P3b differentiates parallel physical and rule-based updating of a sensory model
Authors: Schwartze, M.; Bellotti, F. I.; Kotz, S. A.
Category: neuroscience
Date: 2021-02-18

The capacity to form and update mental representations of the type and timing of sensory events is a central tenet of adaptive behavior in a dynamically changing environment. An internal model of stimulus contingencies provides a means to optimize behavior through predictive adjustments based on past to future events. To this end, neural and cognitive processes rely on systematic relations between events and use these rules to optimize information processing. The P3 complex of the event-related potential of the electroencephalogram (ERP/EEG) is a well-established and extensively tested index of such mechanisms. Here we investigated the P3b sensitivity to auditory stimulus deviations associated with two updating operations: physical change (switching stimulus pitches) and rule change (switching additive and subtractive target stimulus counting). Participants listened to a variant of the classical oddball sequence consisting of frequent standard (600 Hz) and two equally probable less frequent deviant tones (660 Hz, 540 Hz), keeping count of the deviant tones and switching between addition and subtraction with a pitch change. The results indicate specific amplitude modulations, confirming the P3b as a context-sensitive marker of physical and cognitive components of an internal model. This suggests that the P3b can be used as a differential marker of predictive coding mechanisms.
Feature-based attention induces non-linearities in neuronal tuning and behavior during visual motion perception
Authors: Yoo, S.-A.; Martinez-Trujillo, J.; Treue, S.; Tsotsos, J. K.; Fallah, M.
Category: neuroscience
Date: 2021-06-16

Feature-based attention prioritizes the processing of the attended feature while strongly suppressing the processing of nearby ones. This creates a non-linearity or attentional suppressive surround predicted by the Selective Tuning model of visual attention. However, previously reported effects of feature-based attention on neuronal responses are linear, e.g., feature-similarity gain. Here, we investigated this apparent contradiction by neurophysiological and psychophysical approaches. Responses of motion direction-selective neurons in area MT/MST of monkeys were recorded during a motion task. When attention was allocated to a stimulus moving in the neurons preferred direction response tuning curves showed its minimum for directions 60-90 degrees away from the preferred direction, an attentional suppressive surround. This effect was modeled via the interaction of two Gaussian fields representing excitatory narrowly-tuned and inhibitory widely-tuned inputs into a neuron, with feature-based attention predominantly increasing the gain of inhibitory inputs. We further showed using a motion repulsion paradigm in humans that feature-based attention produces a similar non-linearity on motion discrimination performance. Our results link the gain modulation of neuronal inputs and tuning curves examined through the feature-similarity gain lens to the attentional impact on neural population responses predicted by the Selective Tuning model, providing a unified framework for the documented effects of feature-based attention on neuronal responses and behavior.
Perceptual history acts in world-centred coordinates
Authors: Mikellidou, K.; Cicchini, G. M.; Burr, D. C.
Category: neuroscience
Date: 2021-02-18

Serial dependence effects have been observed using a variety of stimuli and tasks, revealing that the recent past can bias current percepts, leading to increased similarity between two. The aim of this study is to determine whether this temporal integration occurs in egocentric or allocentric coordinates. We ask participants to perform an orientation reproduction task using grating stimuli while the head is kept at a fixed position throughout the whole session or while alternating position from one trial to the next, from left (-20{degrees}) to right (+20{degrees}), putting the egocentric and allocentric cues in conflict. Under these conditions, allocentric cues prevail.
Contribution of interneuron subtype-specific GABAergic signalling to emergent sensory processing in somatosensory whisker barrel cortex in mouse.
Authors: Baruchin, L. J.; Kohl, M. M.; Butt, S. J. B.
Category: neuroscience
Date: 2021-02-18

Mammalian neocortex is important for conscious processing of sensory information. Fundamental to this function is balanced glutamatergic and GABAergic signalling. Yet little is known about how this interaction arises in the developing forebrain despite increasing insight into early GABAergic interneuron (IN) circuits. To further study this, we assessed the contribution of specific INs to the development of sensory processing in the mouse whisker barrel cortex. Specifically we explored the role of INs in speed coding and sensory adaptation. In wild-type animals, both speed processing and adaptation were present as early as the layer 4 critical period of plasticity, and showed refinement over the period leading to active whisking onset. We then conditionally silenced action-potential-dependent GABA release in either somatostatin (SST) or vasoactive intestinal peptide (VIP) INs. These genetic manipulations influenced both spontaneous and sensory-evoked activity in an age and layer-dependent manner. Silencing SST+ INs reduced early spontaneous activity and abolished facilitation in sensory adaptation observed in control pups. In contrast, VIP+ IN silencing had an effect towards the onset of active whisking. Silencing either IN subtype had no effect on speed coding. Our results reveal how these IN subtypes differentially contribute to early sensory processing over the first few postnatal weeks.
Disrupting short-term memory in premotor cortex affects serial dependence in visuomotor integration
Authors: de Azevedo Neto, R. M.; Bartels, A.
Category: neuroscience
Date: 2021-06-17

Human behavior is biased by past experience. For example, when intercepting a moving target, the speed of previous targets will bias responses in future trials. Neural mechanisms underlying this so-called serial dependence are still under debate. Here, we tested the hypothesis that the previous trial leaves a neural trace in brain regions associated with encoding task-relevant information in visual and/or motor regions. We reasoned that injecting noise by means of transcranial magnetic stimulation (TMS) over premotor and visual areas would degrade such memory traces and hence reduce serial dependence. To test this hypothesis, we applied bursts of TMS pulses to right visual motion processing region hV5/MT+ and to left dorsal premotor cortex during inter-trial intervals of a coincident timing task performed by twenty healthy human participants (15 female). Without TMS, participants presented a bias towards the speed of the previous trial when intercepting moving targets. TMS over dorsal premotor cortex decreased serial dependence in comparison to the control Vertex stimulation, whereas TMS applied over hV5/MT+ did not. In addition, TMS seems to have specifically affected the memory trace that leads to serial dependence, as we found no evidence that participants behavior worsened after applying TMS. These results provide causal evidence that an implicit short-term memory mechanism in premotor cortex keeps information from one trial to the next, and that this information is blended with current trial information so that it biases behavior in a visuomotor integration task with moving objects.

Significance StatementHuman perception and action are biased by the recent past. The origin of such serial bias is still not fully understood, but a few components seem to be fundamental for its emergence: the brain needs to keep previous trial information in short-term memory and blend it with incoming information. Here, we present evidence that a premotor area has a potential role in storing previous trial information in short-term memory in a visuomotor task, and that this information is responsible for biasing ongoing behavior. These results corroborate the perspective that areas associated with processing information of a stimulus or task also participate in maintaining that information in short-term memory even when this information is no longer relevant for current behavior.
Functional MRI of native and non-native speech production in sequential German-English bilinguals
Authors: Treutler, M.; Sörös, P.
Category: neuroscience
Date: 2021-02-18

Bilingualism and multilingualism are highly prevalent. Non-invasive brain imaging has been used to study the neural correlates of native (L1) and non-native (L2) speech and language production, mainly on the lexical and syntactic level. Here, we acquired continuous fast event-related FMRI during visually cued overt production of exclusively German and English vowels and syllables. We analyzed data from 13 university students, native speakers of German and sequential English bilinguals. The production of non-native English sounds was associated with increased activity of the left primary sensori-motor cortex, bilateral cerebellar hemispheres (lobule VI), left inferior frontal gyrus, and left anterior insula compared to native German sounds. The contrast German > English sounds was not statistically significant. Our results emphasize that the production of non-native speech requires additional neural resources already on a basic phonological level in sequential bilinguals.
MEG, myself, and I: individual identification from neurophysiological brain activity
Authors: da Silva Castanheira, J.; Orozco, H. D.; Misic, B.; Baillet, S.
Category: neuroscience
Date: 2021-07-03

Large, openly available datasets and current analytic tools promise the emergence of population neuroscience. The considerable diversity in personality traits and behaviour between individuals is reflected in the statistical variability of neural data collected in such repositories. This amount of variability challenges the sensitivity and specificity of analysis methods to capture the personal characteristics of a putative neural portrait. Recent studies with functional magnetic resonance imaging (fMRI) have concluded that patterns of resting-state functional connectivity can both successfully identify individuals within a cohort and predict some individual traits, yielding the notion of a neural fingerprint. Here, we aimed to clarify the neurophysiological foundations of individual differentiation from features of the rich and complex dynamics of resting-state brain activity using magnetoencephalography (MEG) in 158 participants. Akin to fMRI approaches, neurophysiological functional connectomes enabled the identification of individuals, with identifiability rates similar to fMRIs. We also show that individual identification was equally successful from simpler measures of the spatial distribution of neurophysiological spectral signal power. Our data further indicate that identifiability can be achieved from brain recordings as short as 30 seconds, and that it is robust over time: individuals remain identifiable from recordings performed weeks after their baseline reference data was collected. Based on these results, we can anticipate a vast range of further research and practical applications of individual differentiation from neural electrophysiology in personalized, clinical, and basic neuroscience.
The heart rate discrimination task: a psychophysical method to estimate the accuracy and precision of interoceptive beliefs
Authors: Legrand, N.; Nikolova, N.; Correa, C.; Braendholt, M.; Stuckert, A.; Kildahl, N.; Vejlo, M.; Fardo, F.; Allen, M.
Category: neuroscience
Date: 2021-11-19

Interoception - the physiological sense of our inner bodies - has risen to the forefront of psychological and psychiatric research. Much of this research utilizes tasks that attempt to measure the ability to accurately detect cardiac signals. Unfortunately, these approaches are confounded by well-known issues limiting their validity and interpretation. At the core of this controversy is the role of subjective beliefs about the heart rate in confounding measures of interoceptive accuracy. Here, we recast these beliefs as an important part of the causal machinery of interoception, and offer a novel psychophysical "heart rate discrimination" method to estimate their accuracy and precision. By applying this task in 223 healthy participants, we demonstrate that cardiac interoceptive beliefs are more biased, less precise, and are associated with poorer metacognitive insight relative to an exteroceptive control condition. Our task, provided as an open-source python package, offers a robust approach to quantifying cardiac beliefs.

HighlightsO_LICurrent interoception tasks conflate cardiac beliefs with accuracy.
C_LIO_LIWe introduce a Bayesian method for estimating cardiac belief accuracy and precision.
C_LIO_LIIndividuals underestimate their heart rate by -7 BPM (95% CI [-8.6 -5.3]) on average.
C_LIO_LICardiac beliefs are associated with reduced precision and metacognitive insight.
C_LIO_LIThe task and modelling tools are provided in the Python Cardioception Package.
C_LI