PenguinMan/ARXIV huggingface dataset:
A simple model for learning in volatile environments
Authors: Payam Piray, Nathaniel D Daw
Journal: PLOS Computational Biology
Accepted: 2020-05-18T00:00:00Z


Sound principles of statistical inference dictate that uncertainty shapes learning. In this work, we revisit the question of learning in volatile environments, in which both the first and second-order statistics of observations dynamically evolve over time. We propose a new model, the volatile Kalman filter (VKF), which is based on a tractable state-space model of uncertainty and extends the Kalman filter algorithm to volatile environments. The proposed model is algorithmically simple and encompasses the Kalman filter as a special case. Specifically, in addition to the error-correcting rule of Kalman filter for learning observations, the VKF learns volatility according to a second error-correcting rule. These dual updates echo and contextualize classical psychological models of learning, in particular hybrid accounts of Pearce-Hall and Rescorla-Wagner. At the computational level, compared with existing models, the VKF gives up some flexibility in the generative model to enable a more faithful approximation to exact inference. When fit to empirical data, the VKF is better behaved than alternatives and better captures human choice data in two independent datasets of probabilistic learning tasks. The proposed model provides a coherent account of learning in stable or volatile environments and has implications for decision neuroscience research.
Author summary: Sound principles of statistical learning dictate that uncertainty influences behavior. However, despite the success of statistically founded algorithms for learning in stable environments, in which uncertainty behaves in simple and predictable ways, it is challenging to develop a simple yet efficient algorithm for learning in volatile environments, in which uncertainty dynamically changes over time. In this article, we develop a model for learning in volatile environments. The proposed model is consistent with key concepts of classical learning theories from behavioral psychology. Furthermore, our model is algorithmically simpler, theoretically more accurate, and empirically more parsimonious than the state-of-the-art models of learning in volatile environments. The proposed model provides a coherent theory of learning under uncertainty.
Tcf4 regulates dendritic spine density and morphology in the adult brain
Authors: Sophie Crux, Jochen Herms, Mario M Dorostkar
Journal: PLOS ONE
Accepted: 2018-06-06T00:00:00Z


Tcf4 is a transcription factor which regulates neurogenesis and neuronal migration in the brain. In humans, loss of function of Tcf4 leads to the rare neurodevelopmental disorder Pitt-Hopkins syndrome, which is characterized by intellectual disability, developmental delay and autistic behavior. We analyzed the consequences of functional loss of Tcf4 on dendritic spines in mature principal neurons. To this end, we crossed mice in which the DNA-binding domain of the Tcf4 gene is flanked by LoxP sites to mice expressing tamoxifen-inducible cre recombinase in a sparse subset of fluorescently labelled neurons (SlickV line). This resulted in a mouse model with an inducible functional knockout of Tcf4 in a subset of cortical and hippocampal neurons, in which we analyzed dendritic spines, which are the morphological correlate of excitatory postsynapses. Heterozygous as well as homozygous loss of Tcf4 led to a reduction in the number of dendritic spines in the cortex as well as in the hippocampus. This was accompanied by morphological changes of dendritic spines. These results suggest that Tcf4 is involved in synaptic plasticity in mature neurons, and functional loss of Tcf4 may contribute to the neurological symptoms in Pitt-Hopkins syndrome.
Characterising the influence of cerebellum on the neuroplastic modulation of intracortical motor circuits
Authors: George M Opie, John G Semmler
Journal: PLOS ONE
Accepted: 2020-06-19T00:00:00Z


The cerebellum (CB) has extensive connections with both cortical and subcortical areas of the brain, and is known to strongly influence function in areas it projects to. In particular, research using non-invasive brain stimulation (NIBS) has shown that CB projections to primary motor cortex (M1) are likely important for facilitating the learning of new motor skills, and that this process may involve modulation of late indirect (I) wave inputs in M1. However, the nature of this relationship remains unclear, particularly in regards to how CB influences the contribution of the I-wave circuits to neuroplastic changes in M1. Within the proposed research, we will therefore investigate how CB effects neuroplasticity of the I-wave generating circuits. This will be achieved by downregulating CB excitability while concurrently applying a neuroplastic intervention that specifically targets the I-wave circuitry. The outcomes of this study will provide valuable neurophysiological insight into key aspects of the motor network, and may inform the development of optimized interventions for modifying motor learning in a targeted way.
Visual attention is not deployed at the endpoint of averaging saccades
Authors: Luca Wollenberg, Heiner Deubel, Martin Szinte
Journal: PLOS Biology
Accepted: 2018-06-06T00:00:00Z


The premotor theory of attention postulates that spatial attention arises from the activation of saccade areas and that the deployment of attention is the consequence of motor programming. Yet attentional and oculomotor processes have been shown to be dissociable at the neuronal level in covert attention tasks. To investigate a potential dissociation at the behavioral level, we instructed human participants to move their eyes (saccade) towards 1 of 2 nearby, competing saccade targets. The spatial distribution of visual attention was determined using oriented visual stimuli presented either at the target locations, between them, or at several other equidistant locations. Results demonstrate that accurate saccades towards one of the targets were associated with presaccadic enhancement of visual sensitivity at the respective saccade endpoint compared to the nonsaccaded target location. In contrast, averaging saccades, landing between the 2 targets, were not associated with attentional facilitation at the saccade endpoint. Rather, attention before averaging saccades was equally deployed at the 2 target locations. Taken together, our results reveal that visual attention is not obligatorily coupled to the endpoint of a subsequent saccade. Rather, our results suggest that the oculomotor program depends on the state of attentional selection before saccade onset and that saccade averaging arises from unresolved attentional selection.
Author summary: The premotor theory of attention postulates that spatial visual attention is a consequence of the brain activity that controls eye movement. Indeed, attention and eye movement share overlapping brain networks, and attention is deployed at the target of an eye movement (saccade) even before the eyes start to move. But is attention always deployed at the endpoint of saccades? Here, we measured visual attention before accurate saccades and before saccades that landed in between 2 targets (averaging saccades). While accurate saccades were associated with a selective enhancement of visual sensitivity at their endpoint, no such enhancement was found at the endpoint of averaging saccades. Rather, visual sensitivity was evenly distributed across the 2 saccade targets, suggesting that saccade averaging arises from unresolved attentional selection. Overall, our results reveal that attention is not always coupled to the endpoint of saccades, arguing against a simplistic view of the premotor theory of attention at the behavioral level. Instead, we propose that saccadic responses depend on the state of attentional selection at saccade onset.
Frontal cortex tracks surprise separately for different sensory modalities but engages a common inhibitory control mechanism
Authors: Jan R Wessel, David E Huber
Journal: PLOS Computational Biology
Accepted: 2019-05-24T00:00:00Z


The brain constantly generates predictions about the environment to guide action. Unexpected events lead to surprise and can necessitate the modification of ongoing behavior. Surprise can occur for any sensory domain, but it is not clear how these separate surprise signals are integrated to affect motor output. By applying a trial-to-trial Bayesian surprise model to human electroencephalography data recorded during a cross-modal oddball task, we tested whether there are separate predictive models for different sensory modalities (visual, auditory), or whether expectations are integrated across modalities such that surprise in one modality decreases surprise for a subsequent unexpected event in the other modality. We found that while surprise was represented in a common frontal signature across sensory modalities (the fronto-central P3 event-related potential), the single-trial amplitudes of this signature more closely conformed to a model with separate surprise terms for each sensory domain. We then investigated whether surprise-related fronto-central P3 activity indexes the rapid inhibitory control of ongoing behavior after surprise, as suggested by recent theories. Confirming this prediction, the fronto-central P3 amplitude after both auditory and visual unexpected events was highly correlated with the fronto-central P3 found after stop-signals (measured in a separate stop-signal task). Moreover, surprise-related and stopping-related activity loaded onto the same component in a cross-task independent components analysis. Together, these findings suggest that medial frontal cortex maintains separate predictive models for different sensory domains, but engages a common mechanism for inhibitory control of behavior regardless of the source of surprise.
Author summary: Surprise is an elementary cognitive computation that the brain performs to guide behavior. We investigated how the brain tracks surprise across different senses: Do unexpected sounds make subsequent unexpected visual stimuli less surprising? Or does the brain maintain separate expectations of environmental regularities for different senses? We found that the latter is the case. However, even though surprise was separately tracked for auditory and visual events, it elicited a common signature over frontal cortex in both sensory domains. Importantly, we observed the same neural signature when actions had to be stopped after non-surprising stop-signals in a motor inhibition task. This suggests that this signature reflects a rapid interruption of ongoing behavior when our surroundings do not conform to our expectations.
Effect of inhibition indexed by auditory P300 on transmission of visual sensory information
Authors: Amirmahmoud Houshmand Chatroudi, Reza Rostami, Ali Motie Nasrabadi, Yuko Yotsumoto
Journal: PLOS ONE
Accepted: 2021-02-07T00:00:00Z


Early electroencephalographic studies that focused on finding brain correlates of psychic events led to the discovery of the P300. Since then, the P300 has become the focus of many basic and clinical neuroscience studies. However, despite its wide applications, the underlying function of the P300 is not yet clearly understood. One line of research among the many studies that have attempted to elucidate the underlying subroutine of the P300 in the brain has suggested that the physiological function of the P300 is related to inhibition. While some intracranial, behavioral, and event-related potential studies have provided support for this theory, little is known about the inhibitory mechanism. In this study, using alpha event-related desynchronization (ERD) and effective connectivity, based on the causal (one-way directed) relationship between alpha ERD and P300 sources, we demonstrated that P300’s associated inhibition is implemented at a higher information processing stage in a localized brain region. We discuss how inhibition as the primary function of the P300 is not inconsistent with ’resource allocation’ and ’working memory updating’ theories about its cognitive function. In light of our findings regarding the scope and information processing stage of inhibition of the P300, we reconcile the inhibitory account of the P300 with working memory updating theory. Finally, based on the compensatory behavior of alpha ERD at the time of suppression of the P300, we propose two distinct yet complementary working memory mechanisms (inhibition and desynchronizing excitation) that render target perception possible.
The metastable brain associated with autistic-like traits of typically developing individuals
Authors: Takumi Sase, Keiichi Kitajo
Journal: PLOS Computational Biology
Accepted: 2021-03-31T00:00:00Z


Metastability in the brain is thought to be a mechanism involved in the dynamic organization of cognitive and behavioral functions across multiple spatiotemporal scales. However, it is not clear how such organization is realized in underlying neural oscillations in a high-dimensional state space. It was shown that macroscopic oscillations often form phase-phase coupling (PPC) and phase-amplitude coupling (PAC), which result in synchronization and amplitude modulation, respectively, even without external stimuli. These oscillations can also make spontaneous transitions across synchronous states at rest. Using resting-state electroencephalographic signals and the autism-spectrum quotient scores acquired from healthy humans, we show experimental evidence that the PAC combined with PPC allows amplitude modulation to be transient, and that the metastable dynamics with this transient modulation is associated with autistic-like traits. In individuals with a longer attention span, such dynamics tended to show fewer transitions between states by forming delta-alpha PAC. We identified these states as two-dimensional metastable states that could share consistent patterns across individuals. Our findings suggest that the human brain dynamically organizes inter-individual differences in a hierarchy of macroscopic oscillations with multiple timescales by utilizing metastability.
Author summary: The human brain organizes cognitive and behavioral functions dynamically. For decades, the dynamic organization of underlying neural oscillations has been a fundamental topic in neuroscience research. Even without external stimuli, macroscopic oscillations often form phase-phase coupling and phase-amplitude coupling (PAC) that result in synchronization and amplitude modulation, respectively, and can make spontaneous transitions across synchronous states at rest. Using resting-state electroencephalography signals acquired from healthy humans, we show evidence that these two neural couplings enable amplitude modulation to be transient, and that this transient modulation can be viewed as the transition among oscillatory states with different PAC strengths. We also demonstrate that such transition dynamics are associated with the ability to maintain attention to detail and to switch attention, as measured by autism-spectrum quotient scores. These individual dynamics were visualized as a trajectory among states with attracting tendencies, and involved consistent brain states across individuals. Our findings have significant implications for unraveling the variability in the individual brains showing typical and atypical development.
No fruits without color: Cross-modal priming and EEG reveal different roles for different features across semantic categories
Authors: Georgette Argiris, Raffaella I Rumiati, Davide Crepaldi
Journal: PLOS ONE
Accepted: 2021-03-22T00:00:00Z


Category-specific impairments witnessed in patients with semantic deficits have broadly dissociated into natural and artificial kinds. However, how the category of food (more specifically, fruits and vegetables) fits into this distinction has been difficult to interpret, given a pattern of deficit that has inconsistently mapped onto either kind, despite its intuitive membership to the natural domain. The present study explores the effects of a manipulation of a visual sensory (i.e., color) or functional (i.e., orientation) feature on the consequential semantic processing of fruits and vegetables (and tools, by comparison), first at the behavioral and then at the neural level. The categorization of natural (i.e., fruits/vegetables) and artificial (i.e., utensils) entities was investigated via cross–modal priming. Reaction time analysis indicated a reduction in priming for color-modified natural entities and orientation-modified artificial entities. Standard event-related potentials (ERP) analysis was performed, in addition to linear classification. For natural entities, a N400 effect at central channel sites was observed for the color-modified condition compared relative to normal and orientation conditions, with this difference confirmed by classification analysis. Conversely, there was no significant difference between conditions for the artificial category in either analysis. These findings provide strong evidence that color is an integral property to the categorization of fruits/vegetables, thus substantiating the claim that feature-based processing guides as a function of semantic category.
The biophysical basis underlying the maintenance of early phase long-term potentiation
Authors: Moritz F P Becker, Christian Tetzlaff
Journal: PLOS Computational Biology
Accepted: 2021-02-17T00:00:00Z


The maintenance of synaptic changes resulting from long-term potentiation (LTP) is essential for brain function such as memory and learning. Different LTP phases have been associated with diverse molecular processes and pathways, and the molecular underpinnings of LTP on the short, as well as long time scales, are well established. However, the principles on the intermediate time scale of 1-6 hours that mediate the early phase of LTP (E-LTP) remain elusive. We hypothesize that the interplay between specific features of postsynaptic receptor trafficking is responsible for sustaining synaptic changes during this LTP phase. We test this hypothesis by formalizing a biophysical model that integrates several experimentally-motivated mechanisms. The model captures a wide range of experimental findings and predicts that synaptic changes are preserved for hours when the receptor dynamics are shaped by the interplay of structural changes of the spine in conjunction with increased trafficking from recycling endosomes and the cooperative binding of receptors. Furthermore, our model provides several predictions to verify our findings experimentally.
Author Summary: The cognitive ability of learning is associated with plasticity-induced changes in synaptic transmission efficacy mediated by AMPA receptors. Synaptic changes depend on a multitude of molecular and physiological mechanisms, building complex interaction networks. By formalizing and employing a biophysical model of AMPAR trafficking, we unravel and evaluate the interplay between key mechanisms such as receptor binding, exocytosis, morphological changes, and cooperative receptor binding. Our findings indicate that cooperative receptor binding in conjunction with morphological changes of the spine and increased trafficking from recycling endosomes leads to the maintenance of synaptic changes on behaviorally relevant time spans.
Hippocampal cells integrate past memory and present perception for the future
Authors: Cen Yang, Yuji Naya
Journal: PLOS Biology
Accepted: 2020-09-22T00:00:00Z


The ability to use stored information in a highly flexible manner is a defining feature of the declarative memory system. However, the neuronal mechanisms underlying this flexibility are poorly understood. To address this question, we recorded single-unit activity from the hippocampus of 2 nonhuman primates performing a newly devised task requiring the monkeys to retrieve long-term item-location association memory and then use it flexibly in different circumstances. We found that hippocampal neurons signaled both mnemonic information representing the retrieved location and perceptual information representing the external circumstance. The 2 signals were combined at a single-neuron level to construct goal-directed information by 3 sequentially occurring neuronal operations (e.g., convergence, transference, and targeting) in the hippocampus. Thus, flexible use of knowledge may be supported by the hippocampal constructive process linking memory and perception, which may fit the mnemonic information into the current situation to present manageable information for a subsequent action.

This study reveals that three neuronal operations in the macaque hippocampus combine retrieved memory and incoming perceptual information to construct goal-directed information; this constructive memory process may equip us to use past knowledge flexibly according to the current situation.
Electrophysiological correlates of focused attention on low- and high-distressed tinnitus
Authors: Rafał Milner, Monika Lewandowska, Małgorzata Ganc, Jan Nikadon, Iwona Niedziałek, Wiesław Wiktor Jędrzejczak, Henryk Skarżyński
Journal: PLOS ONE
Accepted: 2020-07-07T00:00:00Z

Objectives: The study aimed at determining the EEG correlates of concentration on either low or high-distressed tinnitus. Methods: Sixty-seven patients (36 women, mean age = 50.34 ± 12.94 years) with chronic tinnitus were assigned to either a high (HD) or low (LD) tinnitus-related distress group based on THI results. All participants took part in the EEG study comprising two 3–4 min blocks of focusing on either tinnitus (Tinnitus Focus Condition, TFC) or the sensations from one’s own body (Body Focus Condition, BFC). The absolute power and current density of 8 frequency bands in 7 clusters were compared between conditions and groups. Results: The most pronounced differences were found in the HD patients in the TFC, relative to the BFC, i.e. reduced power of frontally distributed low alpha (8–10 Hz) and posterior high alpha (10–12 Hz) as well as lower current density of 8–10 Hz rhythm over the right frontal/anterior cingulate cortex and higher middle beta (15–18 Hz) density in the precuneus. The HD, relative to LD patients, in both conditions, exhibited increased low beta (12–15 Hz) power over the left middle area and greater higher beta (15–25 Hz) power in the left posterior region. Conclusions: The present study contrasted bioelectrical activity, acquired when concentrating on tinnitus with EEG data collected whilst patients focused on their body. Decreased alpha power and current density in the frontal/cingulate cortex when listening to bothersome tinnitus might reflect greater cortical arousal whereas increased beta power and density in the precuneus/posterior cingulate activity in this condition could be indicative for elevated tension or augmented cognitive/emotional processing of tinnitus sound. Enhanced beta rhythm in patients with high versus low tinnitus distress, observed independently of the study condition, may be due to greater self-focused attention or more active processing of sensations derived from the own body.