PenguinMan/ARXIV huggingface dataset:
Error-based or target-based? A unified framework for learning in recurrent spiking networks
Authors: Cristiano Capone, Paolo Muratore, Pier Stanislao Paolucci
Journal: PLOS Computational Biology
Accepted: 2022-05-17T00:00:00Z


The field of recurrent neural networks is over-populated by a variety of proposed learning rules and protocols. The scope of this work is to define a generalized framework, to move a step forward towards the unification of this fragmented scenario. In the field of supervised learning, two opposite approaches stand out, error-based and target-based. This duality gave rise to a scientific debate on which learning framework is the most likely to be implemented in biological networks of neurons. Moreover, the existence of spikes raises the question of whether the coding of information is rate-based or spike-based. To face these questions, we proposed a learning model with two main parameters, the rank of the feedback learning matrix R and the tolerance to spike timing τ⋆. We demonstrate that a low (high) rank R accounts for an error-based (target-based) learning rule, while high (low) tolerance to spike timing promotes rate-based (spike-based) coding. We show that in a store and recall task, high-ranks allow for lower MSE values, while low-ranks enable a faster convergence. Our framework naturally lends itself to Behavioral Cloning and allows for efficiently solving relevant closed-loop tasks, investigating what parameters ( R , τ ⋆ ) are optimal to solve a specific task. We found that a high R is essential for tasks that require retaining memory for a long time (Button and Food). On the other hand, this is not relevant for a motor task (the 2D Bipedal Walker). In this case, we find that precise spike-based coding enables optimal performances. Finally, we show that our theoretical formulation allows for defining protocols to estimate the rank of the feedback error in biological networks. We release a PyTorch implementation of our model supporting GPU parallelization.
Author summary: Learning in biological or artificial networks means changing the laws governing the network dynamics in order to better behave in a specific situation. However, there exists no consensus on what rules regulate learning in biological systems. To face these questions, we propose a novel theoretical formulation for learning with two main parameters, the number of learning constraints (R) and the tolerance to spike timing (τ⋆). We demonstrate that a low (high) rank R accounts for an error-based (target-based) learning rule, while high (low) tolerance to spike timing τ⋆ promotes rate-based (spike-based) coding.
Cognitive function in non-hospitalized patients 8–13 months after acute COVID-19 infection: A cohort study in Norway
Authors: Knut Stavem, Gunnar Einvik, Birgitte Tholin, Waleed Ghanima, Erik Hessen, Christofer Lundqvist
Journal: PLOS ONE
Accepted: 2022-08-05T00:00:00Z


Studies have reported reduced cognitive function following COVID-19 illness, mostly from hospital settings with short follow-up times. This study recruited non-hospitalized COVID-19 patients from a general population to study prevalence of late cognitive impairment and associations with initial symptoms. We invited patients with PCR-confirmed COVID-19. A postal questionnaire addressed basic demographics, initial COVID-19 symptoms and co-morbidity about 4 months after diagnosis. About 7 months later, we conducted cognitive tests using the Cambridge Neuropsychological Test Automated Battery, comprising four tests for short-term memory, attention and executive function. We present descriptive statistics using z-scores relative to UK population norms and defined impairment as z-score <-1.5. We used multivariable logistic regression with impairment as outcome. Continuous domain scores were analysed by multiple linear regression. Of the initial 458 participants; 305 were invited, and 234 (77%) completed cognitive testing. At median 11 (range 8–13) months after PCR positivity, cognitive scores for short term memory, visuospatial processing, learning and attention were lower than norms (p≤0.001). In each domain, 4–14% were cognitively impaired; 68/232 (29%) were impaired in ≥ 1 of 4 tests. There was no association between initial symptom severity and impairment. Multivariable linear regression showed association between spatial working memory and initial symptom load (6–9 symptoms vs. 0–5, coef. 4.26, 95% CI: 0.65; 7.86). No other dimension scores were associated with symptom load. At median 11 months after out-of-hospital SARS-Cov-2 infection, minor cognitive impairment was seen with little association between COVID-19 symptom severity and outcome.
GAD65 deficient mice are susceptible to ethanol-induced impairment of motor coordination and facilitation of cerebellar neuronal firing
Authors: Wataru Matsunaga, Toru Shinoe, Moritoshi Hirono
Journal: PLOS ONE
Accepted: 2023-05-06T00:00:00Z


γ-aminobutyric acid (GABA) is a major inhibitory neurotransmitter and its concentrations in the brain could be associated with EtOH-induced impairment of motor coordination. GABA is synthesized by two isoforms of glutamate decarboxylase (GAD): GAD65 and GAD67. Mice deficient in GAD65 (GAD65-KO) can grow up to adulthood, and show that GABA concentration in their adult brains was 50–75% that of wild-type C57BL/6 mice (WT). Although a previous study showed that there was no difference in recovery from the motor-incoordination effect of acute intraperitoneally administered injections of 2.0 g/kg EtOH between WT and GAD65-KO, the sensitivity of GAD65-KO to acute EtOH-induced ataxia has not been fully understood. Here, we sought to determine whether motor coordination and spontaneous firing of cerebellar Purkinje cells (PCs) in GAD65-KO are more sensitive to the effect of EtOH than in WT. Motor performance in WT and GAD65-KO was examined by rotarod and open-field tests following acute administration of EtOH at lower-doses, 0.8, 1.2 and 1.6 g/kg. In a rotarod test, there was no significant difference between WT and GAD65-KO in terms of baseline motor coordination. However, only the KO mice showed a significant decrease in rotarod performance of 1.2 g/kg EtOH. In the open-field test, GAD65-KO showed a significant increase in locomotor activity after 1.2 and 1.6 g/kg EtOH injections, but not WT. In in vitro studies of cerebellar slices, the firing rate of PCs was increased by 50 mM EtOH in GAD65-KO compared with WT, whereas no difference was observed in the effect of EtOH at more than 100 mM between the genotypes. Taken together, GAD65-KO are more susceptible to the effect of acute EtOH exposure on motor coordination and PC firing than WT. This different sensitivity could be attributed to the basal low GABA concentration in the brain of GAD65-KO.
Not explicit but implicit memory is influenced by individual perception style
Authors: Kyoko Hine, Yoshiaki Tsushima
Journal: PLOS ONE
Accepted: 2018-01-09T00:00:00Z


Not only explicit but also implicit memory has considerable influence on our daily life. However, it is still unclear whether explicit and implicit memories are sensitive to individual differences. Here, we investigated how individual perception style (global or local) correlates with implicit and explicit memory. As a result, we found that not explicit but implicit memory was affected by the perception style: local perception style people more greatly used implicit memory than global perception style people. These results help us to make the new effective application adapting to individual perception style and understand some clinical symptoms such as autistic spectrum disorder. Furthermore, this finding might give us new insight of memory involving consciousness and unconsciousness as well as relationship between implicit/explicit memory and individual perception style.
Iron is increased in the brains of ageing mice lacking the neurofilament light gene
Authors: James C Vickers, Anna E King, Graeme H McCormack, Aidan D Bindoff, Paul A Adlard
Journal: PLOS ONE
Accepted: 2019-10-06T00:00:00Z


There has been strong interest in the role of metals in neurodegeneration, and how ageing may predispose the brain to related diseases such as Alzheimer’s disease. Recent work has also highlighted a potential interaction between different metal species and various components of the cytoskeletal network in the brain, which themselves have a reported role in age-related degenerative disease and other neurological disorders. Neurofilaments are one such class of intermediate filament protein that have a demonstrated capacity to bind and utilise cation species. In this study, we investigated the consequences of altering the neurofilamentous network on metal ion homeostasis by examining neurofilament light (NFL) gene knockout mice, relative to wildtype control animals, at adulthood (5 months of age) and advanced age (22 months). Inductively coupled plasma mass spectroscopy demonstrated that the concentrations of iron (Fe), copper (Cu) and zinc (Zn) varied across brain regions and peripheral nerve samples. Zn and Fe showed statistically significant interactions between genotype and age, as well as between genotype and region, and Cu demonstrated a genotype and region interaction. The most substantial difference between genotypes was found in Fe in the older animals, where, across many regions examined, there was elevated Fe in the NFL knockout mice. This data indicates a potential relationship between the neurofilamentous cytoskeleton and the processing and/or storage of Fe through ageing.
Subgraphs of functional brain networks identify dynamical constraints of cognitive control
Authors: Ankit N Khambhati, John D Medaglia, Elisabeth A Karuza, Sharon L Thompson-Schill, Danielle S Bassett
Journal: PLOS Computational Biology
Accepted: 2018-05-27T00:00:00Z


Brain anatomy and physiology support the human ability to navigate a complex space of perceptions and actions. To maneuver across an ever-changing landscape of mental states, the brain invokes cognitive control—a set of dynamic processes that engage and disengage different groups of brain regions to modulate attention, switch between tasks, and inhibit prepotent responses. Current theory posits that correlated and anticorrelated brain activity may signify cooperative and competitive interactions between brain areas that subserve adaptive behavior. In this study, we use a quantitative approach to identify distinct topological motifs of functional interactions and examine how their expression relates to cognitive control processes and behavior. In particular, we acquire fMRI BOLD signal in twenty-eight healthy subjects as they perform two cognitive control tasks—a Stroop interference task and a local-global perception switching task using Navon figures—each with low and high cognitive control demand conditions. Based on these data, we construct dynamic functional brain networks and use a parts-based, network decomposition technique called non-negative matrix factorization to identify putative cognitive control subgraphs whose temporal expression captures distributed network structures involved in different phases of cooperative and competitive control processes. Our results demonstrate that temporal expression of the subgraphs fluctuate alongside changes in cognitive demand and are associated with individual differences in task performance. These findings offer insight into how coordinated changes in the cooperative and competitive roles of cognitive systems map trajectories between cognitively demanding brain states.
Author summary: Brain networks support the human ability to navigate a complex space of perceptions and actions through cognitive control. Here we ask, “How do brain networks coordinate task-relevant information as individuals adapt to cognitive demands imposed by a task?” We study the fMRI BOLD signal of twenty-eight healthy subjects as they perform two cognitive control tasks—a Stroop interference task and a local-global perception switching task using Navon figures—with low and high cognitive load conditions. We construct functional networks and use a machine learning technique called non-negative matrix factorization to identify topological motifs whose expression fluctuates across different phases of cognitive control processes. We find that motifs stratify the brain network into a hierarchy of distributed functional processes that adapt to changes in cognitive demand and predict individual differences in task performance. These data offer insight into how network interactions linking cognitive systems coordinate transitions between cognitively demanding brain states.
A strategy for mapping biophysical to abstract neuronal network models applied to primary visual cortex
Authors: Anton V Chizhov, Lyle J Graham
Journal: PLOS Computational Biology
Accepted: 2021-07-27T00:00:00Z


A fundamental challenge for the theoretical study of neuronal networks is to make the link between complex biophysical models based directly on experimental data, to progressively simpler mathematical models that allow the derivation of general operating principles. We present a strategy that successively maps a relatively detailed biophysical population model, comprising conductance-based Hodgkin-Huxley type neuron models with connectivity rules derived from anatomical data, to various representations with fewer parameters, finishing with a firing rate network model that permits analysis. We apply this methodology to primary visual cortex of higher mammals, focusing on the functional property of stimulus orientation selectivity of receptive fields of individual neurons. The mapping produces compact expressions for the parameters of the abstract model that clearly identify the impact of specific electrophysiological and anatomical parameters on the analytical results, in particular as manifested by specific functional signatures of visual cortex, including input-output sharpening, conductance invariance, virtual rotation and the tilt after effect. Importantly, qualitative differences between model behaviours point out consequences of various simplifications. The strategy may be applied to other neuronal systems with appropriate modifications.
Author summary: A hierarchy of theoretical approaches to study a neuronal network depends on a tradeoff between biological fidelity and mathematical tractibility. Biophysically-detailed models consider cellular mechanisms and anatomically defined synaptic circuits, but are often too complex to reveal insights into fundamental principles. In contrast, increasingly abstract reduced models facilitate analytical insights. To better ground the latter to the underlying biology, we describe a systematic procedure to move across the model hierarchy that allows understanding how changes in biological parameters—physiological, pathophysiological, or because of new data—impact the behaviour of the network. We apply this approach to mammalian primary visual cortex, and examine how the different models in the hierarchy reproduce functional signatures of this area, in particular the tuning of neurons to the orientation of a visual stimulus. Our work provides a navigation of the complex parameter space of neural network models faithful to biology, as well as highlighting how simplifications made for mathematical convenience can fundamentally change their behaviour.
Alix is required for activity-dependent bulk endocytosis at brain synapses
Authors: Marine H Laporte, Kwang Il Chi, Laura C Caudal, Na Zhao, Yvonne Schwarz, Marta Rolland, José Martinez-Hernandez, Magalie Martineau, Christine Chatellard, Eric Denarier, Vincent Mercier, Florent Lemaître, Béatrice Blot, Eve Moutaux, Maxime Cazorla, David Perrais, Fabien Lanté, Dieter Bruns, Sandrine Fraboulet, Fiona J Hemming, Frank Kirchhoff, Rémy Sadoul
Journal: PLOS Biology
Accepted: 2022-05-04T00:00:00Z


In chemical synapses undergoing high frequency stimulation, vesicle components can be retrieved from the plasma membrane via a clathrin-independent process called activity-dependent bulk endocytosis (ADBE). Alix (ALG-2-interacting protein X/PDCD6IP) is an adaptor protein binding to ESCRT and endophilin-A proteins which is required for clathrin-independent endocytosis in fibroblasts. Alix is expressed in neurons and concentrates at synapses during epileptic seizures. Here, we used cultured neurons to show that Alix is recruited to presynapses where it interacts with and concentrates endophilin-A during conditions triggering ADBE. Using Alix knockout (ko) neurons, we showed that this recruitment, which requires interaction with the calcium-binding protein ALG-2, is necessary for ADBE. We also found that presynaptic compartments of Alix ko hippocampi display subtle morphological defects compatible with flawed synaptic activity and plasticity detected electrophysiologically. Furthermore, mice lacking Alix in the forebrain undergo less seizures during kainate-induced status epilepticus and reduced propagation of the epileptiform activity. These results thus show that impairment of ADBE due to the lack of neuronal Alix leads to abnormal synaptic recovery during physiological or pathological repeated stimulations.

The adaptor protein Alix (PDCD6IP) is necessary for membrane shaping underlying various biological processes including endocytosis. This study shows that Alix mediates activity-dependent bulk endocytosis and is required for correct synaptic physiology under normal and pathological conditions.
Rule-based and stimulus-based cues bias auditory decisions via different computational and physiological mechanisms
Authors: Nathan Tardiff, Lalitta Suriya-Arunroj, Yale E Cohen, Joshua I Gold
Journal: PLOS Computational Biology
Accepted: 2022-09-26T00:00:00Z


Expectations, such as those arising from either learned rules or recent stimulus regularities, can bias subsequent auditory perception in diverse ways. However, it is not well understood if and how these diverse effects depend on the source of the expectations. Further, it is unknown whether different sources of bias use the same or different computational and physiological mechanisms. We examined how rule-based and stimulus-based expectations influenced behavior and pupil-linked arousal, a marker of certain forms of expectation-based processing, of human subjects performing an auditory frequency-discrimination task. Rule-based cues consistently biased choices and response times (RTs) toward the more-probable stimulus. In contrast, stimulus-based cues had a complex combination of effects, including choice and RT biases toward and away from the frequency of recently presented stimuli. These different behavioral patterns also had: 1) distinct computational signatures, including different modulations of key components of a novel form of a drift-diffusion decision model and 2) distinct physiological signatures, including substantial bias-dependent modulations of pupil size in response to rule-based but not stimulus-based cues. These results imply that different sources of expectations can modulate auditory processing via distinct mechanisms: one that uses arousal-linked, rule-based information and another that uses arousal-independent, stimulus-based information to bias the speed and accuracy of auditory perceptual decisions.
Author summary: Prior information about upcoming stimuli can bias our perception of those stimuli. Whether different sources of prior information bias perception in similar or distinct ways is not well understood. We compared the influence of two kinds of prior information on tone-frequency discrimination: rule-based cues, in the form of explicit information about the most-likely identity of the upcoming tone; and stimulus-based cues, in the form of sequences of tones presented before the to-be-discriminated tone. Although both types of prior information biased auditory decision-making, they demonstrated distinct behavioral, computational, and physiological signatures. Our results suggest that the brain processes prior information in a form-specific manner rather than utilizing a general-purpose prior. Such form-specific processing has implications for understanding decision biases real-world contexts, in which prior information comes from many different sources and modalities.
Identification of animal behavioral strategies by inverse reinforcement learning
Authors: Shoichiro Yamaguchi, Honda Naoki, Muneki Ikeda, Yuki Tsukada, Shunji Nakano, Ikue Mori, Shin Ishii
Journal: PLOS Computational Biology
Accepted: 2018-04-03T00:00:00Z


Animals are able to reach a desired state in an environment by controlling various behavioral patterns. Identification of the behavioral strategy used for this control is important for understanding animals’ decision-making and is fundamental to dissect information processing done by the nervous system. However, methods for quantifying such behavioral strategies have not been fully established. In this study, we developed an inverse reinforcement-learning (IRL) framework to identify an animal’s behavioral strategy from behavioral time-series data. We applied this framework to C. elegans thermotactic behavior; after cultivation at a constant temperature with or without food, fed worms prefer, while starved worms avoid the cultivation temperature on a thermal gradient. Our IRL approach revealed that the fed worms used both the absolute temperature and its temporal derivative and that their behavior involved two strategies: directed migration (DM) and isothermal migration (IM). With DM, worms efficiently reached specific temperatures, which explains their thermotactic behavior when fed. With IM, worms moved along a constant temperature, which reflects isothermal tracking, well-observed in previous studies. In contrast to fed animals, starved worms escaped the cultivation temperature using only the absolute, but not the temporal derivative of temperature. We also investigated the neural basis underlying these strategies, by applying our method to thermosensory neuron-deficient worms. Thus, our IRL-based approach is useful in identifying animal strategies from behavioral time-series data and could be applied to a wide range of behavioral studies, including decision-making, in other organisms.
Author summary: Understanding animal decision-making has been a fundamental problem in neuroscience and behavioral ecology. Many studies have analyzed the actions representing decision-making in behavioral tasks, in which rewards are artificially designed with specific objectives. However, it is impossible to extend this artificially designed experiment to a natural environment, as in the latter, the rewards for freely-behaving animals cannot be clearly defined. To this end, we sought to reverse the current paradigm so that rewards could be identified from behavioral data. Here, we propose a new reverse-engineering approach (inverse reinforcement learning), which can estimate a behavioral strategy from time-series data of freely-behaving animals. By applying this technique on C. elegans thermotaxis, we successfully identified the respective reward-based behavioral strategy.