PenguinMan/ARXIV huggingface dataset:
Sleep prevents catastrophic forgetting in spiking neural networks by forming a joint synaptic weight representation
Authors: Ryan Golden, Jean Erik Delanois, Pavel Sanda, Maxim Bazhenov
Journal: PLOS Computational Biology
Accepted: 2022-10-03T00:00:00Z


Artificial neural networks overwrite previously learned tasks when trained sequentially, a phenomenon known as catastrophic forgetting. In contrast, the brain learns continuously, and typically learns best when new training is interleaved with periods of sleep for memory consolidation. Here we used spiking network to study mechanisms behind catastrophic forgetting and the role of sleep in preventing it. The network could be trained to learn a complex foraging task but exhibited catastrophic forgetting when trained sequentially on different tasks. In synaptic weight space, new task training moved the synaptic weight configuration away from the manifold representing old task leading to forgetting. Interleaving new task training with periods of off-line reactivation, mimicking biological sleep, mitigated catastrophic forgetting by constraining the network synaptic weight state to the  previously learned manifold, while allowing the weight configuration to converge towards the intersection of the manifolds representing old and new tasks. The study reveals a possible strategy of synaptic weights dynamics the brain applies during sleep to prevent forgetting and optimize learning.
Author summary: Artificial neural networks can achieve superhuman performance in many domains. Despite these advances, these networks fail in sequential learning; they achieve optimal performance on newer tasks at the expense of performance on previously learned tasks. Humans and animals on the other hand have a remarkable ability to learn continuously and incorporate new data into their corpus of existing knowledge. Sleep has been hypothesized to play an important role in memory and learning by enabling spontaneous reactivation of previously learned memory patterns. Here we use a spiking neural network model, simulating sensory processing and reinforcement learning in animal brain, to demonstrate that interleaving new task training with sleep-like activity optimizes the network’s memory representation in synaptic weight space to prevent forgetting old memories. Sleep makes this possible by replaying old memory traces without the explicit usage of the old task data.
Hasty sensorimotor decisions rely on an overlap of broad and selective changes in motor activity
Authors: Gerard Derosiere, David Thura, Paul Cisek, Julie Duque
Journal: PLOS Biology
Accepted: 2022-03-10T00:00:00Z


Humans and other animals are able to adjust their speed–accuracy trade-off (SAT) at will depending on the urge to act, favoring either cautious or hasty decision policies in different contexts. An emerging view is that SAT regulation relies on influences exerting broad changes on the motor system, tuning its activity up globally when hastiness is at premium. The present study aimed to test this hypothesis. A total of 50 participants performed a task involving choices between left and right index fingers, in which incorrect choices led either to a high or to a low penalty in 2 contexts, inciting them to emphasize either cautious or hasty policies. We applied transcranial magnetic stimulation (TMS) on multiple motor representations, eliciting motor-evoked potentials (MEPs) in 9 finger and leg muscles. MEP amplitudes allowed us to probe activity changes in the corresponding finger and leg representations, while participants were deliberating about which index to choose. Our data indicate that hastiness entails a broad amplification of motor activity, although this amplification was limited to the chosen side. On top of this effect, we identified a local suppression of motor activity, surrounding the chosen index representation. Hence, a decision policy favoring speed over accuracy appears to rely on overlapping processes producing a broad (but not global) amplification and a surround suppression of motor activity. The latter effect may help to increase the signal-to-noise ratio of the chosen representation, as supported by single-trial correlation analyses indicating a stronger differentiation of activity changes in finger representations in the hasty context.

Many have argued that the regulation of the speed-accuracy tradeoff relies on an urgency signal, which implements "collapsing decision thresholds" by tuning neural activity in a global manner in decision-related structures. This study indicates that the reality is more subtle, with several aspects of "urgency" being specifically targeted to particular corticospinal populations within the motor system.
Refractory density model of cortical direction selectivity: Lagged-nonlagged, transient-sustained, and On-Off thalamic neuron-based mechanisms and intracortical amplification
Authors: Anton Chizhov, Natalia Merkulyeva
Journal: PLOS Computational Biology
Accepted: 2020-09-12T00:00:00Z


A biophysically detailed description of the mechanisms of the primary vision is still being developed. We have incorporated a simplified, filter-based description of retino-thalamic visual signal processing into the detailed, conductance-based refractory density description of the neuronal population activity of the primary visual cortex. We compared four mechanisms of the direction selectivity (DS), three of them being based on asymmetrical projections of different types of thalamic neurons to the cortex, distinguishing between (i) lagged and nonlagged, (ii) transient and sustained, and (iii) On and Off neurons. The fourth mechanism implies a lack of subcortical bias and is an epiphenomenon of intracortical interactions between orientation columns. The simulations of the cortical response to moving gratings have verified that first three mechanisms provide DS to an extent compared with experimental data and that the biophysical model realistically reproduces characteristics of the visual cortex activity, such as membrane potential, firing rate, and synaptic conductances. The proposed model reveals the difference between the mechanisms of both the intact and the silenced cortex, favoring the second mechanism. In the fourth case, DS is weaker but significant; it completely vanishes in the silenced cortex.DS in the On-Off mechanism derives from the nonlinear interactions within the orientation map. Results of simulations can help to identify a prevailing mechanism of DS in V1. This is a step towards a comprehensive biophysical modeling of the primary visual system in the frameworks of the population rate coding concept.
Author summary: A major mechanism that underlies tuning of cortical neurons to the direction of a moving stimulus is still debated. Considering the visual cortex structured with orientation-selective columns, we have realized and compared in our biophysically detailed mathematical model four hypothetical mechanisms of the direction selectivity (DS) known from experiments. The present model accomplishes our previous model that was tuned to experimental data on excitability in slices and reproduces orientation tuning effects in vivo. In simulations, we have found that the convergence of inputs from so-called transient and sustained (or lagged and nonlagged) thalamic neurons in the cortex provides an initial bias for DS, whereas cortical interactions amplify the tuning. In the absence of any bias, DS emerges as an epiphenomenon of the orientation map. In the case of a biased convergence of On- and Off- thalamic inputs, DS emerges with the help of the intracortical interactions on the orientation map, also. Thus, we have proposed a comprehensive description of the primary vision and revealed characteristic features of different mechanisms of DS in the visual cortex with columnar structure.
Alpha 7 nicotinic receptors attenuate neurite development through calcium activation of calpain at the growth cone
Authors: Justin R King, Nadine Kabbani
Journal: PLOS ONE
Accepted: 2018-04-30T00:00:00Z


The α7 nicotinic acetylcholine receptor (nAChR) is a ligand-gated ion channel that plays an important role in cellular calcium signaling contributing to synaptic development and plasticity, and is a key drug target for the treatment of neurodegenerative conditions such as Alzheimer’s disease. Here we show that α7 nAChR mediated calcium signals in differentiating PC12 cells activate the proteolytic enzyme calpain leading to spectrin breakdown, microtubule retraction, and attenuation in neurite growth. Imaging in growth cones confirms that α7 activation decreases EB3 comet motility in a calcium dependent manner as demonstrated by the ability of α7 nAChR, ryanodine, or IP3 receptor antagonists to block the effect of α7 nAChR on growth. α7 nAChR mediated EB3 comet motility, spectrin breakdown, and neurite growth was also inhibited by the addition of the selective calpain blocker calpeptin and attenuated by the expression of an α7 subunit unable to bind Gαq and activate calcium store release. The findings indicate that α7 nAChRs regulate cytoskeletal dynamics through local calcium signals for calpain protease activity.
Large-scale functional networks connect differently for processing words and symbol strings
Authors: Mia Liljeström, Johanna Vartiainen, Jan Kujala, Riitta Salmelin
Journal: PLOS ONE
Accepted: 2018-04-19T00:00:00Z


Reconfigurations of synchronized large-scale networks are thought to be central neural mechanisms that support cognition and behavior in the human brain. Magnetoencephalography (MEG) recordings together with recent advances in network analysis now allow for sub-second snapshots of such networks. In the present study, we compared frequency-resolved functional connectivity patterns underlying reading of single words and visual recognition of symbol strings. Word reading emphasized coherence in a left-lateralized network with nodes in classical perisylvian language regions, whereas symbol processing recruited a bilateral network, including connections between frontal and parietal regions previously associated with spatial attention and visual working memory. Our results illustrate the flexible nature of functional networks, whereby processing of different form categories, written words vs. symbol strings, leads to the formation of large-scale functional networks that operate at distinct oscillatory frequencies and incorporate task-relevant regions. These results suggest that category-specific processing should be viewed not so much as a local process but as a distributed neural process implemented in signature networks. For words, increased coherence was detected particularly in the alpha (8–13 Hz) and high gamma (60–90 Hz) frequency bands, whereas increased coherence for symbol strings was observed in the high beta (21–29 Hz) and low gamma (30–45 Hz) frequency range. These findings attest to the role of coherence in specific frequency bands as a general mechanism for integrating stimulus-dependent information across brain regions.
Working memory, age and education: A lifespan fMRI study
Authors: Jo A Archer, Annie Lee, Anqi Qiu, S-H Annabel Chen
Journal: PLOS ONE
Accepted: 2018-03-12T00:00:00Z


Ageing is associated with grey matter atrophy and changes in task-related neural activations. This study investigated the effects of age and education on neural activation during a spatial working memory task in 189 participants aged between 20–80 years old, whilst controlling for grey matter density. Age was related to linear decreases in neural activation in task activated areas, and this effect was no longer significant when adjusting for education or accuracy. Age was also related to cubic increases in neural activation in non-task related areas, such as the temporal gyrus, cuneus and cerebellum when adjusting for accuracy and education. These findings support previous lifespan datasets indicating linear age-related decreases in task activation, but non-linear increases in non-task related areas during episodic memory tasks. The findings also support past studies indicating education offers a form of cognitive reserve through providing a form of neural compensation and highlights the need to consider education in ageing studies.
fMRI repetition suppression reveals no sensitivity to trait judgments from faces in face perception or theory-of-mind networks
Authors: Emily E Butler, Rob Ward, Paul E Downing, Richard Ramsey
Journal: PLOS ONE
Accepted: 2018-07-11T00:00:00Z


The human face cues a wealth of social information, but the neural mechanisms that underpin social attributions from faces are not well known. In the current fMRI experiment, we used repetition suppression to test the hypothesis that populations of neurons in face perception and theory-of-mind neural networks would show sensitivity to faces that cue distinct trait judgments. Although faces were accurately discriminated based on associated traits, our results showed no evidence that face or theory-of-mind networks showed repetition suppression for face traits. Thus, we do not provide evidence for population coding models of face perception that include sensitivity to high and low trait features. Due to aspects of the experimental design, which bolstered statistical power and sensitivity, we have reasonable confidence that we could detect effects of a moderate size, should they exist. The null findings reported here, therefore, add value to models of neural organisation in social perception by showing instances where effects are absent or small. To test the generalisability of our findings, future work should test different types of trait judgment and different types of facial stimuli, in order to further probe the neurobiological bases of impression formation based on facial appearance.
Analyses with double knockouts of the Bmpr1a and Bmpr1b genes demonstrate that BMP signaling is involved in the formation of precerebellar mossy fiber nuclei derived from the rhombic lip
Authors: Lihua Qin, Kyung J Ahn, Lara Wine Lee, Charles de Charleroy Jr, E Bryan Crenshaw III
Journal: PLOS ONE
Accepted: 2019-12-01T00:00:00Z


Bone morphogenetic proteins (BMPs) have been hypothesized to specify distinct dorsal neural fates. During neural development, BMPs are expressed in the roof plate and adjacent neuroepithelium. Because several hindbrain nuclei that form the proprioceptive/vestibular/auditory sensory network originate from the rhombic lip, near the roof plate, BMP signaling may regulate the development of these nuclei. To test this hypothesis genetically, we have examined the development of the hindbrain in BMP type I receptor knockout mice. Our results demonstrate that BMP signaling is involved in the formation of precerebellar mossy fiber nuclei, which give rise to cerebellar mossy fibers, but is not required for the development of the inferior olivary nucleus, which gives rise to cerebellar climbing fibers.
Orientation processing by synaptic integration across first-order tactile neurons
Authors: Etay Hay, J Andrew Pruszynski
Journal: PLOS Computational Biology
Accepted: 2020-09-03T00:00:00Z


Our ability to manipulate objects relies on tactile inputs from first-order tactile neurons that innervate the glabrous skin of the hand. The distal axon of these neurons branches in the skin and innervates many mechanoreceptors, yielding spatially-complex receptive fields. Here we show that synaptic integration across the complex signals from the first-order neuronal population could underlie human ability to accurately (< 3°) and rapidly process the orientation of edges moving across the fingertip. We first derive spiking models of human first-order tactile neurons that fit and predict responses to moving edges with high accuracy. We then use the model neurons in simulating the peripheral neuronal population that innervates a fingertip. We train classifiers performing synaptic integration across the neuronal population activity, and show that synaptic integration across first-order neurons can process edge orientations with high acuity and speed. In particular, our models suggest that integration of fast-decaying (AMPA-like) synaptic inputs within short timescales is critical for discriminating fine orientations, whereas integration of slow-decaying (NMDA-like) synaptic inputs supports discrimination of coarser orientations and maintains robustness over longer timescales. Taken together, our results provide new insight into the computations occurring in the earliest stages of the human tactile processing pathway and how they may be critical for supporting hand function.
Author summary: Our ability to manipulate objects relies on tactile inputs signaled by first-order neurons that innervate mechanoreceptors in the skin of the hand and have spatially-complex receptive fields. Here we simulated populations of model human first-order neurons to show how synaptic integration across the rich inputs they provide can rapidly and accurately process the orientation of edges moving across the fingertip. We examined different types of synaptic integration to provide mechanistic insight into how higher-order neurons extract meaningful tactile information from the complex responses of the peripheral neuronal population. We thus show that synaptic integration across first-order neurons could underlie human ability to process edge orientations with high acuity and speed.
Scalable and accurate method for neuronal ensemble detection in spiking neural networks
Authors: Rubén Herzog, Arturo Morales, Soraya Mora, Joaquín Araya, María-José Escobar, Adrian G Palacios, Rodrigo Cofré
Journal: PLOS ONE
Accepted: 2021-04-29T00:00:00Z


We propose a novel, scalable, and accurate method for detecting neuronal ensembles from a population of spiking neurons. Our approach offers a simple yet powerful tool to study ensemble activity. It relies on clustering synchronous population activity (population vectors), allows the participation of neurons in different ensembles, has few parameters to tune and is computationally efficient. To validate the performance and generality of our method, we generated synthetic data, where we found that our method accurately detects neuronal ensembles for a wide range of simulation parameters. We found that our method outperforms current alternative methodologies. We used spike trains of retinal ganglion cells obtained from multi-electrode array recordings under a simple ON-OFF light stimulus to test our method. We found a consistent stimuli-evoked ensemble activity intermingled with spontaneously active ensembles and irregular activity. Our results suggest that the early visual system activity could be organized in distinguishable functional ensembles. We provide a Graphic User Interface, which facilitates the use of our method by the scientific community.
Acute effects of a single dose of 2 mA of anodal transcranial direct current stimulation over the left dorsolateral prefrontal cortex on executive functions in patients with schizophrenia—A randomized controlled trial
Authors: Thomas M Schilling, Magdalena Bossert, Miriam König, Gustav Wirtz, Matthias Weisbrod, Steffen Aschenbrenner
Journal: PLOS ONE
Accepted: 2021-06-27T00:00:00Z

Objective: Cognitive impairments are a frequent and difficult to treat symptom in patients with schizophrenia and the strongest predictor for a successful reintegration in occupational and everyday life. Recent research suggests transcranial direct current stimulation (tDCS) to enhance cognition in this patient group. However, the question regarding its acute effectiveness on executive functions remains largely unanswered. Here, we examined in a randomized, double blind, sham-controlled repeated-measures design the impact of tDCS on performance in several executive functions in patients with schizophrenia, schizoaffective disorder or acute transient psychotic disorder. Methods: Patients (N = 48) were tested twice using standardized, well-constructed and clinically validated neuropsychological tests assessing verbal working memory, response inhibition, mental flexibility and problem solving. In session 1 they solely underwent the neuropsychological assessment, whereas in session 2 they additionally received 2 mA of anodal tDCS stimulation over the left dorsolateral prefrontal cortex (DLPFC), cathode right supraorbital ridge, or sham stimulation for 20 minutes. Results: Patients of both groups were not able to correctly discriminate the type of stimulation received confirming the success of the blinding procedure. However, analyzing the whole sample the change in performance from session 1 to session 2 was the same in the verum as in the sham condition (all p >.5). Moreover, a subsequent exploratory analysis showed that performance in the response inhibition task was worse for patients that engaged in the task within 20 minutes after the end of the verum stimulation. Conclusion: Hence, 2 mA of anodal tDCS applied over the left DLPFC did not acutely enhance executive functions in patients with schizophrenia or related disorders but impaired performance in the response inhibition task shortly after. Future studies should continue to seek for effective stimulation configurations for this patient group. Clinical trial registration: The study is registered in the “Deutsches Register Klinischer Studien DRKS”, German Clinical Trial Register and has been allocated the following number: DRKS00022126.
Biological data questions the support of the self inhibition required for pattern generation in the half center model
Authors: Matthias Kohler, Philipp Stratmann, Florian Röhrbein, Alois Knoll, Alin Albu-Schäffer, Henrik Jörntell
Journal: PLOS ONE
Accepted: 2020-08-19T00:00:00Z


Locomotion control in mammals has been hypothesized to be governed by a central pattern generator (CPG) located in the circuitry of the spinal cord. The most common model of the CPG is the half center model, where two pools of neurons generate alternating, oscillatory activity. In this model, the pools reciprocally inhibit each other ensuring alternating activity. There is experimental support for reciprocal inhibition. However another crucial part of the half center model is a self inhibitory mechanism which prevents the neurons of each individual pool from infinite firing. Self-inhibition is hence necessary to obtain alternating activity. But critical parts of the experimental bases for the proposed mechanisms for self-inhibition were obtained in vitro, in preparations of juvenile animals. The commonly used adaptation of spike firing does not appear to be present in adult animals in vivo. We therefore modeled several possible self inhibitory mechanisms for locomotor control. Based on currently published data, previously proposed hypotheses of the self inhibitory mechanism, necessary to support the CPG hypothesis, seems to be put into question by functional evaluation tests or by in vivo data. This opens for alternative explanations of how locomotion activity patterns in the adult mammal could be generated.