PenguinMan/ARXIV huggingface dataset:
Efficient and robust coding in heterogeneous recurrent networks
Authors: Fleur Zeldenrust, Boris Gutkin, Sophie Denéve
Journal: PLOS Computational Biology
Accepted: 2021-04-07T00:00:00Z


Cortical networks show a large heterogeneity of neuronal properties. However, traditional coding models have focused on homogeneous populations of excitatory and inhibitory neurons. Here, we analytically derive a class of recurrent networks of spiking neurons that close to optimally track a continuously varying input online, based on two assumptions: 1) every spike is decoded linearly and 2) the network aims to reduce the mean-squared error between the input and the estimate. From this we derive a class of predictive coding networks, that unifies encoding and decoding and in which we can investigate the difference between homogeneous networks and heterogeneous networks, in which each neurons represents different features and has different spike-generating properties. We find that in this framework, ‘type 1’ and ‘type 2’ neurons arise naturally and networks consisting of a heterogeneous population of different neuron types are both more efficient and more robust against correlated noise. We make two experimental predictions: 1) we predict that integrators show strong correlations with other integrators and resonators are correlated with resonators, whereas the correlations are much weaker between neurons with different coding properties and 2) that ‘type 2’ neurons are more coherent with the overall network activity than ‘type 1’ neurons.
Author summary: Neurons in the brain show a large diversity of properties, yet traditionally neural network models have often used homogeneous populations of neurons. In this study, we investigate the effect of including heterogoenous neural populations on the capacity of networks to represent an input stimulus. We use a predictive coding framework, by deriving a class of recurrent filter networks of spiking neurons that close to optimally track a continuously varying input online. We show that if every neuron represents a different filter, these networks can represent the input stimulus more efficiently than if every neuron represents the same filter.
Brain Modeling ToolKit: An open source software suite for multiscale modeling of brain circuits
Authors: Kael Dai, Sergey L Gratiy, Yazan N Billeh, Richard Xu, Binghuang Cai, Nicholas Cain, Atle E Rimehaug, Alexander J Stasik, Gaute T Einevoll, Stefan Mihalas, Christof Koch, Anton Arkhipov
Journal: PLOS Computational Biology
Accepted: 2020-09-16T00:00:00Z


Experimental studies in neuroscience are producing data at a rapidly increasing rate, providing exciting opportunities and formidable challenges to existing theoretical and modeling approaches. To turn massive datasets into predictive quantitative frameworks, the field needs software solutions for systematic integration of data into realistic, multiscale models. Here we describe the Brain Modeling ToolKit (BMTK), a software suite for building models and performing simulations at multiple levels of resolution, from biophysically detailed multi-compartmental, to point-neuron, to population-statistical approaches. Leveraging the SONATA file format and existing software such as NEURON, NEST, and others, BMTK offers a consistent user experience across multiple levels of resolution. It permits highly sophisticated simulations to be set up with little coding required, thus lowering entry barriers to new users. We illustrate successful applications of BMTK to large-scale simulations of a cortical area. BMTK is an open-source package provided as a resource supporting modeling-based discovery in the community.
Stimulus presentation can enhance spiking irregularity across subcortical and cortical regions
Authors: Saleh Fayaz, Mohammad Amin Fakharian, Ali Ghazizadeh
Journal: PLOS Computational Biology
Accepted: 2022-05-27T00:00:00Z


Stimulus presentation is believed to quench neural response variability as measured by fano-factor (FF). However, the relative contributions of within-trial spike irregularity and trial-to-trial rate variability to FF fluctuations have remained elusive. Here, we introduce a principled approach for accurate estimation of spiking irregularity and rate variability in time for doubly stochastic point processes. Consistent with previous evidence, analysis showed stimulus-induced reduction in rate variability across multiple cortical and subcortical areas. However, unlike what was previously thought, spiking irregularity, was not constant in time but could be enhanced due to factors such as bursting abating the quench in the post-stimulus FF. Simulations confirmed plausibility of a time varying spiking irregularity arising from within and between pool correlations of excitatory and inhibitory neural inputs. By accurate parsing of neural variability, our approach reveals previously unnoticed changes in neural response variability and constrains candidate mechanisms that give rise to observed rate variability and spiking irregularity within brain regions.
Author summary: Mounting evidence suggest neural response variability to be important for understanding and constraining the underlying neural mechanisms in a given brain area. Here, by analyzing responses across multiple brain areas and by using a principled method for parsing variability components into rate variability and spiking irregularity, we show that unlike what was previously thought, event-related quench of variability is not a brain-wide phenomenon and that point process variability and nonrenewal bursting can enhance post-stimulus spiking irregularity across certain cortical and subcortical regions. We propose possible presynaptic mechanisms that may underlie the observed heterogeneities in spiking variability across the brain.
Priority-based transformations of stimulus representation in visual working memory
Authors: Quan Wan, Jorge A Menendez, Bradley R Postle
Journal: PLOS Computational Biology
Accepted: 2022-05-12T00:00:00Z


How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent neural networks (RNNs) with a long short-term memory (LSTM) architecture to perform a 2-back WM task. Visualization of LSTM hidden layer activity using Principal Component Analysis (PCA) confirmed that stimulus representations undergo a representational transformation–consistent with a flip—while transitioning from the functional status of UMI to PMI. Demixed (d)PCA of the same data identified two representational trajectories, one each within a UMI subspace and a PMI subspace, both undergoing a reversal of stimulus coding axes. dPCA of data from an EEG dataset also provided evidence for priority-based transformations of the representational code, albeit with some differences. This type of transformation could allow for retention of unprioritized information in WM while preventing it from interfering with concurrent behavior. The results from this initial exploration suggest that the algorithmic details of how this transformation is carried out by RNNs, versus by the human brain, may differ.
Author summary: How is information held in working memory (WM) but outside the current focus of attention? Motivated by previous neuroimaging studies, we trained recurrent neural networks (RNNs) to perform a 2-back WM task that entails shifts of an item’s priority status. Dimensionality reduction of the resultant activity in the hidden layer of the RNNs allowed us to characterize how a stimulus item’s representation follows a transformational trajectory through high-dimensional representational space as its priority status changes from memory probe to unprioritized to prioritized. This work illustrates the value of artificial neural networks for assessing and refining hypotheses about mechanisms for information processing in the brain.
Applications of EEG indices for the quantification of human cognitive performance: A systematic review and bibliometric analysis
Authors: Lina Elsherif Ismail, Waldemar Karwowski
Journal: PLOS ONE
Accepted: 2020-11-10T00:00:00Z

Background: Neuroergonomics combines neuroscience with ergonomics to study human performance using recorded brain signals. Such neural signatures of performance can be measured using a variety of neuroimaging techniques, including functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), and electroencephalography (EEG). EEG has an excellent temporal resolution, and EEG indices are highly sensitive to human brain activity fluctuations. Objective: The focus of this systematic review was to explore the applications of EEG indices for quantifying human performance in a variety of cognitive tasks at the macro and micro scales. To identify trends and the state of the field, we examined global patterns among selected articles, such as journal contributions, highly cited papers, affiliations, and high-frequency keywords. Moreover, we discussed the most frequently used EEG indices and synthesized current knowledge regarding the EEG signatures of associated human performance measurements. Methods: In this systematic review, we analyzed articles published in English (from peer-reviewed journals, proceedings, and conference papers), Ph.D. dissertations, textbooks, and reference books. All articles reviewed herein included exclusively EEG-based experimental studies in healthy participants. We searched Web-of-Science and Scopus databases using specific sets of keywords. Results: Out of 143 papers, a considerable number of cognitive studies focused on quantifying human performance with respect to mental fatigue, mental workload, mental effort, visual fatigue, emotion, and stress. An increasing trend for publication in this area was observed, with the highest number of publications in 2017. Most studies applied linear methods (e.g., EEG power spectral density and the amplitude of event-related potentials) to evaluate human cognitive performance. A few papers utilized nonlinear methods, such as fractal dimension, largest Lyapunov exponent, and signal entropy. More than 50% of the studies focused on evaluating an individual’s mental states while operating a vehicle. Several different methods of artifact removal have also been noted. Based on the reviewed articles, research gaps, trends, and potential directions for future research were explored. Conclusion: This systematic review synthesized current knowledge regarding the application of EEG indices for quantifying human performance in a wide variety of cognitive tasks. This knowledge is useful for understanding the global patterns of applications of EEG indices for the analysis and design of cognitive tasks.
Stability of working memory in continuous attractor networks under the control of short-term plasticity
Authors: Alexander Seeholzer, Moritz Deger, Wulfram Gerstner
Journal: PLOS Computational Biology
Accepted: 2019-03-04T00:00:00Z


Continuous attractor models of working-memory store continuous-valued information in continuous state-spaces, but are sensitive to noise processes that degrade memory retention. Short-term synaptic plasticity of recurrent synapses has previously been shown to affect continuous attractor systems: short-term facilitation can stabilize memory retention, while short-term depression possibly increases continuous attractor volatility. Here, we present a comprehensive description of the combined effect of both short-term facilitation and depression on noise-induced memory degradation in one-dimensional continuous attractor models. Our theoretical description, applicable to rate models as well as spiking networks close to a stationary state, accurately describes the slow dynamics of stored memory positions as a combination of two processes: (i) diffusion due to variability caused by spikes; and (ii) drift due to random connectivity and neuronal heterogeneity. We find that facilitation decreases both diffusion and directed drifts, while short-term depression tends to increase both. Using mutual information, we evaluate the combined impact of short-term facilitation and depression on the ability of networks to retain stable working memory. Finally, our theory predicts the sensitivity of continuous working memory to distractor inputs and provides conditions for stability of memory.
Author summary: The ability to transiently memorize positions in the visual field is crucial for behavior. Models and experiments have shown that such memories can be maintained in networks of cortical neurons with a continuum of possible activity states, that reflects the continuum of positions in the environment. However, the accuracy of positions stored in such networks will degrade over time due to the noisiness of neuronal signaling and imperfections of the biological substrate. Previous work in simplified models has shown that synaptic short-term plasticity could stabilize this degradation by dynamically up- or down-regulating the strength of synaptic connections, thereby “pinning down” memorized positions. Here, we present a general theory that accurately predicts the extent of this “pinning down” by short-term plasticity in a broad class of biologically plausible network models, thereby untangling the interplay of varying biological sources of noise with short-term plasticity. Importantly, our work provides a novel theoretical link from the microscopic substrate of working memory—neurons and synaptic connections—to observable behavioral correlates, for example the susceptibility to distracting stimuli.
Isolation, cryo-laser scanning confocal microscope imaging and cryo-FIB milling of mouse glutamatergic synaptosomes
Authors: Prerana Gogoi, Momoko Shiozaki, Eric Gouaux
Journal: PLOS ONE
Accepted: 2022-07-07T00:00:00Z


Ionotropic glutamate receptors (iGluRs) at postsynaptic terminals mediate the majority of fast excitatory neurotransmission in response to release of glutamate from the presynaptic terminal. Obtaining structural information on the molecular organization of iGluRs in their native environment, along with other signaling and scaffolding proteins in the postsynaptic density (PSD), and associated proteins on the presynaptic terminal, would enhance understanding of the molecular basis for excitatory synaptic transmission in normal and in disease states. Cryo-electron tomography (ET) studies of synaptosomes is one attractive vehicle by which to study iGluR-containing excitatory synapses. Here we describe a workflow for the preparation of glutamatergic synaptosomes for cryo-ET studies. We describe the utilization of fluorescent markers for the facile detection of the pre and postsynaptic terminals of glutamatergic synaptosomes using cryo-laser scanning confocal microscope (cryo-LSM). We further provide the details for preparation of lamellae, between ~100 to 200 nm thick, of glutamatergic synaptosomes using cryo-focused ion-beam (FIB) milling. We monitor the lamella preparation using a scanning electron microscope (SEM) and following lamella production, we identify regions for subsequent cryo-ET studies by confocal fluorescent imaging, exploiting the pre and postsynaptic fluorophores.
Differential changes to D1 and D2 medium spiny neurons in the 12-month-old Q175+/- mouse model of Huntington’s Disease
Authors: Joseph W Goodliffe, Hanbing Song, Anastasia Rubakovic, Wayne Chang, Maria Medalla, Christina M Weaver, Jennifer I Luebke
Journal: PLOS ONE
Accepted: 2018-06-29T00:00:00Z


Huntington’s Disease (HD) is an autosomal dominant, progressive neurodegenerative disorder caused by deleterious expansion of CAG repeats in the Huntingtin gene and production of neurotoxic mutant Huntingtin protein (mHTT). The key pathological feature of HD is a profound degeneration of the striatum and a loss of cortical volume. The initial loss of indirect pathway (D2) medium spiny neuron (MSN) projections in early stages of HD, followed by a loss of direct pathway (D1) projections in advanced stages has important implications for the trajectory of motor and cognitive dysfunction in HD, but is not yet understood. Mouse models of HD have yielded important information on the effects and mechanisms of mHTT toxicity; however, whether these models recapitulate differential vulnerability of D1 vs. D2 MSNs is unknown. Here, we employed 12-month-old Q175+/- x D2-eGFP mice to examine the detailed structural and functional properties of D1 vs. D2 MSNs. While both D1 and D2 MSNs exhibited increased input resistance, depolarized resting membrane potentials and action potential threshold, only D1 MSNs showed reduced rheobase, action potential amplitude and frequency of spontaneous excitatory postsynaptic currents. Furthermore, D1 but not D2 MSNs showed marked proliferative changes to their dendritic arbors and reductions in spine density. Immunohistochemical assessment showed no loss of glutamatergic afferent inputs from cortical and subcortical sources onto identified D1 and D2 MSNs. Computational models constrained by empirical data predict that the increased dendritic complexity in Q175+/- D1 MSNs likely leads to greater dendritic filtering and attenuation of signals propagating to the soma from the dendrites. Together these findings reveal that, by twelve months, D1 and D2 MSNs exhibit distinctive responses to the presence of mHTT in this important mouse model of HD. This further highlights the need to incorporate findings from D1 and D2 MSNs independently in the context of HD models.
Organization of primate amygdalar–thalamic pathways for emotions
Authors: Clare Timbie, Miguel Á García-Cabezas, Basilis Zikopoulos, Helen Barbas
Journal: PLOS Biology
Accepted: 2020-02-11T00:00:00Z


Studies on the thalamus have mostly focused on sensory relay nuclei, but the organization of pathways associated with emotions is not well understood. We addressed this issue by testing the hypothesis that the primate amygdala acts, in part, like a sensory structure for the affective import of stimuli and conveys this information to the mediodorsal thalamic nucleus, magnocellular part (MDmc). We found that primate sensory cortices innervate amygdalar sites that project to the MDmc, which projects to the orbitofrontal cortex. As in sensory thalamic systems, large amygdalar terminals innervated excitatory relay and inhibitory neurons in the MDmc that facilitate faithful transmission to the cortex. The amygdala, however, uniquely innervated a few MDmc neurons by surrounding and isolating large segments of their proximal dendrites, as revealed by three-dimensional high-resolution reconstruction. Physiologic studies have shown that large axon terminals are found in pathways issued from motor systems that innervate other brain centers to help distinguish self-initiated from other movements. By analogy, the amygdalar pathway to the MDmc may convey signals forwarded to the orbitofrontal cortex to monitor and update the status of the environment in processes deranged in schizophrenia, resulting in attribution of thoughts and actions to external sources.

Pathways from the amygdala target specific neurons in the thalamic magnocellular mediodorsal nucleus to enable speedy and faithful transmission of emotional information to prefrontal cortex.
Constrained inference in sparse coding reproduces contextual effects and predicts laminar neural dynamics
Authors: Federica Capparelli, Klaus Pawelzik, Udo Ernst
Journal: PLOS Computational Biology
Accepted: 2019-09-02T00:00:00Z


When probed with complex stimuli that extend beyond their classical receptive field, neurons in primary visual cortex display complex and non-linear response characteristics. Sparse coding models reproduce some of the observed contextual effects, but still fail to provide a satisfactory explanation in terms of realistic neural structures and cortical mechanisms, since the connection scheme they propose consists only of interactions among neurons with overlapping input fields. Here we propose an extended generative model for visual scenes that includes spatial dependencies among different features. We derive a neurophysiologically realistic inference scheme under the constraint that neurons have direct access only to local image information. The scheme can be interpreted as a network in primary visual cortex where two neural populations are organized in different layers within orientation hypercolumns that are connected by local, short-range and long-range recurrent interactions. When trained with natural images, the model predicts a connectivity structure linking neurons with similar orientation preferences matching the typical patterns found for long-ranging horizontal axons and feedback projections in visual cortex. Subjected to contextual stimuli typically used in empirical studies, our model replicates several hallmark effects of contextual processing and predicts characteristic differences for surround modulation between the two model populations. In summary, our model provides a novel framework for contextual processing in the visual system proposing a well-defined functional role for horizontal axons and feedback projections.
Author summary: An influential hypothesis about how the brain processes visual information posits that each given stimulus should be efficiently encoded using only a small number of cells. This idea led to the development of a class of models that provided a functional explanation for various response properties of visual neurons, including the non-linear modulations observed when localized stimuli are placed in a broader spatial context. However, it remains to be clarified through which anatomical structures and neural connectivities a network in the cortex could perform the computations that these models require. In this paper we propose a model for encoding spatially extended visual scenes. Imposing the constraint that neurons in visual cortex have direct access only to small portions of the visual field we derive a simple yet realistic neural population dynamics. Connectivities optimized for natural scenes conform with anatomical findings and the resulting model reproduces a broad set of physiological observations, while exposing the neural mechanisms relevant for spatio-temporal information integration.
Neuronal mechanisms for sequential activation of memory items: Dynamics and reliability
Authors: Elif Köksal Ersöz, Carlos Aguilar, Pascal Chossat, Martin Krupa, Frédéric Lavigne
Journal: PLOS ONE
Accepted: 2020-03-17T00:00:00Z


In this article we present a biologically inspired model of activation of memory items in a sequence. Our model produces two types of sequences, corresponding to two different types of cerebral functions: activation of regular or irregular sequences. The switch between the two types of activation occurs through the modulation of biological parameters, without altering the connectivity matrix. Some of the parameters included in our model are neuronal gain, strength of inhibition, synaptic depression and noise. We investigate how these parameters enable the existence of sequences and influence the type of sequences observed. In particular we show that synaptic depression and noise drive the transitions from one memory item to the next and neuronal gain controls the switching between regular and irregular (random) activation.