PenguinMan/ARXIV huggingface dataset:
Dopamine release, diffusion and uptake: A computational model for synaptic and volume transmission
Authors: Kathleen Wiencke, Annette Horstmann, David Mathar, Arno Villringer, Jane Neumann
Journal: PLOS Computational Biology
Accepted: 2020-09-30T00:00:00Z


Computational modeling of dopamine transmission is challenged by complex underlying mechanisms. Here we present a new computational model that (I) simultaneously regards release, diffusion and uptake of dopamine, (II) considers multiple terminal release events and (III) comprises both synaptic and volume transmission by incorporating the geometry of the synaptic cleft. We were able to validate our model in that it simulates concentration values comparable to physiological values observed in empirical studies. Further, although synaptic dopamine diffuses into extra-synaptic space, our model reflects a very localized signal occurring on the synaptic level, i.e. synaptic dopamine release is negligibly recognized by neighboring synapses. Moreover, increasing evidence suggests that cognitive performance can be predicted by signal variability of neuroimaging data (e.g. BOLD). Signal variability in target areas of dopaminergic neurons (striatum, cortex) may arise from dopamine concentration variability. On that account we compared spatio-temporal variability in a simulation mimicking normal dopamine transmission in striatum to scenarios of enhanced dopamine release and dopamine uptake inhibition. We found different variability characteristics between the three settings, which may in part account for differences in empirical observations. From a clinical perspective, differences in striatal dopaminergic signaling contribute to differential learning and reward processing, with relevant implications for addictive- and compulsive-like behavior. Specifically, dopaminergic tone is assumed to impact on phasic dopamine and hence on the integration of reward-related signals. However, in humans DA tone is classically assessed using PET, which is an indirect measure of endogenous DA availability and suffers from temporal and spatial resolution issues. We discuss how this can lead to discrepancies with observations from other methods such as microdialysis and show how computational modeling can help to refine our understanding of DA transmission.
Author summary: The dopaminergic system of the brain is very complex and affects various cognitive domains like memory, learning and motor control. Alterations have been observed e.g. in Parkinson’s or Huntington’s Disease, ADHD, addiction and compulsive disorders, such as pathological gambling and also in obesity. We present a new computational model that allows to simulate the process of dopamine transmission from dopaminergic neurons originated in source brain regions like the VTA to target areas such as the striatum on a synaptic and on a larger, volume-spanning level. The model can further be used for simulations of dopamine related diseases or pharmacological interventions. In general, computational modeling helps to extend our understanding, gained from empirical research, to situations where in vivo measurements are not feasible.
Revisiting the importance of model fitting for model-based fMRI: It does matter in computational psychiatry
Authors: Kentaro Katahira, Asako Toyama
Journal: PLOS Computational Biology
Accepted: 2021-01-25T00:00:00Z


Computational modeling has been applied for data analysis in psychology, neuroscience, and psychiatry. One of its important uses is to infer the latent variables underlying behavior by which researchers can evaluate corresponding neural, physiological, or behavioral measures. This feature is especially crucial for computational psychiatry, in which altered computational processes underlying mental disorders are of interest. For instance, several studies employing model-based fMRI—a method for identifying brain regions correlated with latent variables—have shown that patients with mental disorders (e.g., depression) exhibit diminished neural responses to reward prediction errors (RPEs), which are the differences between experienced and predicted rewards. Such model-based analysis has the drawback that the parameter estimates and inference of latent variables are not necessarily correct—rather, they usually contain some errors. A previous study theoretically and empirically showed that the error in model-fitting does not necessarily cause a serious error in model-based fMRI. However, the study did not deal with certain situations relevant to psychiatry, such as group comparisons between patients and healthy controls. We developed a theoretical framework to explore such situations. We demonstrate that the parameter-misspecification can critically affect the results of group comparison. We demonstrate that even if the RPE response in patients is completely intact, a spurious difference to healthy controls is observable. Such a situation occurs when the ground-truth learning rate differs between groups but a common learning rate is used, as per previous studies. Furthermore, even if the parameters are appropriately fitted to individual participants, spurious group differences in RPE responses are observable when the model lacks a component that differs between groups. These results highlight the importance of appropriate model-fitting and the need for caution when interpreting the results of model-based fMRI.
Author summary: Computational modeling has been utilized to infer the latent variables reflecting computational processes underlying behavior. This approach provides a predictor of neural activity by which one can test the physiological or neural measures that reflect computational processes. In this way, individual differences in physiological signals corresponding to latent variables (e.g., reward prediction error) and deficits related to mental disorders have been clarified. However, if the model contains a systematic error, the results may be erroneous. In this study, we suggest that spurious between-group (individual) differences are observable if a model parameter (e.g., learning rate) is misspecified. This bias may account for the inconsistencies in a series of studies that have addressed aberrant brain activity underpinning reward prediction error in patients with psychiatric disorders.
Models of heterogeneous dopamine signaling in an insect learning and memory center
Authors: Linnie Jiang, Ashok Litwin-Kumar
Journal: PLOS Computational Biology
Accepted: 2021-06-22T00:00:00Z


The Drosophila mushroom body exhibits dopamine dependent synaptic plasticity that underlies the acquisition of associative memories. Recordings of dopamine neurons in this system have identified signals related to external reinforcement such as reward and punishment. However, other factors including locomotion, novelty, reward expectation, and internal state have also recently been shown to modulate dopamine neurons. This heterogeneity is at odds with typical modeling approaches in which these neurons are assumed to encode a global, scalar error signal. How is dopamine dependent plasticity coordinated in the presence of such heterogeneity? We develop a modeling approach that infers a pattern of dopamine activity sufficient to solve defined behavioral tasks, given architectural constraints informed by knowledge of mushroom body circuitry. Model dopamine neurons exhibit diverse tuning to task parameters while nonetheless producing coherent learned behaviors. Notably, reward prediction error emerges as a mode of population activity distributed across these neurons. Our results provide a mechanistic framework that accounts for the heterogeneity of dopamine activity during learning and behavior.
Author summary: Dopamine neurons across the animal kingdom are involved in the formation of associative memories. While numerous studies have recorded activity in these neurons related to external and predicted rewards, the diversity of these neurons’ activity and their tuning to non-reward-related quantities such as novelty, movement, and internal state have proved challenging to account for in traditional modeling approaches. Using a well-characterized model system for learning and memory, the mushroom body of Drosophila fruit flies, Jiang and Litwin-Kumar provide an account of the diversity of signals across dopamine neurons. They show that models optimized to solve tasks like those encountered by flies exhibit heterogeneous activity across dopamine neurons, but nonetheless this activity is sufficient for the system to solve the tasks. The models will be useful to generate testable hypotheses about dopamine neuron activity across different experimental conditions.
The human insula processes both modality-independent and pain-selective learning signals
Authors: Björn Horing, Christian Büchel
Journal: PLOS Biology
Accepted: 2022-04-15T00:00:00Z


Prediction errors (PEs) are generated when there are differences between an expected and an actual event or sensory input. The insula is a key brain region involved in pain processing, and studies have shown that the insula encodes the magnitude of an unexpected outcome (unsigned PEs). In addition to signaling this general magnitude information, PEs can give specific information on the direction of this deviation—i.e., whether an event is better or worse than expected. It is unclear whether the unsigned PE responses in the insula are selective for pain or reflective of a more general processing of aversive events irrespective of modality. It is also unknown whether the insula can process signed PEs at all. Understanding these specific mechanisms has implications for understanding how pain is processed in the brain in both health and in chronic pain conditions. In this study, 47 participants learned associations between 2 conditioned stimuli (CS) with 4 unconditioned stimuli (US; painful heat or loud sound, of one low and one high intensity each) while undergoing functional magnetic resonance imaging (fMRI) and skin conductance response (SCR) measurements. We demonstrate that activation in the anterior insula correlated with unsigned intensity PEs, irrespective of modality, indicating an unspecific aversive surprise signal. Conversely, signed intensity PE signals were modality specific, with signed PEs following pain but not sound located in the dorsal posterior insula, an area implicated in pain intensity processing. Previous studies have identified abnormal insula function and abnormal learning as potential causes of pain chronification. Our findings link these results and suggest that a misrepresentation of learning relevant PEs in the insular cortex may serve as an underlying factor in chronic pain.

This study uses a learning paradigm including pain and sound stimuli to show that the human posterior insula encodes signed intensity prediction errors for pain but not sound, whereas unsigned intensity and modality prediction errors are encoded in the anterior insula for both stimulus modalities.
Classification of early-MCI patients from healthy controls using evolutionary optimization of graph measures of resting-state fMRI, for the Alzheimer’s disease neuroimaging initiative
Authors: Jafar Zamani, Ali Sadr, Amir-Homayoun Javadi
Journal: PLOS ONE
Accepted: 2022-04-11T00:00:00Z


Identifying individuals with early mild cognitive impairment (EMCI) can be an effective strategy for early diagnosis and delay the progression of Alzheimer’s disease (AD). Many approaches have been devised to discriminate those with EMCI from healthy control (HC) individuals. Selection of the most effective parameters has been one of the challenging aspects of these approaches. In this study we suggest an optimization method based on five evolutionary algorithms that can be used in optimization of neuroimaging data with a large number of parameters. Resting-state functional magnetic resonance imaging (rs-fMRI) measures, which measure functional connectivity, have been shown to be useful in prediction of cognitive decline. Analysis of functional connectivity data using graph measures is a common practice that results in a great number of parameters. Using graph measures we calculated 1155 parameters from the functional connectivity data of HC (n = 72) and EMCI (n = 68) extracted from the publicly available database of the Alzheimer’s disease neuroimaging initiative database (ADNI). These parameters were fed into the evolutionary algorithms to select a subset of parameters for classification of the data into two categories of EMCI and HC using a two-layer artificial neural network. All algorithms achieved classification accuracy of 94.55%, which is extremely high considering single-modality input and low number of data participants. These results highlight potential application of rs-fMRI and efficiency of such optimization methods in classification of images into HC and EMCI. This is of particular importance considering that MRI images of EMCI individuals cannot be easily identified by experts.
Brain stimulation competes with ongoing oscillations for control of spike timing in the primate brain
Authors: Matthew R Krause, Pedro G Vieira, Jean-Philippe Thivierge, Christopher C Pack
Journal: PLOS Biology
Accepted: 2022-04-27T00:00:00Z


Transcranial alternating current stimulation (tACS) is a popular method for modulating brain activity noninvasively. In particular, tACS is often used as a targeted intervention that enhances a neural oscillation at a specific frequency to affect a particular behavior. However, these interventions often yield highly variable results. Here, we provide a potential explanation for this variability: tACS competes with the brain’s ongoing oscillations. Using neural recordings from alert nonhuman primates, we find that when neural firing is independent of ongoing brain oscillations, tACS readily entrains spiking activity, but when neurons are strongly entrained to ongoing oscillations, tACS often causes a decrease in entrainment instead. Consequently, tACS can yield categorically different results on neural activity, even when the stimulation protocol is fixed. Mathematical analysis suggests that this competition is likely to occur under many experimental conditions. Attempting to impose an external rhythm on the brain may therefore often yield precisely the opposite effect.

Transcranial alternating current stimulation (tACS) is a popular method for modulating brain activity noninvasively; however, tACS can often yield highly variable results. This study shows that when neurons are strongly entrained to ongoing oscillations, tACS often causes a decrease in entrainment instead of the expected enhancement.
Steady state evoked potential (SSEP) responses in the primary and secondary somatosensory cortices of anesthetized cats: Nonlinearity characterized by harmonic and intermodulation frequencies
Authors: Yota Kawashima, Rannee Li, Spencer Chin-Yu Chen, Richard Martin Vickery, John W Morley, Naotsugu Tsuchiya
Journal: PLOS ONE
Accepted: 2021-02-10T00:00:00Z


When presented with an oscillatory sensory input at a particular frequency, F [Hz], neural systems respond with the corresponding frequency, f [Hz], and its multiples. When the input includes two frequencies (F1 and F2) and they are nonlinearly integrated in the system, responses at intermodulation frequencies (i.e., n1*f1+n2*f2 [Hz], where n1 and n2 are non-zero integers) emerge. Utilizing these properties, the steady state evoked potential (SSEP) paradigm allows us to characterize linear and nonlinear neural computation performed in cortical neurocircuitry. Here, we analyzed the steady state evoked local field potentials (LFPs) recorded from the primary (S1) and secondary (S2) somatosensory cortex of anesthetized cats (maintained with alfaxalone) while we presented slow (F1 = 23Hz) and fast (F2 = 200Hz) somatosensory vibration to the contralateral paw pads and digits. Over 9 experimental sessions, we recorded LFPs from N = 1620 and N = 1008 bipolar-referenced sites in S1 and S2 using electrode arrays. Power spectral analyses revealed strong responses at 1) the fundamental (f1, f2), 2) its harmonic, 3) the intermodulation frequencies, and 4) broadband frequencies (50-150Hz). To compare the computational architecture in S1 and S2, we employed simple computational modeling. Our modeling results necessitate nonlinear computation to explain SSEP in S2 more than S1. Combined with our current analysis of LFPs, our paradigm offers a rare opportunity to constrain the computational architecture of hierarchical organization of S1 and S2 and to reveal how a large-scale SSEP can emerge from local neural population activities.
Multiple bumps can enhance robustness to noise in continuous attractor networks
Authors: Raymond Wang, Louis Kang
Journal: PLOS Computational Biology
Accepted: 2022-09-06T00:00:00Z


A central function of continuous attractor networks is encoding coordinates and accurately updating their values through path integration. To do so, these networks produce localized bumps of activity that move coherently in response to velocity inputs. In the brain, continuous attractors are believed to underlie grid cells and head direction cells, which maintain periodic representations of position and orientation, respectively. These representations can be achieved with any number of activity bumps, and the consequences of having more or fewer bumps are unclear. We address this knowledge gap by constructing 1D ring attractor networks with different bump numbers and characterizing their responses to three types of noise: fluctuating inputs, spiking noise, and deviations in connectivity away from ideal attractor configurations. Across all three types, networks with more bumps experience less noise-driven deviations in bump motion. This translates to more robust encodings of linear coordinates, like position, assuming that each neuron represents a fixed length no matter the bump number. Alternatively, we consider encoding a circular coordinate, like orientation, such that the network distance between adjacent bumps always maps onto 360 degrees. Under this mapping, bump number does not significantly affect the amount of error in the coordinate readout. Our simulation results are intuitively explained and quantitatively matched by a unified theory for path integration and noise in multi-bump networks. Thus, to suppress the effects of biologically relevant noise, continuous attractor networks can employ more bumps when encoding linear coordinates; this advantage disappears when encoding circular coordinates. Our findings provide motivation for multiple bumps in the mammalian grid network.
Author summary: Our brains maintain an internal sense of location and direction so we can, for example, find our way to the door if the lights go off. A class of neural circuits called continuous attractor networks is believed to be responsible for this ability. These circuits must be resilient against the myriad forms of imperfections and random fluctuations present in the brain, which can degrade the accuracy of their encoded information. We have discovered a new way in which continuous attractor networks can improve their robustness to noise: they should distribute their activity among multiple regions in the network, called bumps, instead of concentrating it in a single bump. Bump number is a fundamental feature of continuous attractor networks, but its connection to error suppression has never been appreciated. A recent experiment in rodents suggests that one such network indeed contains multiple regions of activity; our finding provides motivation for why such a configuration may have been evolved.
A threshold-free model of numerosity comparisons
Authors: Santiago Alonso-Diaz, Jessica F Cantlon, Steven T Piantadosi
Journal: PLOS ONE
Accepted: 2018-03-09T00:00:00Z


A dominant mechanism in the Judgment and Decision Making literature states that information is accumulated about each choice option until a decision threshold is met. Only after that threshold does a subject start to execute a motor response to indicate their choice. However, recent research has revealed spatial gradients in motor responses as a function of comparison difficulty as well as changes-of-mind in the middle of an action, both suggesting continued accumulation and processing of decision-related signals after the decision boundary. Here we present a formal model and supporting data from a number comparison task that a continuous motor planner, combined with a simple statistical inference scheme, can model detailed behavioral effects without assuming a threshold. This threshold-free model reproduces subjects’ sensitivity to numerical distance in reaching, accuracy, reaction time, and changes of mind. We argue that the motor system positions the effectors using an optimal biomechanical feedback controller, and continuous statistical inference on outputs from cognitive processes.
Emergent mechanisms of evidence integration in recurrent neural networks
Authors: Silvan Quax, Marcel van Gerven
Journal: PLOS ONE
Accepted: 2018-09-29T00:00:00Z


Recent advances in machine learning have enabled neural networks to solve tasks humans typically perform. These networks offer an exciting new tool for neuroscience that can give us insight in the emergence of neural and behavioral mechanisms. A big gap remains though between the very deep neural networks that have risen in popularity and outperformed many existing shallow networks in the field of computer vision and the highly recurrently connected human brain. This trend towards ever-deeper architectures raises the question why the brain has not developed such an architecture. Besides wiring constraints we argue that the brain operates under different circumstances when performing object recognition, being confronted with noisy and ambiguous sensory input. The role of time in the process of object recognition is investigated, showing that a recurrent network trained through reinforcement learning is able to learn the amount of time needed to arrive at an accurate estimate of the stimulus and develops behavioral and neural mechanisms similar to those found in the human and non-human primate literature.
Towards an ontology of cognitive processes and their neural substrates: A structural equation modeling approach
Authors: Teal Eich, David Parker, Yunglin Gazes, Qolamreza Razlighi, Christian Habeck, Yaakov Stern
Journal: PLOS ONE
Accepted: 2020-01-08T00:00:00Z


A key challenge in the field of cognitive neuroscience is to identify discriminable cognitive functions, and then map these functions to brain activity. In the current study, we set out to explore the relationships between performance arising from different cognitive tasks thought to tap different domains of cognition, and then to test whether these distinct latent cognitive abilities also are subserved by corresponding “latent” brain substrates. To this end, we tested a large sample of adults under the age of 40 on twelve cognitive tasks as they underwent fMRI scanning. Exploratory factor analysis revealed 4-factor model, dissociating tasks into processes corresponding to episodic memory retrieval, reasoning, speed of processing and vocabulary. An analysis of the topographic covariance patterns of the BOLD-response acquired during each task similarity also converged on four neural networks that corresponded to the 4 latent factors. These results suggest that distinct ontologies of cognition are subserved by corresponding distinct neural networks.