PenguinMan/ARXIV huggingface dataset:
Disrupted reinforcement learning during post-error slowing in ADHD
Authors: Andre Chevrier, Mehereen Bhaijiwala, Jonathan Lipszyc, Douglas Cheyne, Simon Graham, Russell Schachar
Journal: PLOS ONE
Accepted: 2019-01-30T00:00:00Z


ADHD is associated with altered dopamine regulated reinforcement learning on prediction errors. Despite evidence of categorically altered error processing in ADHD, neuroimaging advances have largely investigated models of normal reinforcement learning in greater detail. Further, although reinforcement leaning critically relies on ventral striatum exerting error magnitude related thresholding influences on substantia nigra (SN) and dorsal striatum, these thresholding influences have never been identified with neuroimaging. To identify such thresholding influences, we propose that error magnitude related activities must first be separated from opposite activities in overlapping neural regions during error detection. Here we separate error detection from magnitude related adjustment (post-error slowing) during inhibition errors in the stop signal task in typically developing (TD) and ADHD adolescents using fMRI. In TD, we predicted that: 1) deactivation of dorsal striatum on error detection interrupts ongoing processing, and should be proportional to right frontoparietal response phase activity that has been observed in the SST; 2) deactivation of ventral striatum on post-error slowing exerts thresholding influences on, and should be proportional to activity in dorsal striatum. In ADHD, we predicted that ventral striatum would instead correlate with heightened amygdala responses to errors. We found deactivation of dorsal striatum on error detection correlated with response-phase activity in both groups. In TD, post-error slowing deactivation of ventral striatum correlated with activation of dorsal striatum. In ADHD, ventral striatum correlated with heightened amygdala activity. Further, heightened activities in locus coeruleus (norepinephrine), raphe nucleus (serotonin) and medial septal nuclei (acetylcholine), which all compete for control of DA, and are altered in ADHD, exhibited altered correlations with SN. All correlations in TD were replicated in healthy adults. Results in TD are consistent with dopamine regulated reinforcement learning on post-error slowing. In ADHD, results are consistent with heightened activities in the amygdala and non-dopaminergic neurotransmitter nuclei preventing reinforcement learning.
Humans adapt their anticipatory eye movements to the volatility of visual motion properties
Authors: Chloé Pasturel, Anna Montagnini, Laurent Udo Perrinet
Journal: PLOS Computational Biology
Accepted: 2020-02-27T00:00:00Z


Animal behavior constantly adapts to changes, for example when the statistical properties of the environment change unexpectedly. For an agent that interacts with this volatile setting, it is important to react accurately and as quickly as possible. It has already been shown that when a random sequence of motion ramps of a visual target is biased to one direction (e.g. right or left), human observers adapt their eye movements to accurately anticipate the target’s expected direction. Here, we prove that this ability extends to a volatile environment where the probability bias could change at random switching times. In addition, we also recorded the explicit prediction of the next outcome as reported by observers using a rating scale. Both results were compared to the estimates of a probabilistic agent that is optimal in relation to the assumed generative model. Compared to the classical leaky integrator model, we found a better match between our probabilistic agent and the behavioral responses, both for the anticipatory eye movements and the explicit task. Furthermore, by controlling the level of preference between exploitation and exploration in the model, we were able to fit for each individual’s experimental dataset the most likely level of volatility and analyze inter-individual variability across participants. These results prove that in such an unstable environment, human observers can still represent an internal belief about the environmental contingencies, and use this representation both for sensory-motor control and for explicit judgments. This work offers an innovative approach to more generically test the diversity of human cognitive abilities in uncertain and dynamic environments.
Author summary: Understanding how humans adapt to changing environments to make judgments or plan motor responses based on time-varying sensory information is crucial for psychology, neuroscience and artificial intelligence. Current theories for how we deal with the environment’s uncertainty, that is, in response to the introduction of some randomness change, mostly rely on the behavior at equilibrium, long after after a change. Here, we show that in the more ecological case where the context switches at random times all along the experiment, an adaptation to this volatility can be performed online. In particular, we show in two behavioral experiments that humans can adapt to such volatility at the early sensorimotor level, through their anticipatory eye movements, but also at a higher cognitive level, through explicit ratings. Our results suggest that humans (and future artificial systems) can use much richer adaptive strategies than previously assumed.
An update to Hippocampome.org by integrating single-cell phenotypes with circuit function in vivo
Authors: Alberto Sanchez-Aguilera, Diek W Wheeler, Teresa Jurado-Parras, Manuel Valero, Miriam S Nokia, Elena Cid, Ivan Fernandez-Lamo, Nate Sutton, Daniel García-Rincón, Liset M de la Prida, Giorgio A Ascoli
Journal: PLOS Biology
Accepted: 2021-03-30T00:00:00Z


Understanding brain operation demands linking basic behavioral traits to cell-type specific dynamics of different brain-wide subcircuits. This requires a system to classify the basic operational modes of neurons and circuits. Single-cell phenotyping of firing behavior during ongoing oscillations in vivo has provided a large body of evidence on entorhinal–hippocampal function, but data are dispersed and diverse. Here, we mined literature to search for information regarding the phase-timing dynamics of over 100 hippocampal/entorhinal neuron types defined in Hippocampome.org. We identified missing and unresolved pieces of knowledge (e.g., the preferred theta phase for a specific neuron type) and complemented the dataset with our own new data. By confronting the effect of brain state and recording methods, we highlight the equivalences and differences across conditions and offer a number of novel observations. We show how a heuristic approach based on oscillatory features of morphologically identified neurons can aid in classifying extracellular recordings of single cells and discuss future opportunities and challenges towards integrating single-cell phenotypes with circuit function.

By integrating single-cell firing behavior during in vivo oscillations with morphological and molecular neuron classification in vitro, this study standardizes a framework for interpreting the functional roles of distinct circuit modules and ascribing extracellular recordings to identified neuron types.
Change detection of auditory tonal patterns defined by absolute versus relative pitch information. A combined behavioural and EEG study
Authors: Nina Coy, Maria Bader, Erich Schröger, Sabine Grimm
Journal: PLOS ONE
Accepted: 2021-02-08T00:00:00Z


The human auditory system often relies on relative pitch information to extract and identify auditory objects; such as when the same melody is played in different keys. The current study investigated the mental chronometry underlying the active discrimination of unfamiliar melodic six-tone patterns by measuring behavioural performance and event-related potentials (ERPs). In a roving standard paradigm, such patterns were either repeated identically within a stimulus train, carrying absolute frequency information about the pattern, or shifted in pitch (transposed) between repetitions, so only relative pitch information was available to extract the pattern identity. Results showed that participants were able to use relative pitch to detect when a new melodic pattern occurred. Though in the absence of absolute pitch sensitivity significantly decreased and behavioural reaction time to pattern changes increased. Mismatch-Negativity (MMN), an ERP indicator of auditory deviance detection, was elicited at approximately 206 ms after stimulus onset at frontocentral electrodes, even when only relative pitch was available to inform pattern discrimination. A P3a was elicited in both conditions, comparable in amplitude and latency. Increased latencies but no differences in amplitudes of N2b, and P3b suggest that processing at higher levels is affected when, in the absence of absolute pitch cues, relative pitch has to be extracted to inform pattern discrimination. Interestingly, the response delay of approximately 70 ms on the behavioural level, already fully manifests at the level of N2b. This is in accordance with recent findings on implicit auditory learning processes and suggests that in the absence of absolute pitch cues a slowing of target selection rather than a slowing of the auditory pattern change detection process causes the deterioration in behavioural performance.
Temporal progression along discrete coding states during decision-making in the mouse gustatory cortex
Authors: Liam Lang, Giancarlo La Camera, Alfredo Fontanini
Journal: PLOS Computational Biology
Accepted: 2023-01-10T00:00:00Z


The mouse gustatory cortex (GC) is involved in taste-guided decision-making in addition to sensory processing. Rodent GC exhibits metastable neural dynamics during ongoing and stimulus-evoked activity, but how these dynamics evolve in the context of a taste-based decision-making task remains unclear. Here we employ analytical and modeling approaches to i) extract metastable dynamics in ensemble spiking activity recorded from the GC of mice performing a perceptual decision-making task; ii) investigate the computational mechanisms underlying GC metastability in this task; and iii) establish a relationship between GC dynamics and behavioral performance. Our results show that activity in GC during perceptual decision-making is metastable and that this metastability may serve as a substrate for sequentially encoding sensory, abstract cue, and decision information over time. Perturbations of the model’s metastable dynamics indicate that boosting inhibition in different coding epochs differentially impacts network performance, explaining a counterintuitive effect of GC optogenetic silencing on mouse behavior.
Author summary: Neural circuits can operate in a dynamic regime characterized by sequences of metastable states. Each state can last for hundreds of ms and is described by correlated spiking activity across ensembles of neurons. Metastable dynamics have been shown to play a role in representing sensory information and cognitive signals. In this article, we demonstrate that activity in the gustatory cortex of mice engaged in a decision-making task is metastable. We found that some metastable states are associated with the perception of taste, while others are associated with decision processes. This neural activity, and the behavioral performance sustained by it, can be explained by a metastable network model comprising connected ensembles of spiking neurons. When mimicking optogenetic silencing conducted in previous experiments, our model simulations reveal the link between the disruption of metastable state sequences and the behavioral impairment due to the optogenetic manipulation. Altogether, our results reveal the importance of metastable states in mediating taste perception related to task performance.
Coherent noise enables probabilistic sequence replay in spiking neuronal networks
Authors: Younes Bouhadjar, Dirk J Wouters, Markus Diesmann, Tom Tetzlaff
Journal: PLOS Computational Biology
Accepted: 2023-03-02T00:00:00Z


Animals rely on different decision strategies when faced with ambiguous or uncertain cues. Depending on the context, decisions may be biased towards events that were most frequently experienced in the past, or be more explorative. A particular type of decision making central to cognition is sequential memory recall in response to ambiguous cues. A previously developed spiking neuronal network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. In response to an ambiguous cue, the model deterministically recalls the sequence shown most frequently during training. Here, we present an extension of the model enabling a range of different decision strategies. In this model, explorative behavior is generated by supplying neurons with noise. As the model relies on population encoding, uncorrelated noise averages out, and the recall dynamics remain effectively deterministic. In the presence of locally correlated noise, the averaging effect is avoided without impairing the model performance, and without the need for large noise amplitudes. We investigate two forms of correlated noise occurring in nature: shared synaptic background inputs, and random locking of the stimulus to spatiotemporal oscillations in the network activity. Depending on the noise characteristics, the network adopts various recall strategies. This study thereby provides potential mechanisms explaining how the statistics of learned sequences affect decision making, and how decision strategies can be adjusted after learning.
Author summary: Humans and other animals often benefit from exploring multiple alternative solutions to a given problem, rather than adhering to a single, global optimum. Such explorative behavior is frequently attributed to noise in the neuronal dynamics. Supplying each neuron or synapse in a neuronal circuit with noise, however, does not necessarily lead to explorative dynamics. If decisions are triggered by the compound activity of ensembles of neurons or synapses, noise averages out, unless it is correlated within these ensembles. As an analogy, consider a particle in a still fluid: despite the constant bombardment by surrounding molecules, a large particle will hardly undergo any Brownian motion, because the momenta of the impinging molecules largely cancel each other. Only if the molecules move in a coherent manner, such as in a turbulent fluid, they can have a substantial influence on the particle’s motion. This modeling study exploits this effect to equip a neuronal sequence-processing circuit with explorative behavior by introducing configurable, locally coherent noise. It contributes to an understanding of the neuronal mechanisms underlying different decision strategies in the face of ambiguity, and highlights the role of coherent network activity such as traveling waves during sequential memory recall.
Brief mindfulness training enhances cognitive control in socioemotional contexts: Behavioral and neural evidence
Authors: Jordan T Quaglia, Fadel Zeidan, Peter G Grossenbacher, Sara P Freeman, Sarah E Braun, Alexandra Martelli, Robert J Goodman, Kirk Warren Brown
Journal: PLOS ONE
Accepted: 2019-07-02T00:00:00Z


In social contexts, the dynamic nature of others’ emotions places unique demands on attention and emotion regulation. Mindfulness, characterized by heightened and receptive moment-to-moment attending, may be well-suited to meet these demands. In particular, mindfulness may support more effective cognitive control in social situations via efficient deployment of top-down attention. To test this, a randomized controlled study examined effects of mindfulness training (MT) on behavioral and neural (event-related potentials [ERPs]) responses during an emotional go/no-go task that tested cognitive control in the context of emotional facial expressions that tend to elicit approach or avoidance behavior. Participants (N = 66) were randomly assigned to four brief (20 min) MT sessions or to structurally equivalent book learning control sessions. Relative to the control group, MT led to improved discrimination of facial expressions, as indexed by d-prime, as well as more efficient cognitive control, as indexed by response time and accuracy, and particularly for those evidencing poorer discrimination and cognitive control at baseline. MT also produced better conflict monitoring of behavioral goal-prepotent response tendencies, as indexed by larger No-Go N200 ERP amplitudes, and particularly so for those with smaller No-Go amplitude at baseline. Overall, findings are consistent with MT’s potential to enhance deployment of early top-down attention to better meet the unique cognitive and emotional demands of socioemotional contexts, particularly for those with greater opportunity for change. Findings also suggest that early top-down attention deployment could be a cognitive mechanism correspondent to the present-oriented attention commonly used to explain regulatory benefits of mindfulness more broadly.
Multi-scale modeling of the circadian modulation of learning and memory
Authors: Shiju S, K Sriram
Journal: PLOS ONE
Accepted: 2019-07-02T00:00:00Z


We propose a multi-scale model to explain the time-of-day effects on learning and memory. We specifically model the circadian variation of hippocampus (HC) dependent long-term potentiation (LTP), depression (LTD), and the fear conditioning paradigm in amygdala. The model we built has both Goodwin type circadian gene regulatory network (GRN) and the conductance model of Morris-Lecar (ML) type to explain the spontaneous firing patterns (SFR) in suprachiasmatic nucleus (SCN). In the conductance model, we also include N-Methyl-D-aspartic acid receptor (NMDAR) to study the circadian dependent changes in LTP/LTD in hippocampus and include both NMDAR and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR) dynamics to explain the circadian modulation of fear conditioning paradigm in memory acquisition, recall, and extinction as seen in amygdala. Our multi-scale model captures the essential dynamics seen in the experiments and strongly supports the circadian time-of-the-day effects on learning and memory.
Higher hypnotic suggestibility is associated with the lower EEG signal variability in theta, alpha, and beta frequency bands
Authors: Soheil Keshmiri, Maryam Alimardani, Masahiro Shiomi, Hidenobu Sumioka, Hiroshi Ishiguro, Kazuo Hiraki
Journal: PLOS ONE
Accepted: 2020-03-10T00:00:00Z


Variation of information in the firing rate of neural population, as reflected in different frequency bands of electroencephalographic (EEG) time series, provides direct evidence for change in neural responses of the brain to hypnotic suggestibility. However, realization of an effective biomarker for spiking behaviour of neural population proves to be an elusive subject matter with its impact evident in highly contrasting results in the literature. In this article, we took an information-theoretic stance on analysis of the EEG time series of the brain activity during hypnotic suggestions, thereby capturing the variability in pattern of brain neural activity in terms of its information content. For this purpose, we utilized differential entropy (DE, i.e., the average information content in a continuous time series) of theta, alpha, and beta frequency bands of fourteen-channel EEG time series recordings that pertain to the brain neural responses of twelve carefully selected high and low hypnotically suggestible individuals. Our results show that the higher hypnotic suggestibility is associated with a significantly lower variability in information content of theta, alpha, and beta frequencies. Moreover, they indicate that such a lower variability is accompanied by a significantly higher functional connectivity (FC, a measure of spatiotemporal synchronization) in the parietal and the parieto-occipital regions in the case of theta and alpha frequency bands and a non-significantly lower FC in the central region’s beta frequency band. Our results contribute to the field in two ways. First, they identify the applicability of DE as a unifying measure to reproduce the similar observations that are separately reported through adaptation of different hypnotic biomarkers in the literature. Second, they extend these previous findings that were based on neutral hypnosis (i.e., a hypnotic procedure that involves no specific suggestions other than those for becoming hypnotized) to the case of hypnotic suggestions, thereby identifying their presence as a potential signature of hypnotic experience.
A computational account of threat-related attentional bias
Authors: Toby Wise, Jochen Michely, Peter Dayan, Raymond J Dolan
Journal: PLOS Computational Biology
Accepted: 2019-08-18T00:00:00Z


Visual selective attention acts as a filter on perceptual information, facilitating learning and inference about important events in an agent’s environment. A role for visual attention in reward-based decisions has previously been demonstrated, but it remains unclear how visual attention is recruited during aversive learning, particularly when learning about multiple stimuli concurrently. This question is of particular importance in psychopathology, where enhanced attention to threat is a putative feature of pathological anxiety. Using an aversive reversal learning task that required subjects to learn, and exploit, predictions about multiple stimuli, we show that the allocation of visual attention is influenced significantly by aversive value but not by uncertainty. Moreover, this relationship is bidirectional in that attention biases value updates for attended stimuli, resulting in heightened value estimates. Our findings have implications for understanding biased attention in psychopathology and support a role for learning in the expression of threat-related attentional biases in anxiety.
Author summary: To make inferences and learn efficiently in the face of a multiplicity of stimuli we need to allocate attention preferentially to those that are most motivationally relevant. It is unclear how this is achieved in aversive environments. We investigated how value (the likelihood of an unpleasant event) and uncertainty (akin to ignorance about its probability) influence visual attention during aversive learning. Our results show that attention is influenced by value but not by uncertainty. Attention in turn results in heightened value estimates for attended stimuli. The findings have implications for understanding the development of pathological threat-related attentional biases that are a feature of anxiety disorders.