PenguinMan/ARXIV huggingface dataset:
Asymmetric and adaptive reward coding via normalized reinforcement learning
Authors: Louie, K.
Category: neuroscience
Date: 2021-11-29

Learning is widely modeled in psychology, neuroscience, and computer science by prediction error-guided reinforcement learning (RL) algorithms. While standard RL assumes linear reward functions, reward-related neural activity is a saturating, nonlinear function of reward; however, the computational and behavioral implications of nonlinear RL are unknown. Here, we show that nonlinear RL incorporating the canonical divisive normalization computation introduces an intrinsic and tunable asymmetry in prediction error coding. At the behavioral level, this asymmetry explains empirical variability in risk preferences typically attributed to asymmetric learning rates. At the neural level, diversity in asymmetries provides a computational mechanism for recently proposed theories of distributional RL, allowing the brain to learn the full probability distribution of future rewards. This behavioral and computational flexibility argues for an incorporation of biologically valid value functions in computational models of learning and decision-making.
Hippocampal-Prefrontal cortex network dynamics predict performance during retrieval in a context-guided object memory task
Authors: Morici, J. F.; Weisstaub, N. V.; Zold, C. L.
Category: neuroscience
Date: 2021-11-29

Remembering life episodes is a complex process that requires the interaction between multiple brain areas. It is thought that contextual information provided by the hippocampus (HPC) can trigger the recall of a past event through the activation of medial prefrontal cortex (mPFC) neuronal ensembles, but the underlying mechanisms remain poorly understood. Indeed, little is known about how the vHPC and mPFC are coordinated during a contextual-guided recall of an object recognition memory. To address this, we performed electrophysiological recordings in behaving rats during the retrieval phase of the object-in-context memory task (OIC). Coherence, phase locking and theta amplitude correlation analysis showed an increase in vHPC-mPFC LFP synchronization in the theta range when animals explore contextually mismatched objects. Moreover, we identified ensembles of putative pyramidal cells in the mPFC that encode specific object-context associations. Interestingly, the increase of vHPC-mPFC synchronization during exploration of the contextually mismatched object and the preference of mPFC incongruent object neurons predicts the animals performance during the resolution of the OIC task. Altogether, these results identify changes in vHPC-mPFC synchronization and mPFC ensembles encoding specific object-context associations likely involved in the recall of past events.
The functional role of episodic memory in spatial learning
Authors: Zeng, X.; Wiskott, L.; Cheng, S.
Category: neuroscience
Date: 2022-04-12

AO_SCPLOWBSTRACTC_SCPLOWEpisodic memory has been studied extensively in the past few decades, but so far little is understood about how it drives behavior. Here we propose that episodic memory can facilitate learning in two fundamentally different modes: retrieval and replay. We study their properties by comparing three learning paradigms using computational modeling based on visually-driven reinforcement learning. Firstly, episodic memory is retrieved to learn from single experiences (one-shot learning); secondly, episodic memory is replayed to facilitate learning of statistical regularities (replay learning); and, thirdly, learning occurs online as experiences arise with no access to past experiences (online learning). We found that episodic memory benefits spatial learning in a broad range of conditions, but the performance difference is meaningful only when the task is sufficiently complex and the number of learning trials is limited. Furthermore, the two modes of accessing episodic memory affect spatial learning distinctly. One-shot learning is initially faster than replay learning, but the latter reaches a better asymptotic performance. Our model accounts for experimental results where replay is inhibited, but the hippocampus, and hence episodic memory, is intact during learning. Understanding how episodic memory drives behavior will be an important step towards elucidating the nature of episodic memory.
Prenatal opioid exposure inhibits microglial sculpting of the dopamine system during adolescence
Authors: Smith, C. J.; Lintz, T.; Clark, M. J.; Malacon, K. E.; Constantino, N.; Abiad, A.; Alonso-Caraballo, Y.; Kim, V. J.; Jo, Y. C.; Bilbo, S. D.; Chartoff, E. H.
Category: neuroscience
Date: 2022-01-18

The current opioid epidemic has dramatically increased the number of children who are prenatally exposed to opioids, including oxycodone. A number of social and cognitive abnormalities have been documented in these children as they reach young adulthood. However, little is known about the mechanisms underlying developmental effects of prenatal opioid exposure. Microglia, the resident immune cells of the brain, respond to acute opioid exposure in adulthood. Moreover, microglia are known to sculpt neural circuits during healthy development. Indeed, we recently found that microglial phagocytosis of dopamine D1 receptors (D1R) in the nucleus accumbens (NAc) is required for the natural developmental decline in NAc-D1R that occurs between adolescence and adulthood in rats. This microglial pruning occurs only in males, and is required for the normal developmental trajectory of social play behavior. However, virtually nothing is known as to whether this developmental program is altered by prenatal exposure to opioids. Here, we show in rats that maternal oxycodone self-administration during pregnancy leads to reduced adolescent microglial phagocytosis of D1R and subsequently higher D1R density within the NAc in adult male, but not female, offspring. Finally, we show that prenatal opioid exposure abolishes the extinction of oxycodone-conditioned place preference in these male offspring. This work demonstrates for the first time that microglia play a key role in translating prenatal opioid exposure to long-term changes in neural systems and behavior.

HighlightsO_LIPrenatal opioid exposure decreases offspring viability and body weight in males and females
C_LIO_LIPrenatal opioid exposure decreases microglial phagocytosis of D1R in the nucleus accumbens in males only
C_LIO_LIPrenatal opioid exposure increases nucleus accumbens dopamine D1 receptor expression in males but not females
C_LIO_LIAdult males fail to extinguish oxycodone-conditioned place preference following prenatal oxycodone exposure
C_LI
Increased excursions to functional networks in schizophrenia in the absence of task
Authors: Farinha, M.; Amado, C.; Cabral, J.
Category: neuroscience
Date: 2021-12-07

Brain activity during rest has been demonstrated to evolve through a repertoire of functional connectivity (FC) patterns, whose alterations may provide biomarkers of schizophrenia - a psychotic disorder characterized by dysfunctional brain connectivity. In this study, differences between the dynamic exploration of resting-state networks using functional magnetic resonance imaging (fMRI) data from 71 schizophrenia patients and 74 healthy controls were investigated using a method focusing on the dominant fMRI signal phase coherence pattern at each time point. Through the lens of dynamical systems theory, brain activity in the form of temporal FC state trajectories was examined for intergroup differences by calculating the fractional occupancy, dwell time, limiting probability of each state and the transition probabilities between states. Results showed reduced fractional occupancy of a globally synchronized state in schizophrenia. Conversely, FC states overlapping with canonical functional subsystems exhibited increased fractional occupancy and limiting probability in schizophrenia. Furthermore, state-to-state transition probabilities were altered in schizophrenia. This revealed a reduced probability of remaining in a global integrative state, increased probability of switching from this state to functionally meaningful networks and reduced probability of remaining in a state related to the Default Mode network. These results revealed medium to large effect sizes. Finally, this study showed that using K-medoids clustering did not influence the observed intergroup differences - highlighting the utility of dynamical systems theory to better understand brain activity. Combined, these findings expose pronounced differences between schizophrenia patients and healthy controls - supporting and extending current knowledge regarding disrupted brain dynamics in schizophrenia.
Reactivation of hedonic but not sensory representations in human emotional learning
Authors: Ehlers, M. R.; Kryklywy, J. H.; Beukers, A. O.; Moore, S. R.; Brandon, F. J.; Anderson, A. K.; Todd, R. M.
Category: neuroscience
Date: 2021-11-29

Learning which stimuli in our environment co-occur with painful or pleasurable events is critical for survival. Previous research has established the basic neural and behavioural mechanisms of aversive and appetitive conditioning; however, it is unclear what precisely is learned. Here we examined what aspects of the unconditioned stimulus (US) - sensory and hedonic - are transferred to the conditioned stimulus (CS). To decode the content of brain activation patterns elicited during appetitive (soft touch) and aversive (painful touch) conditioning of faces, a novel variation of representational similarity analysis (RSA) based on theoretically driven representational patterns of interest (POIs) was applied to fMRI data. Once face associations were learned through conditioning, globally the CS reactivated US representational patterns showing conditioning-dependent reactivation. More specifically, in higher order brain regions, the CS only reactivated hedonic but not sensory aspects of the US - suggesting that affective conditioning primarily carries forward the valence of the experience rather than its sensory origins.
Highly accurate retinotopic maps of the physiological blind spot in human visual cortex
Authors: Urale, P. W. B.; Puckett, A. M.; York, A.; Arnold, D.; Schwarzkopf, D. S.
Category: neuroscience
Date: 2022-02-08

The physiological blind spot is a naturally occurring scotoma corresponding with the optic disc in the retina of each eye. Even during monocular viewing, observers are usually oblivious to the scotoma, in part because the visual system extrapolates information from the surrounding area. Unfortunately, studying this visual field region with neuroimaging has proven difficult, as it occupies only a small part of retinotopic cortex. Here we used functional magnetic resonance imaging and a novel data-driven method for mapping the retinotopic organization in and around the blind spot representation in V1. Our approach allowed for highly accurate reconstructions of the extent of an observers blind spot, and out-performed conventional model-based analyses. This method opens exciting opportunities to study the plasticity of receptive fields after visual field loss, and our data add to evidence suggesting that the neural circuitry responsible for impressions of perceptual completion across the physiological blind spot most likely involves regions of extrastriate cortex - beyond V1.
Structured connectivity in the cerebellum enables noise-resilient pattern separation
Authors: Nguyen, T. M.; Thomas, L. A.; Rhoades, J. L.; Ricchi, I.; Yuan, X. C.; Sheridan, A.; Hildebrand, D. G.; Funke, J.; Regehr, W. G.; Lee, W.-C. A.
Category: neuroscience
Date: 2021-11-30

The cerebellum is thought to detect and correct errors between intended and executed commands1-3 and is critical for social behaviors, cognition and emotion4-6. Computations for motor control must be performed quickly to correct errors in real time and should be sensitive to small differences between patterns for fine error correction while being resilient to noise7. Influential theories of cerebellar information processing have largely assumed random network connectivity, which increases the encoding capacity of the networks first layer8-13. However, maximizing encoding capacity reduces resiliency to noise7. To understand how neuronal circuits address this fundamental tradeoff, we mapped the feedforward connectivity in the mouse cerebellar cortex using automated large-scale transmission electron microscopy (EM) and convolutional neural network-based image segmentation. We found that both the input and output layers of the circuit exhibit redundant and selective connectivity motifs, which contrast with prevailing models. Numerical simulations suggest these redundant, non-random connectivity motifs increase discriminability of similar input patterns at a minimal cost to the networks overall encoding capacity. This work reveals how neuronal network structure can balance encoding capacity and redundancy, unveiling principles of biological network architecture with implications for artificial neural network design.
Multi-task representations in human cortex transform along a sensory-to-motor hierarchy
Authors: Ito, T.; Murray, J. D.
Category: neuroscience
Date: 2021-11-30

Human cognition recruits diverse neural processes, yet the organizing computational and functional architectures remain unclear. Here, we characterized the geometry and topography of multi-task representations across human cortex using functional MRI during 26 cognitive tasks in the same subjects. We measured the representational similarity across tasks within a region, and the alignment of representations between regions. We found a cortical topography of representational alignment following a hierarchical sensory-association-motor gradient, revealing compression-then-expansion of multi-task dimensionality along this gradient. To investigate computational principles of multi-task representations, we trained multi-layer neural network models to transform empirical visual to motor representations. Compression-then-expansion organization in models emerged exclusively in a training regime where internal representations are highly optimized for sensory-to-motor transformation, and not under generic signal propagation. This regime produces hierarchically structured representations similar to empirical cortical patterns. Together, these results reveal computational principles that organize multi-task representations across human cortex to support flexible cognition.
Using child-friendly movie stimuli to study the development of face, place, and object regions from age 3 to 12 years
Authors: Kamps, F. S.; Richardson, H.; Murty, N. A. S. R.; Kanwisher, N.; Saxe, R.
Category: neuroscience
Date: 2021-11-30

Scanning young children while watching short, engaging, commercially-produced movies has emerged as a promising approach for increasing data retention and quality. Movie stimuli also evoke a richer variety of cognitive processes than traditional experiments - allowing the study of multiple aspects of brain development simultaneously. However, because these stimuli are uncontrolled, it is unclear how effectively distinct profiles of brain activity can be distinguished from the resulting data. Here we develop an approach for identifying multiple distinct subject-specific Regions of Interest (ssROIs) using fMRI data collected during movie-viewing. We focused on the test case of higher-level visual regions selective for faces, scenes, and objects. Adults (N=13) were scanned while viewing a 5.5 minute child-friendly movie, as well as a traditional experiment with isolated faces, scenes, and objects. We found that just 2.7 minutes of movie data could identify subject-specific face, scene, and object regions. While successful, the movie approach was still less effective than a traditional localizer. Having validated our approach in adults, we then used the same methods on movie data collected from 3-12-year-old children (N=122). Movie response timecourses in 3-year-old childrens face, scene, and object regions were already significantly and specifically predicted by timecourses from the corresponding regions in adults. We also found evidence of continued developmental change, particularly in the face-selective posterior superior temporal sulcus. Taken together, our results reveal both early maturity and functional change in face, scene, and object regions, and more broadly highlight the promise of short, child-friendly movies for developmental cognitive neuroscience.
General factors of white matter microstructure from DTI and NODDI in the developing brain
Authors: Vaher, K.; Galdi, P.; Blesa, M.; Sullivan, G.; Stoye, D. Q.; Quigley, A. J.; Thrippleton, M. J.; Bogaert, D.; Bastin, M. E.; Cox, S. R.; Boardman, J. P.
Category: neuroscience
Date: 2021-11-30

Preterm birth is closely associated with diffuse white matter dysmaturation inferred from diffusion MRI and neurocognitive impairment in childhood. Diffusion tensor imaging (DTI) and neurite orientation dispersion and density imaging (NODDI) are distinct dMRI modalities, yet metrics derived from these two methods share variance across tracts. This raises the hypothesis that dimensionality reduction approaches may provide efficient whole-brain estimates of white matter microstructure that capture (dys)maturational processes. To investigate the optimal model for accurate classification of generalised white matter dysmaturation in preterm infants we assessed variation in DTI and NODDI metrics across 16 major white matter tracts using principal component analysis and structural equation modelling, in 79 term and 141 preterm infants at term equivalent age. We used logistic regression models to evaluate performances of single-metric and multimodality general factor frameworks for efficient classification of preterm infants based on variation in white matter microstructure. Single-metric general factors from DTI and NODDI capture substantial shared variance (41.8-72.5%) across 16 white matter tracts, and two multimodality factors captured 93.9% of variance shared between DTI and NODDI metrics themselves. General factors associate with preterm birth and a single model that includes all seven DTI and NODDI metrics provides the most accurate prediction of microstructural variations associated with preterm birth. This suggests that despite global covariance of dMRI metrics in neonates, each metric represents information about specific (and additive) aspects of the underlying microstructure that differ in preterm compared to term subjects.

HighlightsO_LIWe measured variation of 7 DTI and NODDI metrics across 16 major tracts
C_LIO_LIGeneral factors for DTI and NODDI capture substantial shared variance across tracts
C_LIO_LIGeneral factors also capture substantial shared variance between DTI and NODDI
C_LIO_LISingle-metric and multimodality factors associate with gestational age at birth
C_LIO_LIThe best preterm prediction model contains all 7 single-metric g-factors
C_LI
Non-uniform distribution of dendritic nonlinearities differentially engages thalamostriatal and corticostriatal inputs onto cholinergic interneurons
Authors: Oz, O.; Matityahu, L.; Mizrahi-Kliger, A.; Kaplan, A.; Berkowitz, N.; Tiroshi, L.; Bergman, H.; Goldberg, J. A.
Category: neuroscience
Date: 2022-06-22

The tonic activity of striatal cholinergic interneurons (CINs) is modified differentially by their afferent inputs. Although their unitary synaptic currents are identical, in most CINs cortical inputs onto distal dendrites only weakly entrain them, whereas proximal thalamic inputs trigger abrupt pauses in discharge in response to salient external stimuli. To test whether the dendritic expression of the active conductances that drive autonomous discharge contribute to the CINs capacity to dissociate cortical from thalamic inputs, we used an optogenetics-based method to quantify dendritic excitability. We found that the persistent sodium (NaP) current gave rise to dendritic boosting, and that the hyperpolarization-activated cyclic nucleotide-gated (HCN) current gave rise to a subhertz membrane resonance. This resonance may underlie our novel finding of an association between CIN pauses and internally-generated slow wave events in sleeping non-human primates. Moreover, our method indicated that dendritic NaP and HCN currents were preferentially expressed in proximal dendrites. We validated the non-uniform distribution of NaP currents pharmacologically; with two-photon imaging of dendritic back-propagating action potentials; and by demonstrating boosting of thalamic, but not cortical, inputs by NaP currents. Thus, the localization of active dendritic conductances in CIN dendrites mirrors the spatial distribution of afferent terminals and may promote their differential responses to thalamic vs. cortical inputs.
Mutation-related apparent myelin, not axon density, drives white matter differences in premanifest Huntington's disease: Evidence from in vivo ultra-strong gradient MRI
Authors: Casella, C.; Chamberland, M.; Luque-Laguna, P.; Parker, G. D.; Rosser, A. E.; Coulthard, E.; Rickards, H.; Berry, S. C.; Jones, D. K.; Metzler-Baddeley, C.
Category: neuroscience
Date: 2021-11-30

White matter (WM) alterations have been observed early in Huntingtons disease (HD) progression but their role in the disease-pathophysiology remains unknown. We exploited ultra-strong-gradient MRI to tease apart contributions of myelin (with the magnetization transfer ratio), and axon density (with the restricted volume fraction from the Composite Hindered and Restricted Model of Diffusion) to WM differences between premanifest HD patients and age- and sex-matched controls. Diffusion tensor MRI (DT-MRI) measures were also assessed. We used tractometry to investigate region-specific changes across callosal segments with well-characterized early- and late-myelinating axonal populations, while brain-wise alterations were explored with tract-based cluster analysis (TBCA). Behavioural measures were included to explore disease-associated brain-function relationships. We detected lower myelin in the rostrum of patients (tractometry: p = 0.0343; TBCA: p = 0.030), but higher myelin in their splenium (p = 0.016). Importantly, patients myelin and mutation size were positively associated (all p-values < 0.01), indicating that increased myelination might be a direct result of the mutation. Finally, myelin was higher than controls in younger patients but lower in older patients (p = 0.003), suggesting detrimental effects of increased myelination later in the course of the disease. Higher FR in patients left cortico-spinal tract (CST) (p = 0.03) was detected, and was found to be positively associated with MTR in the posterior callosum (p = 0.033), possibly suggesting compensation to myelin alterations. This comprehensive, ultra-strong gradient MRI investigation provides novel evidence of CAG-driven myelin alterations in premanifest HD which may reflect neurodevelopmental, rather than neurodegenerative disease-associated changes.