PenguinMan/ARXIV huggingface dataset:
Modeling Sensory-Motor Decisions in Natural Behavior
Authors: Zhang, R.; Zhang, S.; Tong, M. H.; Cui, Y.; Rothkopf, C. A.; Ballard, D. H.; Hayhoe, M. M.
Category: neuroscience
Date: 2018-09-16

Although a standard reinforcement learning model can capture many aspects of reward-seeking behaviors, it may not be practical for modeling human natural behaviors because of the richness of dynamic environments and limitations in cognitive resources. We propose a modular reinforcement learning model that addresses these factors. Based on this model, a modular inverse reinforcement learning algorithm is developed to estimate both the rewards and discount factors from human behavioral data, which allows predictions of human navigation behaviors in virtual reality with high accuracy across different subjects and with different tasks. Complex human navigation trajectories in novel environments can be reproduced by an artificial agent that is based on the modular model. This model provides a strategy for estimating the subjective value of actions and how they influence sensory-motor decisions in natural behavior.\n\nAuthor summaryIt is generally agreed that human actions can be formalized within the framework of statistical decision theory, which specifies a cost function for actions choices, and that the intrinsic value of actions is controlled by the brains dopaminergic reward machinery. Given behavioral data, the underlying subjective reward value for an action can be estimated through a machine learning technique called inverse reinforcement learning. Hence it is an attractive method for studying human reward-seeking behaviors. Standard reinforcement learning methods were developed for artificial intelligence agents, and incur too much computation to be a viable model for real-time human decision making. We propose an approach called modular reinforcement learning that decomposes a complex task into independent decision modules. This model includes a frequently overlooked variable called the discount factor, which controls the degree of impulsiveness in seeking future reward. We develop an algorithm called modular inverse reinforcement learning that estimates both the reward and the discount factor. We show that modular reinforcement learning may be a useful model for natural navigation behaviors. The estimated rewards and discount factors explain human walking direction decisions in a virtual-reality environment, and can be used to train an artificial agent that can accurately reproduce human navigation trajectories.
Developmental maturation of the precuneus as a functional core of the default-mode network
Authors: Li, R.; Utevsky, A.; Huettel, S.; Braams, B.; Peters, S.; Crone, E.; van Duijvenvoorde, A. C. K.
Category: neuroscience
Date: 2018-09-17

Efforts to map the functional architecture of the developing human brain have shown that connectivity between and within functional neural networks changes from childhood to adulthood. While prior work has established that the adult precuneus distinctively modifies its connectivity during task versus rest states (Utevsky, Smith, & Huettel, 2014), it remains unknown how these connectivity patterns emerge over development. Here, we use functional magnetic resonance imaging (fMRI) data collected at two longitudinal timepoints from over 250 participants between the ages of 8 and 26 engaging in two cognitive tasks and a resting-state scan. By applying independent component analysis (ICA) to both task and rest data, we identified three canonical networks of interest - the rest-based default mode network (DMN) and the task-based left and right frontoparietal networks (LFPN, RFPN) - which we explored for developmental changes using dual-regression analyses. We found systematic state-dependent functional connectivity in the precuneus, such that engaging in a task (compared to rest) resulted in greater precuneus-LFPN and precuneus-RFPN connectivity, whereas being at rest (compared to task) resulted in greater precuneus-DMN connectivity. These cross-sectional results replicated across both tasks and at both developmental timepoints. Finally, we used longitudinal mixed models to show that the degree to which precuneus distinguishes between task and rest states increases with age, due to age-related increasing segregation between precuneus and LFPN at rest. Our results highlight the distinct role of the precuneus in tracking processing state, in a manner that is both present throughout and strengthened across development.
Reward-driven changes in striatal pathway competition shape evidence evaluation in decision-making
Authors: Dunovan, K.; Vich, C.; Clapp, M.; Verstynen, T.; Rubin, J.
Category: neuroscience
Date: 2018-10-07

Cortico-basal-ganglia-thalamic (CBGT) networks are critical for adaptive decision-making, yet how changes to circuit-level properties impact cognitive algorithms remains unclear. Here we explore how dopaminergic plasticity at corticostriatal synapses alters competition between striatal pathways, impacting the evidence accumulation process during decision-making. Spike-timing dependent plasticity simulations showed that dopaminergic feedback based on rewards modified the ratio of direct and indirect corticostriatal weights within opposing action channels. Using the learned weight ratios in a full spiking CBGT network model, we simulated neural dynamics and decision outcomes in a reward-driven decision task and fit them with a drift diffusion model. Fits revealed that the rate of evidence accumulation varied with inter-channel differences in direct pathway activity while boundary height varied with overall indirect pathway activity. This multi-level modeling approach demonstrates how complementary learning and decision computations can emerge from corticostriatal plasticity.

Author summaryCognitive process models such as reinforcement learning (RL) and the drift diffusion model (DDM) have helped to elucidate the basic algorithms underlying error-corrective learning and the evaluation of accumulating decision evidence leading up to a choice. While these relatively abstract models help to guide experimental and theoretical probes into associated phenomena, they remain uninformative about the actual physical mechanics by which learning and decision algorithms are carried out in a neurobiological substrate during adaptive choice behavior. Here we present an "upwards mapping" approach to bridging neural and cognitive models of value-based decision-making, showing how dopaminergic feedback alters the network-level dynamics of cortico-basal-ganglia-thalamic (CBGT) pathways during learning to bias behavioral choice towards more rewarding actions. By mapping "up" the levels of analysis, this approach yields specific predictions about aspects of neuronal activity that map to the quantities appearing in the cognitive decision-making framework.
Bayesian Inference of Other Minds Explains Human Choices in Group Decision Making
Authors: Khalvati, K.; Park, S. A.; Mirbagheri, S.; Philippe, R.; Sestito, M.; Dreher, J.-C.; Rao, R. P. N.
Category: neuroscience
Date: 2018-10-23

To make decisions in a social context, humans have to predict the behavior of others, an ability that is thought to rely on having a model of other minds known as theory of mind. Such a model becomes especially complex when the number of people one simultaneously interacts is large and the actions are anonymous. Here, we show that in order to make decisions within a large group, humans employ Bayesian inference to model the \"mind of the group,\" making predictions of others decisions while also considering the effects of their own actions on the group as a whole. We present results from a group decision making task known as the Volunteers Dilemma and demonstrate that a Bayesian model based on partially observable Markov decision processes outperforms existing models in quantitatively explaining human behavior. Our results suggest that in group decision making, rather than acting based solely on the rewards received thus far, humans maintain a model of the group and simulate the groups dynamics into the future in order to choose an action as a member of the group.
Inverse occlusion, a binocularly motivated treatment for amblyopia
Authors: Zhou, J.; Wu, Y.; Chen, Y.; Chen, X.; Liang, Y.; Mao, Y.; Yao, Z.; He, Z.; Lu, F.; Qu, J.; Hess, R.
Category: neuroscience
Date: 2018-09-18

Recent laboratory finding suggest that short-term patching the amblyopic eye (i.e., inverse occlusion) results in a larger and more sustained improvement in the binocular balance compared with normal controls. In this study, we investigate the cumulative effects of the short-term inverse occlusion in adults and old children with amblyopia. A prospective cohort study of 18 amblyopes (10-35 years old; 3 with strabismus) who have been subjected to 2 hours/day of inverse occlusion for 2 months. Patients who required refractive correction or whose refractive correction needed updating were given a 2-month period of refractive adaptation. The primary outcome measure was the binocular balance which was measured using a phase combination task, the secondary outcome measures were the best corrected visual acuity which was measured with a Tumbling E acuity chart and convert to logMAR units and the stereo acuity which was measured with the Random-dot preschool stereotest. The averaged binocular gain was 0.11 in terms of the effective contrast ratio (z = -2.344, p = 0.019, 2-tailed Related samples Wilcoxon Signed Ranks Test). The average acuity gain was 0.14 logMAR equivalent (t(17) = 0.13, p < 0.001, 2-tailed paired samples t-test). The averaged stereo acuity gain was 253 arc seconds (z = -2.689, p = 0.007). Based on more recent research concerning adult ocular dominance plasticity, contrary to current practice, patching the amblyopic eye makes more sense; comparable acuity benefits, better compliance, better binocular outcome and applicable to adults as well as old children.
Can pharmacological enhancement of the placebo effect be a novel therapy for working memory impairments?
Authors: Zhao, W.; Becker, B.; Yao, S.; Ma, X.; Kou, J.; Kendrick, K.
Category: neuroscience
Date: 2018-09-17

Working memory is considered as a core aspect of cognitive function and its impairment in a wide range of mental disorders has resulted in it being considered as an important transdiagnostic feature. To date pharmacological and behavioural strategies for augmenting working memory have achieved only moderate success. Here we have taken a different approach by combining expectancy effects with intranasal oxytocin as an adjunct given previous evidence that it may enhance placebo effects. In a randomised controlled clinical trial we demonstrate that while working memory performance is not influenced by expectancy per se when it is given in conjunction with oxytocin performance in terms of accuracy can be significantly enhanced following positive expectancy induction (placebo effect) and impaired following negative expectancy induction (nocebo effect). Thus combining expectancy effects with intranasal oxytocin may represent a radical new approach for improving working memory function in mental disorders.
Who gets lost and why: A representative cross-sectional survey on sociodemographic and vestibular determinants of wayfinding strategies
Authors: Ulrich, S.; Grill, E.; Flanagin, V. L.
Category: neuroscience
Date: 2018-09-17

When we think of our family and friends, we probably know someone who is good at finding their way and someone else that easily get lost. We still know little about the biological and environmental factors that influence our navigational ability. Here, we investigated the frequency and sociodemographic determinants of wayfinding and their association with vestibular function in a representative cross-sectional sample (N = 783) of the adult German-speaking population. Wayfinding was assessed using the Wayfinding Strategy Scale, a self-report scale that produces two scores for each participant representing to what degree they rely on route-based or orientation (map-based) strategies. We were interested in the following research questions: (1) the frequency and determinants of wayfinding strategies in a population-based representative sample, (2) the relationship between vestibular function and strategy choice and (3) how sociodemographic factors influence general wayfinding ability as measured using a combined score from both strategy scores. Our linear regression models showed that being male, having a higher education, higher age and lower regional urbanization increased orientation strategy scores. Vertigo/dizziness reduced the scores of both the orientation and the route strategies. Using a novel approach, we grouped participants by their combined strategy scores in a multinomial regression model, to see whether individuals prefer one strategy over the other. The majority of individuals reported using either both or no strategy, instead of preferring one strategy over the other. Young age and reduced vestibular function were indicative of using no strategy. In summary, wayfinding ability depends on both biological and environmental factors; all sociodemographic factors except income. Over a third of the population, predominantly under the age of 35, does not successfully use either strategy. This represents a change in our wayfinding skills, which may result from the technological advances in navigational aids over the last few decades.
A human embryonic stem cell model of Aβ-dependent chronic progressive neurodegeneration
Authors: Ubina, T.; Magallanes, M.; Srivastava, S.; Warden, C.; Yee, J.-K.; Salvaterra, P. M.
Category: neuroscience
Date: 2018-09-17

We describe construction and phenotypic analysis of a human embryonic stem cell model of progressive A{beta}-dependent neurodegeneration (ND) with potential relevance to Alzheimers disease (AD). We modified one allele of the normal APP locus to directly express a secretory form of A{beta}40 or A{beta}42, eliminating the need for amyloidogenic APP proteolysis. Following neuronal differentiation edited cell lines specifically accumulate aggregated/oligomeric A{beta}, exhibit a synaptic deficit and have an abnormal accumulation of endolysosomal vesicles. Edited cultures progress to a stage of overt ND. All phenotypes appear at earlier culture times for A{beta}42 relative to A{beta}40. Whole transcriptome RNA-Seq analysis identified 23 up and 70 down regulated genes (DEGs) with similar directional fold change but larger absolute values in the A{beta}42 samples suggesting common underlying pathogenic mechanisms. Pathway/annotation analysis suggested that down regulation of extracellular matrix and cilia functions are significantly overrepresented. This cellular model could be useful for uncovering mechanisms directly linking A{beta} to neuronal death and as a tool to screen for new therapeutic agents that slow or prevent human ND.
Age-differences in functional asymmetry during memory retrieval revisited: no evidence for contralateral over-activation or compensation
Authors: Roe, J. M.; Vidal-Pineiro, D.; Sneve, M. H.; Kompus, K.; Greve, D.; Walhovd, K. B.; Fjell, A. M.; Westerhausen, R.
Category: neuroscience
Date: 2018-09-17

Brain asymmetry is inherent to cognitive processing and seems to reflect processing efficiency. Lower frontal asymmetry is often observed in older adults during memory retrieval, yet it is unclear whether lower asymmetry implies an age-related increase in contralateral recruitment, whether less asymmetry reflects compensation, is limited to frontal regions, or predicts neurocognitive stability or decline. We assessed age-differences in asymmetry across the entire cerebral cortex, using fMRI data from 89 young and 76 older adults during successful retrieval, and surface-based methods that allowed direct homotopic comparison of activity between hemispheres. An extensive left-asymmetric network facilitated retrieval in both young and older adults, whereas diverse frontal and parietal regions exhibited lower asymmetry in older adults. However, lower asymmetry was not associated with age-related increases in contralateral recruitment, but primarily reflected either less deactivation in contralateral regions reliably signalling retrieval failure in the young, or lower recruitment of the dominant hemisphere--suggesting that functional deficits may drive lower asymmetry in older brains, not compensatory activity. Lower asymmetry neither predicted current memory performance, nor the extent of memory change across the preceding [~]8 years in older adults. Together, these findings are inconsistent with a compensation account for lower asymmetry during retrieval and aging.
Parcellation of motor sequence representations in the human neocortex
Authors: Yokoi, A.; Diedrichsen, J.
Category: neuroscience
Date: 2018-09-17

While previous studies have revealed an extended network of cortical regions associated with motor sequence production, the specific role of each of these areas is still elusive. To address this issue, we designed a novel behavioural paradigm that allowed us to experimentally manipulate the structure of motor sequences representations in individual participants. We then conducted fMRI while participants executed 8 trained sequences to examine how this structure is reflected in the associated activity patterns. Both model-based and model-free approaches revealed a clear distinction between primary and non-primary motor cortices in their representational contents, with M1 specifically representing individual finger movements, and premotor and parietal cortices showing a mixture of chunk, sequence and finger transition representations. Using model-free representational parcellation, we could divide these non-primary motor cortices into separate clusters, each with a unique representation along the stimulus-to-action gradient. These results provide new insights into how human neocortex organizes movement sequences.
Oxytocin amplifies sex differences in human mate choice
Authors: Xu, L.; Becker, B.; Luo, R.; Zheng, X.; Zhao, W.; Zhang, Q.; Kendrick, K.
Category: neuroscience
Date: 2018-09-17

Infidelity is the major cause of breakups and individuals with a history of infidelity are more likely to repeat it, but may also present a greater opportunity for short-term sexual relationships. Here in a pre-registered, double-blind study involving 160 subjects we report that while both sexes valued faithful individuals most for long-term relationships, both single men and those in a relationship were more interested in having short-term relationships with previously unfaithful individuals than women. Oxytocin administration resulted in men rating the faces of unfaithful women as more attractive but in women rating those of unfaithful men as less attractive and also finding them less memorable. Oxytocin also increased mens interest in having short-term relationships with previously unfaithful women whereas it increased womens interest in having long-term relationships with faithful men. Thus, oxytocin release during courtship may first act to amplify sex-dependent priorities in attraction and mate choice before subsequently promoting romantic bonds.
Deciphering defective subventricular adult neurogenesis in cyclin D2-deficient mice
Authors: Płatek, R.; Kaczmarek, L.; Czupryn, A.
Category: neuroscience
Date: 2018-09-17

Adult neurogenesis occurring in the brain of adult mammals is considered to have potential therapeutical applications. New neurons are produced constitutively from postnatal neural stem cells/precursors residing in two neurogenic regions: the subventricular zone (SVZ) of the lateral ventricles and the subgranular layer in the dentate gyrus of the hippocampus. Newly-generated neuroblasts from the SVZ migrate long distance towards the olfactory bulb and repopulate different subtypes of inhibitory interneurons modulating the olfactory processing. It was reported that cyclin D2 knockout mice (cD2-KO) present reduced generation of new hippocampal neurons, however proliferation deficiency and mechanisms responsible for dysregulation of subventricular precursors, derived progenitors, and olfactory interneurons need to be detaily investigated. In this report, proliferative activity of different subpopulations of SVZ neural precursors, cell migration, and differentiation in cD2-KO mice was characterized. For that goal, EdU, a thymidine analogue, proliferation mapping combined with multi-epitope immunohisto-chemical detection of endogenous stage-specific cell markers was carried out. Severely reduced number of newly-generated cells in the subventricular niche was demonstrated that was not accompanied by increased level of apoptotic death. Surprisingly, the number of B1 quiescent precursor subpopulation was not affected, whereas the number of B1 type active primary precursors, intermediate/transiently-amplifying progenitors (C type cells), and neuroblasts (A type cells) were reduced. The analyses suggest that cycline D2 might be critical for transition of B1 precursor quiescent cells into B1 active cells. We also demonstrate that the subpopulation of calbindin interneurons is reduced in the olfactory bulb. Deciphering processes underlying a potential modulation of intensity of adult neurogenesis at the cellular levels could lead to replacement therapies after injury, stroke, or neurodegenerative disease in the central nervous system.
Early postnatal development of the cellular and circuit properties of striatal D1 and D2 spiny projection neurons
Authors: Krajeski, R. N.; Macey-Dare, A.; van Heusden, F.; Ebrahimjee, F.; Ellender, T. J.
Category: neuroscience
Date: 2018-09-17

A dysfunctional striatum is thought to contribute to neurodevelopmental disorders such as ADHD, Tourettes syndrome and OCD. Insight into these disorders is reliant on an understanding of the normal development of the striatal cellular and circuit properties. Here we combined whole-cell patch-clamp electrophysiology and anatomical reconstructions of D1 and D2 striatal projection neurons (SPNs) in brain slices to characterize the development of the electrophysiological and morphological properties as well as their long-range and local inputs during the first three postnatal weeks. Overall, we find that many properties develop in parallel but we make several key observations. Firstly, that the electrophysiological properties of young D1 SPNs are more mature and that distinctions between D1 and D2 SPNs become apparent in the second postnatal week. Secondly, that dendrites and spines as well as excitatory inputs from cortex develop in parallel with cortical inputs exhibiting a prolonged period of maturation involving changes in postsynaptic glutamate receptors. Lastly, that initial local connections between striatal SPNs consist of gap junctions, which are gradually replaced by inhibitory synaptic connections. Interestingly, relative biases in inhibitory synaptic connectivity seen between SPNs in adulthood, such as a high connectivity between D2 SPNs, are already evident in the second postnatal week. Combined, these results provide an experimental framework for future investigations of striatal neurodevelopmental disorders and show that many of the cellular and circuit properties are established in the first and second postnatal weeks suggesting intrinsic programs guide their development.\n\nSignificance StatementNormal brain development involves the formation of neurons, which develop correct electrical and morphological properties and are precisely connected with each other in a neural circuit. In neurodevelopmental disorders these processes go awry leading to behavioral and cognitive problems later in life. Here we provide for the first time a detailed quantitative description of the cellular and circuit properties of the two main neuron types of the striatum during the first postnatal weeks. This can form an experimental framework for future studies into neurodevelopmental disorders. We find that most of the properties for both types of striatal neuron develop in parallel and are already established by the second postnatal week suggesting a key role for intrinsic programs in guiding their development.