PenguinMan/ARXIV huggingface dataset:
No substantial change in the balance between model-free and model-based control via training on the two-step task
Authors: Elmar D Grosskurth, Dominik R Bach, Marcos Economides, Quentin J M Huys, Lisa Holper
Journal: PLOS Computational Biology
Accepted: 2019-09-26T00:00:00Z


Human decisions can be habitual or goal-directed, also known as model-free (MF) or model-based (MB) control. Previous work suggests that the balance between the two decision systems is impaired in psychiatric disorders such as compulsion and addiction, via overreliance on MF control. However, little is known whether the balance can be altered through task training. Here, 20 healthy participants performed a well-established two-step task that differentiates MB from MF control, across five training sessions. We used computational modelling and functional near-infrared spectroscopy to assess changes in decision-making and brain hemodynamic over time. Mixed-effects modelling revealed overall no substantial changes in MF and MB behavior across training. Although our behavioral and brain findings show task-induced changes in learning rates, these parameters have no direct relation to either MF or MB control or the balance between the two systems, and thus do not support the assumption of training effects on MF or MB strategies. Our findings indicate that training on the two-step paradigm in its current form does not support a shift in the balance between MF and MB control. We discuss these results with respect to implications for restoring the balance between MF and MB control in psychiatric conditions.
Author summary: Psychiatric conditions such as compulsion or addiction are associated with an overreliance on habitual, or model-free, decision-making. Goal-directed, or model-based, decision-making may protect against such overreliance. We therefore asked whether model-free control could be reduced, and model-based control strengthened, via task training. We used the well-characterized two-step task that differentiates model-based from model-free actions. Our results suggest that training on the current form of the two-step task does not support a shift in the balance between model-free and model-based strategies. Factors such as devaluation, demotivation or automatization during training may play a role in the missing emergence of a training effect. Future studies could adapt the two-step task so as to separate such factors from decision-making strategies.
Loss of control as a violation of expectations: Testing the predictions of a common inconsistency compensation approach in an inclusionary cyberball game
Authors: Michael Niedeggen, Rudolf Kerschreiter, Katharina Schuck
Journal: PLOS ONE
Accepted: 2019-08-15T00:00:00Z


Personal control relies on the expectation that events are contingent upon one’s own behavior. A common ‘inconsistency compensation approach’ posits that a violation of expectancies in social interaction triggers aversive arousal and compensatory effort. Following this approach, we tested the hypothesis that interventions affecting participants' decisions violate the expected personal control. In a modified version of the established cyberball paradigm, participants were not excluded, but consistently included. However, their decisions regarding the recipient of a ball throw in the virtual game were occasionally overruled (expectancy violation). We hypothesized that this intervention will trigger a P3 response in event-related brain potentials (ERP). Since this component is related to subjective expectancies, its amplitude was assumed to depend on the frequency of interventions (independent factor: loss of control). Further, we manipulated the vertical position of the participants’ avatar on the computer screen (independent factor: verticality). Building on research showing that verticality is related to the self-assigned power and influences the expected level of control, we hypothesized that the ERP effects of intervention should be more pronounced for participants with avatars in superior position. As predicted, both experimental factors interactively affected the expression of the ERP response: In case of low intervention frequency, P3 amplitudes were significantly pronounced if the participants’ avatar was positioned above as compared to below co-players (high > low self-assigned power). The effect of verticality could be traced back to a lack of adaptation of P3 amplitudes to recurring aversive events. By demonstrating that loss of control triggers ERP effects corresponding to those triggered by social exclusion, this study provides further evidence for a common cognitive mechanism in reactions to aversive events based on an inconsistency in expectancy states.
Intervention changes acoustic peak frequency and mesolimbic neurochemistry in the Pink1-/- rat model of Parkinson disease
Authors: Sharon A Stevenson, Michelle R Ciucci, Cynthia A Kelm-Nelson
Journal: PLOS ONE
Accepted: 2019-07-22T00:00:00Z


The neural mechanisms underlying behavioral therapy for vocal acoustic deficits in patients with Parkinson disease is unknown. A primary hypothesis is that voice therapy may modulate mesolimbic brainstem regions, including the ventral tegmental area (VTA). The VTA is implicated in ultrasonic call peak frequency, involved in rewarding behaviors, and impacted by Parkinsonism. We tested the hypothesis that chronic (daily) behavioral vocal exercise of male Pink1-/- rats would alter ultrasonic vocalization acoustics and mesolimbic neurochemistry (catecholamines, GABA, mu-opioid receptor) compared to three different controls: sham-exercised Pink1-/-, unexercised Pink1-/-, and unexercised wildtype (WT) rats. A sub-hypothesis is that sham-exercise rats may exhibit changes to VTA neurochemistry as a result of a type or rewarding intervention. Results demonstrate that average bandwidth (frequency range) of ultrasonic vocalizations did not differ between WT, Pink1-/- no exercise vs. sham and vocal-exercise rats. However, average peak frequency is significantly reduced in vocal-exercised Pink1-/- rats compared to Pink1-/- no exercise, and WT groups. Unexpectedly, there were no significant acoustic differences between the vocal- and sham-exercised groups. There were no differences in catecholamine protein concentrations or tyrosine hydroxylase mRNA expression in the VTA between any of the groups. However, there was significant upregulation of all GABA-related genes in both vocal- and sham-exercised Pink1-/- rats (Gad1, Gad2, Gls, Glul); this finding was confirmed with follow up quantitative Western blotting for GAD. Additionally, there were differential results for mu-opioid receptor quantification in the VTA: vocal-exercised Pink1-/- rats showed increased mRNA expression for mu-opioid receptors whereas Western blotting indicated decreased protein levels in all Pink1-/- rats compared to WT controls suggesting the possible onset of pathology in this model. These data demonstrate modulatory effects of a rewarding behavioral paradigm on ultrasonic vocalization peak frequency. The results suggest that neuromodulators such as GABA and opioid activity, as well as the rewarding aspects of therapy may play a key role in shaping vocal treatments.
Glial response to hypoxia in mutants of NPAS1/3 homolog Trachealess through Wg signaling to modulate synaptic bouton organization
Authors: Pei-Yi Chen, Yi-Wei Tsai, Ying-Ju Cheng, Angela Giangrande, Cheng-Ting Chien
Journal: PLOS Genetics
Accepted: 2019-07-15T00:00:00Z


Synaptic structure and activity are sensitive to environmental alterations. Modulation of synaptic morphology and function is often induced by signals from glia. However, the process by which glia mediate synaptic responses to environmental perturbations such as hypoxia remains unknown. Here, we report that, in the mutant for Trachealess (Trh), the Drosophila homolog for NPAS1 and NPAS3, smaller synaptic boutons form clusters named satellite boutons appear at larval neuromuscular junctions (NMJs), which is induced by the reduction of internal oxygen levels due to defective tracheal branches. Thus, the satellite bouton phenotype in the trh mutant is suppressed by hyperoxia, and recapitulated in wild-type larvae raised under hypoxia. We further show that hypoxia-inducible factor (HIF)-1α/Similar (Sima) is critical in mediating hypoxia-induced satellite bouton formation. Sima upregulates the level of the Wnt/Wingless (Wg) signal in glia, leading to reorganized microtubule structures within presynaptic sites. Finally, hypoxia-induced satellite boutons maintain normal synaptic transmission at the NMJs, which is crucial for coordinated larval locomotion.
Author summary: Oxygen is essential for animals to maintain their life such as growth, metabolism, responsiveness, and movement. It is therefore important to understand how animal cells trigger hypoxia response and adapt to hypoxia thereafter. Both mammalian vascular and insect tracheal branches are induced to enhance the oxygen delivery. However, the study of hypoxia response in the nervous system remains limited. In this study, we assess the morphology of Drosophila neuromuscular junctions (NMJs), a model system to study development and function of synapses, in two hypoxia conditions, one with raising wild-type larvae in hypoxia, and the other in the trachealess (trh) mutant in which the trachea is defective, causing insufficient oxygen supply. Interestingly, the glial processes, normally wrapping around the axons, invade into synaptic boutons of NMJs under hypoxia. Also, the hypoxia-induced factor Sima activates the Wg signal in glia and the secreted Wg signal reorganizes the synaptic boutons as a response to hypoxia. This synaptic bouton reorganization might maintain normal synaptic transmission and locomotion of larvae.
Loss of Bardet-Biedl syndrome proteins causes synaptic aberrations in principal neurons
Authors: Naila Haq, Christoph Schmidt-Hieber, Fernando J Sialana, Lorenza Ciani, Janosch P Heller, Michelle Stewart, Liz Bentley, Sara Wells, Richard J Rodenburg, Patrick M Nolan, Elizabeth Forsythe, Michael C Wu, Gert Lubec, P Salinas, Michael Häusser, Philip L Beales, Sofia Christou-Savina
Journal: PLOS Biology
Accepted: 2019-08-19T00:00:00Z


Bardet-Biedl syndrome (BBS), a ciliopathy, is a rare genetic condition characterised by retinal degeneration, obesity, kidney failure, and cognitive impairment. In spite of progress made in our general understanding of BBS aetiology, the molecular and cellular mechanisms underlying cognitive impairment in BBS remain elusive. Here, we report that the loss of BBS proteins causes synaptic dysfunction in principal neurons, providing a possible explanation for the cognitive impairment phenotype observed in BBS patients. Using synaptosomal proteomics and immunocytochemistry, we demonstrate the presence of Bbs proteins in the postsynaptic density (PSD) of hippocampal neurons. Loss of Bbs results in a significant reduction of dendritic spines in principal neurons of Bbs mouse models. Furthermore, we show that spine deficiency correlates with events that destabilise spine architecture, such as impaired spine membrane receptor signalling, known to be involved in the maintenance of dendritic spines. Our findings suggest a role for BBS proteins in dendritic spine homeostasis that may be linked to the cognitive phenotype observed in BBS.

In Bardet-Biedl syndrome (BBS), mutations that affect the function of primary cilia cause retinal degeneration, obesity, kidney failure, and cognitive impairment. The cognitive impairment has yet to be explained, but this study shows that loss of BBS proteins causes synaptic aberrations in principal neurons and can be partially rescued by aerobic exercise.
Quantum dots reveal heterogeneous membrane diffusivity and dynamic surface density polarization of dopamine transporter
Authors: Oleg Kovtun, Ian D Tomlinson, Riley S Ferguson, Sandra J Rosenthal
Journal: PLOS ONE
Accepted: 2019-11-01T00:00:00Z


The presynaptic dopamine transporter mediates rapid reuptake of synaptic dopamine. Although cell surface DAT trafficking recently emerged as an important component of DAT regulation, it has not been systematically investigated. Here, we apply our single quantum dot (Qdot) tracking approach to monitor DAT plasma membrane dynamics in several heterologous expression cell hosts with nanometer localization accuracy. We demonstrate that Qdot-tagged DAT proteins exhibited highly heterogeneous membrane diffusivity dependent on the local membrane topography. We also show that Qdot-tagged DATs were localized away from the flat membrane regions and were dynamically retained in the membrane protrusions and cell edges for the duration of imaging. Single quantum dot tracking of wildtype DAT and its conformation-defective coding variants (R60A and W63A) revealed a significantly accelerated rate of dysfunctional DAT membrane diffusion. We believe our results warrant an in-depth investigation as to whether compromised membrane dynamics is a common feature of brain disorder-derived DAT mutants.
An investigation of far and near transfer in a gamified visual learning paradigm
Authors: Stefanie Duyck, Hans Op de Beeck
Journal: PLOS ONE
Accepted: 2019-12-09T00:00:00Z


After training, visual perceptual learning improvements are mostly constrained to the trained stimulus feature and retinal location. The aim of this study is to construct an integrated paradigm where the visual learning happens in a more natural context and in parallel for multiple stimulus types, and to test the generalization of learning-related improvements towards untrained features, locations, and more general cognitive domains. Half the subjects were trained with a gamified perceptual learning paradigm for ten hours, which consisted of an orientation discrimination task and a novel object categorization task embedded in a three-dimensional maze. A second group of subjects, an active control group, played ten hours of Candy Crush Saga. Before and after training, all subjects completed a ‘near transfer’ orientation discrimination and novel object categorization task, as well as a set of ‘far transfer’ general cognitive and attentional tasks. During the perceptual learning tasks, two different stimulus features and two retinal location pairs were assessed in each task. For the experimental group, one stimulus feature and retinal location pair was trained, whilst the other one remained untrained. Both features and location pairs were untrained in the control group. Far transfer did occur in some domains across all subjects irrespective of the training regimen (i.e. executive functioning, mental rotation performance, and multitask performance and speed). Near transfer was present in both groups, however only more pronounced for one particular task in the experimental group, namely novel object categorization. To conclude, all but one near transfer task did not generalize more than the control group.
Probing neural networks for dynamic switches of communication pathways
Authors: Holger Finger, Richard Gast, Christian Gerloff, Andreas K Engel, Peter König
Journal: PLOS Computational Biology
Accepted: 2019-11-18T00:00:00Z


Dynamic communication and routing play important roles in the human brain in order to facilitate flexibility in task solving and thought processes. Here, we present a network perturbation methodology that allows investigating dynamic switching between different network pathways based on phase offsets between two external oscillatory drivers. We apply this method in a computational model of the human connectome with delay-coupled neural masses. To analyze dynamic switching of pathways, we define four new metrics that measure dynamic network response properties for pairs of stimulated nodes. Evaluating these metrics for all network pathways, we found a broad spectrum of pathways with distinct dynamic properties and switching behaviors. We show that network pathways can have characteristic timescales and thus specific preferences for the phase lag between the regions they connect. Specifically, we identified pairs of network nodes whose connecting paths can either be (1) insensitive to the phase relationship between the node pair, (2) turned on and off via changes in the phase relationship between the node pair, or (3) switched between via changes in the phase relationship between the node pair. Regarding the latter, we found that 33% of node pairs can switch their communication from one pathway to another depending on their phase offsets. This reveals a potential mechanistic role that phase offsets and coupling delays might play for the dynamic information routing via communication pathways in the brain.
Author summary: A big challenge in elucidating information processing in the brain is to understand the neural mechanisms that dynamically organize the communication between different brain regions in a flexible and task-dependent manner. In this theoretical study, we present an approach to investigate the routing and gating of information flow along different pathways from one region to another. We show that stimulation of the brain at two sites with different frequencies and oscillatory phases can reveal the underlying effective connectivity. This yields new insights into the underlying processes that govern dynamic switches in the communication pathways between remote sites of the brain.
Response nonlinearities in networks of spiking neurons
Authors: Alessandro Sanzeni, Mark H Histed, Nicolas Brunel
Journal: PLOS Computational Biology
Accepted: 2020-07-19T00:00:00Z


Combining information from multiple sources is a fundamental operation performed by networks of neurons in the brain, whose general principles are still largely unknown. Experimental evidence suggests that combination of inputs in cortex relies on nonlinear summation. Such nonlinearities are thought to be fundamental to perform complex computations. However, these non-linearities are inconsistent with the balanced-state model, one of the most popular models of cortical dynamics, which predicts networks have a linear response. This linearity is obtained in the limit of very large recurrent coupling strength. We investigate the stationary response of networks of spiking neurons as a function of coupling strength. We show that, while a linear transfer function emerges at strong coupling, nonlinearities are prominent at finite coupling, both at response onset and close to saturation. We derive a general framework to classify nonlinear responses in these networks and discuss which of them can be captured by rate models. This framework could help to understand the diversity of non-linearities observed in cortical networks.
Author summary: Models of cortical networks are often studied in the strong coupling limit, where the so-called balanced state emerges. Across a wide range of parameters, balanced state models explain a number of ubiquitous properties of cortex, such as irregular neural firing. However, in the strong coupling limit, balanced state models show an unrealistic linear network transfer function. We examined, in networks of spiking neurons, how nonlinearities arise as network coupling strength is reduced to realistic levels. We examine closed-form solutions that arise from mean-field analysis, and confirm results with numerical simulations, to show that nonlinearities at response onset and saturation emerge as coupling strength is reduced. Critically, for realistic parameter values, both types of nonlinearities are observed at experimentally-observed firing rates. Thus, cortical network models with moderate coupling strength can account for experimentally observed cortical response nonlinearities.
Lag-invariant detection of interactions in spatially-extended systems using linear inverse modeling
Authors: Rikkert Hindriks
Journal: PLOS ONE
Accepted: 2020-11-07T00:00:00Z


Measurements on physical systems result from the systems’ activity being converted into sensor measurements by a forward model. In a number of cases, inversion of the forward model is extremely sensitive to perturbations such as sensor noise or numerical errors in the forward model. Regularization is then required, which introduces bias in the reconstruction of the systems’ activity. One domain in which this is particularly problematic is the reconstruction of interactions in spatially-extended complex systems such as the human brain. Brain interactions can be reconstructed from non-invasive measurements such as electroencephalography (EEG) or magnetoencephalography (MEG), whose forward models are linear and instantaneous, but have large null-spaces and high condition numbers. This leads to incomplete unmixing of the forward models and hence to spurious interactions. This motivated the development of interaction measures that are exclusively sensitive to lagged, i.e. delayed interactions. The drawback of such measures is that they only detect interactions that have sufficiently large lags and this introduces bias in reconstructed brain networks. We introduce three estimators for linear interactions in spatially-extended systems that are uniformly sensitive to all lags. We derive some basic properties of and relationships between the estimators and evaluate their performance using numerical simulations from a simple benchmark model.
Brain-inspired model for early vocal learning and correspondence matching using free-energy optimization
Authors: Alexandre Pitti, Mathias Quoy, Sofiane Boucenna, Catherine Lavandier
Journal: PLOS Computational Biology
Accepted: 2020-11-27T00:00:00Z


We propose a developmental model inspired by the cortico-basal system (CX-BG) for vocal learning in babies and for solving the correspondence mismatch problem they face when they hear unfamiliar voices, with different tones and pitches. This model is based on the neural architecture INFERNO standing for Iterative Free-Energy Optimization of Recurrent Neural Networks. Free-energy minimization is used for rapidly exploring, selecting and learning the optimal choices of actions to perform (eg sound production) in order to reproduce and control as accurately as possible the spike trains representing desired perceptions (eg sound categories). We detail in this paper the CX-BG system responsible for linking causally the sound and motor primitives at the order of a few milliseconds. Two experiments performed with a small and a large audio database show the capabilities of exploration, generalization and robustness to noise of our neural architecture in retrieving audio primitives during vocal learning and during acoustic matching with unheared voices (different genders and tones).
Author summary: We designed a developmental architecture inspired by the cortico-basal system for early vocal learning. Our neural system explores, evaluates and strengthens the motor primitives that match the best the sound repertoire created also dynamically. After a babbling process in which the network tests and aligns pronounced sound and motor vocal tracks, it is used for listening to novel voices, solving the correspondence problem.