PenguinMan/ARXIV huggingface dataset:
Modeling Changes in Probabilistic Reinforcement Learning during Adolescence
Authors: Xia, L.; Master, S. L.; Eckstein, M. K.; Baribault, B.; Dahl, R. E.; Wilbrecht, L.; Collins, A. G. E.
Category: neuroscience
Date: 2020-12-02

In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggests probabilistic learning may be inefficient in youth compared to adults [1], while others suggest it may be more efficient in youth that are in mid adolescence [2, 3]. Here we used a probabilistic reinforcement learning task to test how youth age 8-17 (N = 187) and adults age 18-30 (N = 110) learn about stable probabilistic contingencies. Performance increased with age through early-twenties, then stabilized. Using hierarchical Bayesian methods to fit computational reinforcement learning models, we show that all participants performance was better explained by models in which negative outcomes had minimal to no impact on learning. The performance increase over age was driven by 1) an increase in learning rate (i.e. decrease in integration time horizon); 2) a decrease in noisy/exploratory choices. In mid-adolescence age 13-15, salivary testosterone and learning rate were positively related. We discuss our findings in the context of other studies and hypotheses about adolescent brain development.

Author summaryAdolescence is a time of great uncertainty. It is also a critical time for brain development, learning, and decision making in social and educational domains. There are currently contradictory findings about learning in adolescence. We sought to better isolate how learning from stable probabilistic contingencies changes during adolescence with a task that previously showed interesting results in adolescents. We collected a relatively large sample size (297 participants) across a wide age range (8-30), to trace the adolescent developmental trajectory of learning under stable but uncertain conditions. We found that age in our sample was positively associated with higher learning rates and lower choice exploration. Within narrow age bins, we found that higher saliva testosterone levels were associated with higher learning rates in participants age 13-15 years. These findings can help us better isolate the trajectory of maturation of core learning and decision making processes during adolescence.
Perturbations both trigger and delay seizures due to generic properties of slow-fast relaxation oscillators
Authors: Perez-Cervera, A.; Hlinka, J.
Category: neuroscience
Date: 2020-12-02

The mechanism underlying the emergence of seizures is one of the most important unresolved issues in epilepsy research. In this paper, we study how perturbations, exogenous of endogenous, may promote or delay seizure emergence. To this aim, due to the increasingly adopted view of epileptic dynamics in terms of slow-fast systems, we perform a theoretical analysis of the phase response of a generic relaxation oscillator. As relaxation oscillators are effectively bistable systems at the fast time scale, it is intuitive that perturbations of the non-seizing state with a suitable direction and amplitude may cause an immediate transition to seizure. By contrast, and perhaps less intuitively, smaller amplitude perturbations have been found to delay the spontaneous seizure initiation. By studying the isochrons of relaxation oscillators, we show that this is a generic phenomenon, with the size of such delay depending on the slow flow component. Therefore, depending on perturbation amplitudes, frequency and timing, a train of perturbations causes an occurrence increase, decrease or complete suppression of seizures. This dependence lends itself to analysis and mechanistic understanding through methods outlined in this paper. We illustrate this methodology by computing the isochrons, phase response curves and the response to perturbations in several epileptic models possessing different slow vector fields. While our theoretical results are applicable to any planar relaxation oscillator, in the motivating context of epilepsy they elucidate mechanisms of triggering and abating seizures, thus suggesting stimulation strategies with effects ranging from mere delaying to full suppression of seizures.

Author summaryDespite its simplicity, the modelling of epileptic dynamics as a slow-fast transition between low and high activity states mediated by some slow feedback variable is a relatively novel albeit fruitful approach. This study is the first, to our knowledge, characterizing the response of such slow-fast models of epileptic brain to perturbations by computing its isochrons. Besides its numerical computation, we theoretically determine which factors shape the geometry of isochrons for planar slow-fast oscillators. As a consequence, we introduce a theoretical approach providing a clear understanding of the response of perturbations of slow-fast oscillators. Within the epilepsy context, this elucidates the origin of the contradictory role of interictal epileptiform discharges in the transition to seizure, manifested by both pro-convulsive and anti-convulsive effect depending on the amplitude, frequency and timing. More generally, this paper provides theoretical framework highlighting the role of the of the slow flow component on the response to perturbations in relaxation oscillators, pointing to the general phenomena in such slow-fast oscillators ubiquitous in biological systems.
Spoken language comprehension activates the primary visual cortex
Authors: Seydell-Greenwald, A.; Wang, X.; Newport, E.; Bi, Y.; Striem-Amit, E.
Category: neuroscience
Date: 2021-05-24

Primary visual cortex (V1) is generally thought of as a low-level sensory area that primarily processes basic visual features. However, in congenitally blind individuals, V1 is involved in language processing, with no evidence of major changes in anatomical connectivity that could explain this seemingly drastic functional change. This is at odds with current accounts of neural plasticity, which emphasize the role of connectivity and conserved function in determining a neural tissues role even after atypical early experiences. To reconcile what appears to be unprecedented functional reorganization with known accounts of plasticity limitations, we tested whether V1 also responds to spoken language in sighted individuals. Using fMRI, we found that V1 in normally sighted individuals was indeed activated by comprehensible speech as compared to a reversed speech control condition, in a left-lateralized and focal manner. Activation in V1 for language was also significant and comparable for abstract and concrete words, suggesting it was not driven by visual imagery. Last, this activation did not stem from increased attention to the auditory onset of words, excluding general attention accounts. Together these findings suggest that V1 responds to verbal information even in sighted individuals, potentially to predict visual input. This capability might be the basis for the strong V1 language activation observed in people born blind, re-affirming the notion that plasticity is guided by pre-existing connectivity and abilities in the typically developed brain.

Significance statementHow flexible is the human brain? Studies of congenitally blind individuals showed that language activates the primary visual cortex. This has been interpreted as evidence for unprecedented functional plasticity from a low-level visual to a language area. To reconcile these findings with known limitations of plasticity based on intrinsic physiology and connectivity, we tested if similar activation can be found in sighted participants. We show that left-lateralized primary visual cortex is activated by spoken language comprehension in sighted individuals, . This suggests that plasticity even in complete blindness from birth is not limitless and is guided by pre-existing connectivity and abilities in the typically-developed brain.
Thinking ahead: prediction in context as a keystone of language in humans and machines
Authors: Goldstein, A.; Zada, Z.; Buchnik, E.; Schain, M.; Price, A.; Aubrey, B.; Nastase, S. A.; Feder, A.; Emanuel, D.; Cohen, A.; Jansen, A.; Gazula, H.; Choe, G.; Rao, A.; Kim, C.; Casto, C.; Lora, F.; Flinker, A.; Devore, S.; Doyle, W.; Dugan, P.; Friedman, D.; Hassidim, A.; Brenner, M.; Matias, Y.; Norman, K. A.; Devinsky, O.; Hasson, U.
Category: neuroscience
Date: 2021-09-30

Departing from traditional linguistic models, advances in deep learning have resulted in a new type of predictive (autoregressive) deep language models (DLMs). Using a self-supervised next-word prediction task, these models are trained to generate appropriate linguistic responses in a given context. We provide empirical evidence that the human brain and autoregressive DLMs share three fundamental computational principles as they process natural language: 1) both are engaged in continuous next-word prediction before word-onset; 2) both match their pre-onset predictions to the incoming word to calculate post-onset surprise (i.e., prediction error signals); 3) both represent words as a function of the previous context. In support of these three principles, our findings indicate that: a) the neural activity before word-onset contains context-dependent predictive information about forthcoming words, even hundreds of milliseconds before the words are perceived; b) the neural activity after word-onset reflects the surprise level and prediction error; and c) autoregressive DLM contextual embeddings capture the neural representation of context-specific word meaning better than arbitrary or static semantic embeddings. Together, our findings suggest that autoregressive DLMs provide a novel and biologically feasible computational framework for studying the neural basis of language.
Ageing disrupts reinforcement learning whilst learning to help others is preserved
Authors: Cutler, J.; Wittmann, M.; Abdurahman, A.; Hargitai, L.; Drew, D.; Husain, M.; Lockwood, P.
Category: neuroscience
Date: 2021-04-01

Reinforcement learning is a fundamental mechanism displayed by many species. However, adaptive behaviour depends not only on learning about actions and outcomes that affect ourselves, but also those that affect others. Here, using computational reinforcement learning models, we tested whether young (age 18-36) and older (age 60-80, total n=152) adults can learn to gain rewards for themselves, another person (prosocial), or neither individual (control). Detailed model comparison showed that a model with separate learning rates for each recipient best explained behaviour. Young adults were faster to learn when their actions benefitted themselves, compared to helping others. Strikingly, compared to younger adults, older adults showed preserved prosocial learning rates but reduced self-relevant learning rates. Moreover, psychopathic traits were lower in older adults and negatively correlated with prosocial learning. These findings suggest learning how to benefit others is preserved across the lifespan with implications for reinforcement learning and theories of healthy ageing.
NMDAR-independent acetylcholine, serotonin, and norepinephrine mediated modulation of synaptic eligibility traces into LTD in mice visual cortex
Authors: Khan, S.
Category: neuroscience
Date: 2021-01-13

In reward-based learning, synaptic eligibility traces are a well-defined theoretical solution for the conversion of initial co-activation of pre and postsynaptic neurons into long-term changes in synaptic strength by reward-linked neuromodulators. However, the types of neuromodulators involved in such a phenomenon in mouse visual cortex remain unknown. To characterize the Ex vivo condition, we used optogenetic stimulation of channelrhodopsin-(ChR2) expressing Cre/Ai32(ChR2-eYFP); Tph2-Cre/Ai32(ChR2-eYFP); Thi-Cre/Ai32(ChR2-eYFP) homozygous mice, which release acetylcholine, serotonin, and norepinephrine, respectively. With these mice it is possible to measure the transformation of eligibility traces into long-term changes by endogenous neuromodulators. Here we delineated that layer 2/3 neurons in the visual cortex showed no LTD after conditioning with paired-pulse low-frequency stimulation (ppLFS; 2Hz, 15 min). However, if conditioning was paired with acetylcholine, serotonin, or norepinephrine release upon 473 nm optical stimulation in brain slices, LTD occurs in every case. Thus, our data suggests a new pathway to connect the gap between stimulus and reward. Moreover, we found that stimulation by theta-glass or metal stimulators evoked IPSC traces with the same amplitudes but differences in decay kinetics, further questioning the appropriate use of stimulators in brain slices for evoking an event.
Oligodendrocytes depend on MCL-1 to prevent spontaneous apoptosis and white matter degeneration
Authors: Cleveland, A. H.; Romero-Morales, A.; Alfonso Azcona, L.; Herrero, M.; Nikolova, V. D.; Moy, S.; Elroy-Stein, O.; Gama, V.; Gershon, T. R.
Category: neuroscience
Date: 2021-07-02

Neurologic disorders often disproportionately affect specific brain regions, and different apoptotic mechanisms may contribute to white matter pathology in leukodystrophies or gray matter pathology in poliodystrophies. We previously showed that neural progenitors that generate cerebellar gray matter depend on the anti-apoptotic protein BCL-xL. Conditional deletion of Bcl-xL in these progenitors produces spontaneous apoptosis and cerebellar hypoplasia, while similar conditional deletion of Mcl-1 produces no phenotype. Here, we show that, in contrast, postnatal oligodendrocytes depend on MCL-1. We found that brain-wide Mcl-1 deletion caused apoptosis specifically in mature oligodendrocytes while sparing astrocytes and oligodendrocyte precursors, resulting in impaired myelination and progressive white matter degeneration. Disabling apoptosis through co-deletion of Bax or Bak rescued white matter degeneration, implicating the intrinsic apoptotic pathway in Mcl-1-dependence. Bax and Bak co-deletions rescued different aspects of the Mcl-1-deleted phenotype, demonstrating their discrete roles in white matter stability. MCL-1 protein abundance was reduced in eif2b5-mutant mouse model of the leukodystrophy vanishing white matter disease (VWMD), suggesting the potential for MCL-1 deficiency to contribute to clinical neurologic disease. Our data show that oligodendrocytes require MCL-1 to suppress apoptosis, implicate MCL-1 deficiency in white matter pathology, and suggest apoptosis inhibition as a leukodystrophy therapy.
Behavioral, Anatomical and Genetic Convergence of Affect and Cognition in Superior Frontal Cortex
Authors: Kraljevic, N.; Schaare, H. L.; Eickhoff, S. B.; Kochunov, P.; Yeo, B. T. T.; Kharabian Masouleh, S.; Valk, S. L.
Category: neuroscience
Date: 2021-07-07

Affective experience and cognitive abilities are key human traits that are interrelated in behavior and brain. Individual variation of affective and cognitive traits, as well as brain structure, has been shown to partly underlie genetic effects. However, to what extent affect and cognition have a shared genetic relationship with local brain structure is incompletely understood. Here we studied phenotypic and genetic correlations of cognitive and affective traits in behavior and brain structure (cortical thickness, surface area and subcortical volumes) in the twin-based Human Connectome Project sample (N = 1091). Both affective and cognitive trait scores were highly heritable and showed significant phenotypic correlation on the behavioral level. Cortical thickness in the left superior frontal cortex showed a phenotypic association with both affect and cognition, which was driven by shared genetic effects. Quantitative functional decoding of this region yielded associations with cognitive and emotional functioning. This study provides a multi-level approach to study the association between affect and cognition and suggests a convergence of both in superior frontal cortical thickness.
Self-beneficial belief updating as a coping mechanism for stress-induced negative affect
Authors: Czekalla, N.; Baumann, J.; Stolz, D. S.; Mayer, A. V.; Voges, J. F.; Rademacher, L.; Paulus, F. M.; Krach, S.; Müller-Pinzler, L.
Category: neuroscience
Date: 2020-12-17

Being confronted with social-evaluative stress elicits a physiological and a psychological stress response. This calls for regulatory processes to manage negative affect and maintain self-related optimistic beliefs. The aim of the current study was to investigate the affect-regulating potential of self-related belief updating after exposure to social-evaluative stress, in comparison to non-social physical stress or no stress. We assessed self-related belief updating using trial-by-trial performance feedback and described the updating behavior in a mechanistic way using computational modeling. We found that social-evaluative stress was accompanied by an increase in cortisol and negative affect which was related to a shift in self-related belief updating towards the positive direction. This self-beneficial belief updating, which was absent after physical stress or control, was associated with a better recovery from stress-induced negative affect. This indicates that enhanced integration of positive self-related feedback can act as a coping strategy to deal with social-evaluative stress.
Loss of SUR1 subtype KATP channels alters antinociception and locomotor activity after opioid administration
Authors: Sakamaki, G.; Johnson, K.; Mensinger, M.; Hmu, E.; Klein, A. H.
Category: neuroscience
Date: 2020-12-03

BackgroundOpioid signaling can occur through several downstream mediators and influence analgesia as well as reward mechanisms in the nervous system. KATP channels are downstream targets of the  opioid receptor and contribute to morphine-induced antinociception.

AimsThe aim of the present work was to assess the role of SUR1-subtype KATP channels in antinocicpetion and hyperlocomotion of synthetic and semi-synthetic opioids.

MethodsAdult male and female mice wild-type (WT) and SUR1 deficient (KO) mice were assessed for mechanical and thermal antinociception after administration of either buprenorphine, fentanyl, or DAMGO. Potassium flux was assessed in the dorsal root ganglia and superficial dorsal horn cells in WT and KO mice. Hyperlocomotion was also assessed in WT and KO animals after buprenorphine, fentanyl, or DAMGO administration.

ResultsSUR1 KO mice had attenuated mechanical antinociception after systemic administration of buprenorphine, fentanyl, and DAMGO. Potassium flux was also attenuated in the dorsal root ganglia and spinal cord cells after acute administration of buprenorphine and fentanyl. Hyperlocomotion after administration of morphine and buprenorphine was potentiated in SUR1 KO mice, but was not seen after administration of fentanyl or DAMGO.

ConclusionsThese results suggest SUR1-subtype KATP channels mediate the antinociceptive response of several classes of opioids (alkaloid and synthetic/semi-synthetic), but may not contribute to the "drug-seeking" behaviors of all classes of opioids.
Common computational principle for vibro-tactile pitch perception in mouse and human
Authors: Prsa, M.; Kilicel, D.; Nourizonoz, A.; Lee, K.-S.; Huber, D.
Category: neuroscience
Date: 2020-12-03

We live surrounded by vibrations generated by moving objects. These oscillatory stimuli can produce sound (i.e. airborne waves) and propagate through solid substrates. Pitch is the main perceptual characteristic of sound, and a similar perceptual attribute seems to exist in the case of substrate vibrations: vibro-tactile pitch. Here, we establish a mechanistic relationship between vibro-tactile pitch perception and the actual physical properties of vibrations using behavioral tasks, in which vibratory stimuli were delivered to the human fingertip or the mouse forelimb. The resulting perceptual reports were analyzed with a model demonstrating that physically different combinations of vibration frequencies and amplitudes can produce equal pitch perception. We found that the perceptually indistinguishable but physically different stimuli follow a common computational principle in mouse and human. It dictates that vibro-tactile pitch perception is shifted with increases in amplitude toward the frequency of highest vibrotactile sensitivity. These findings suggest the existence of a fundamental relationship between the seemingly unrelated concepts of spectral sensitivity and pitch perception.
Cingulate prediction of response to antidepressant and cognitive behavioral therapies for depression: Theory, meta-analysis, and empirical application
Authors: Strege, M.; Siegle, G.; Young, K.
Category: neuroscience
Date: 2020-12-03

ObjectiveIn the interest of precision medicine, we sought to derive preclinical markers of neural mechanisms associated with treatment response in unipolar depression, separated by treatment type.

MethodsWe conducted separate neuroimaging meta-analyses of neural predictors for response to Cognitive Behavioral Therapy (CBT) and Selective Serotonin Reuptake Inhibitors (SSRIs). We assessed whether reactivity of derived regions predicted clinical change in a preference trial of patients with major depressive disorder (MDD) who received CBT (n = 61) or SSRIs (n = 19).

ResultsThe meta-analyses yielded regions within the perigenual (pgACC) and subgenual anterior cingulate cortex (sgACC) associated with SSRI and CBT response, respectively. In our sample, reactivity of the sgACC region was prognostic for response to CBT, but neither cingulate region was prognostic for response to SSRIs using a linguistic task; most prognostic SSRI studies used images. An exploratory analysis revealed a pgACC region for which reactivity to images was prognostic for response to SSRIs.

ConclusionsResults suggest that neural reactivity of the sgACC and pgACC are associated with CBT and SSRI response for unipolar depression. Further research incorporating methodological considerations is necessary for translation.
Alpha activity neuromodulation induced by individual alpha-based neurofeedback learning in ecological context: A double-blind randomized study
Authors: Grosselin, F.; Breton, A.; Yahia-Cherif, L.; Wang, X.; Spinelli, G.; Hugueville, L.; Fossati, P.; Attal, Y.; Navarro, X.; Chavez, M.; George, N.
Category: neuroscience
Date: 2021-06-24

The neuromodulation induced by neurofeedback training (NFT) remains a matter of debate. Investigating the modulation of brain activity specifically associated with NF requires controlling for multiple factors, such as reward, performance, congruency between task and targeted brain activity. This can be achieved using sham feedback (FB) control condition, equating all aspects of the experiment but the link between brain activity and FB. We aimed at investigating the modulation of individual alpha EEG activity induced by NFT in a double-blind, randomized, sham-controlled study. Forty-eight healthy participants were assigned to either NF (n=25) or control (n=23) group and performed alpha upregulation training (over 12 weeks) with a wearable EEG device. Participants of the NF group received FB based on their individual alpha activity. The control group received the auditory FB of participants of the NF group. An increase of alpha activity across training sessions was observed in the NF group only (p<0.001). This neuromodulation was selective in that it was not observed for theta (4-8Hz) and low beta (13-18Hz) activities. While alpha upregulation was found in the NF group only, psychological outcome variables showed increased feeling of control, decreased anxiety level and increased relaxation feeling in both the NF and control groups, without any significant difference between groups. This is interpreted in terms of learning context and placebo effects. Our results pave the way to self-learnt, NF-based neuromodulation with light-weighted, wearable EEG systems.