PenguinMan/ARXIV huggingface dataset:
Adaptation supports short-term memory in a visual change detection task
Authors: Brian Hu, Marina E Garrett, Peter A Groblewski, Douglas R Ollerenshaw, Jiaqi Shang, Kate Roll, Sahar Manavi, Christof Koch, Shawn R Olsen, Stefan Mihalas
Journal: PLOS Computational Biology
Accepted: 2021-07-03T00:00:00Z


The maintenance of short-term memories is critical for survival in a dynamically changing world. Previous studies suggest that this memory can be stored in the form of persistent neural activity or using a synaptic mechanism, such as with short-term plasticity. Here, we compare the predictions of these two mechanisms to neural and behavioral measurements in a visual change detection task. Mice were trained to respond to changes in a repeated sequence of natural images while neural activity was recorded using two-photon calcium imaging. We also trained two types of artificial neural networks on the same change detection task as the mice. Following fixed pre-processing using a pretrained convolutional neural network, either a recurrent neural network (RNN) or a feedforward neural network with short-term synaptic depression (STPNet) was trained to the same level of performance as the mice. While both networks are able to learn the task, the STPNet model contains units whose activity are more similar to the in vivo data and produces errors which are more similar to the mice. When images are omitted, an unexpected perturbation which was absent during training, mice often do not respond to the omission but are more likely to respond to the subsequent image. Unlike the RNN model, STPNet produces a similar pattern of behavior. These results suggest that simple neural adaptation mechanisms may serve as an important bottom-up memory signal in this task, which can be used by downstream areas in the decision-making process.
Author summary: Animals have to adapt to environments with rich dynamics and maintain multiple types of memories. In this study, we focus on a visual change detection task in mice which requires short-term memory. Learning which features need to be maintained in short-term memory can be realized in a recurrent neural network by changing connections in the network, resulting in memory maintenance through persistent activity. However, in biological networks, a large diversity of time-dependent intrinsic mechanisms are also available. As an alternative to persistent neural activity, we find that learning to make use of internal adapting dynamics better matches both the observed neural activity and behavior of animals in this simple task. The presence of a large diversity of temporal traces could be one of the reasons for the diversity of cells observed. We believe that both learning to keep representations of relevant stimuli in persistent activity and learning to make use of intrinsic time-dependent mechanisms exist, and their relative use will be dependent on the exact task.
An association between prediction errors and risk-seeking: Theory and behavioral evidence
Authors: Moritz Moeller, Jan Grohn, Sanjay Manohar, Rafal Bogacz
Journal: PLOS Computational Biology
Accepted: 2021-06-23T00:00:00Z


Reward prediction errors (RPEs) and risk preferences have two things in common: both can shape decision making behavior, and both are commonly associated with dopamine. RPEs drive value learning and are thought to be represented in the phasic release of striatal dopamine. Risk preferences bias choices towards or away from uncertainty; they can be manipulated with drugs that target the dopaminergic system. Based on the common neural substrate, we hypothesize that RPEs and risk preferences are linked on the level of behavior as well. Here, we develop this hypothesis theoretically and test it empirically. First, we apply a recent theory of learning in the basal ganglia to predict how RPEs influence risk preferences. We find that positive RPEs should cause increased risk-seeking, while negative RPEs should cause risk-aversion. We then test our behavioral predictions using a novel bandit task in which value and risk vary independently across options. Critically, conditions are included where options vary in risk but are matched for value. We find that our prediction was correct: participants become more risk-seeking if choices are preceded by positive RPEs, and more risk-averse if choices are preceded by negative RPEs. These findings cannot be explained by other known effects, such as nonlinear utility curves or dynamic learning rates.
Author summary: Many of our decisions are based on expectations. Sometimes, however, surprises happen: outcomes are not as expected. Such discrepancies between expectations and actual outcomes are called prediction errors. Our brain recognizes and uses such prediction errors to modify our expectations and make them more realistic—a process known as reinforcement learning. In particular, neurons that release the neurotransmitter dopamine show activity patterns that strongly resemble prediction errors. Interestingly, the same neurotransmitter is also known to regulate risk preferences: dopamine levels control our willingness to take risks. We theorized that, since learning signals cause dopamine release, they might change risk preferences as well. In this study, we test this hypothesis. We find that participants are more likely to make a risky choice just after they experienced an outcome that was better than expected, which is precisely what our theory predicts. This suggests that dopamine signaling can be ambiguous—a learning signal can be mistaken for an impulse to take a risk.
Altered states phenomena induced by visual flicker light stimulation
Authors: Marie Therese Bartossek, Johanna Kemmerer, Timo Torsten Schmidt
Journal: PLOS ONE
Accepted: 2021-06-14T00:00:00Z


Flicker light stimulation can induce short-term alterations in consciousness including hallucinatory color perception and geometric patterns. In the study at hand, the subjective experiences during 3 Hz and 10 Hz stroboscopic light stimulation of the closed eyes were assessed. In a within-subjects design (N = 24), we applied the Positive and Negative Affect Schedule (mood state), time perception ratings, the Altered State of Consciousness Rating Scale, and the Phenomenology of Consciousness Inventory. Furthermore, we tested for effects of personality traits (NEO Five-Factor Inventory-2 and Tellegen Absorption Scale) on subjective experiences. Such systematic quantification improves replicability, facilitates comparisons between pharmacological and non-pharmacological techniques to induce altered states of consciousness, and is the prerequisite to study their underlying neuronal mechanisms. The resulting data showed that flicker light stimulation-induced states were characterized by vivid visual hallucinations of simple types, with effects strongest in the 10 Hz condition. Additionally, participants’ personality trait of Absorption scores highly correlated with the experienced alterations in consciousness. Our data demonstrate that flicker light stimulation is capable of inducing visual effects with an intensity rated to be similar in strength to effects induced by psychedelic substances and thereby support the investigation of potentially shared underlying neuronal mechanisms.
Ganoderma tsugae prevents cognitive impairment and attenuates oxidative damage in d-galactose-induced aging in the rat brain
Authors: Hui-Chuan Kuo, Sih-Yu Tong, Ming-Wei Chao, Chia-Yi Tseng
Journal: PLOS ONE
Accepted: 2022-03-02T00:00:00Z


Lingzhi has long been regarded as having life-prolonging effects. Research in recent years has also reported that Lingzhi possesses anti-tumor, anti-inflammatory, immunomodulatory, hepatoprotective, and anti-lipogenic effects. The D-galactose (D-gal, 100 mg/kg/day)-induced aging Long-Evans rats were simultaneously orally administered a DMSO extract of Ganoderma tsugae (GTDE, 200 μg/kg/day) for 25 weeks to investigate the effects of GTDE on oxidative stress and memory deficits in the D-galactose-induced aging rats. We found that GTDE significantly improved the locomotion and spatial memory and learning in the aging rats. GTDE alleviated the aging-induced reduction of dendritic branching in neurons of the hippocampus and cerebral cortex. Immunoblotting revealed a significant increase in the protein expression levels of the superoxide dismutase-1 (SOD-1) and catalase, and the brain-derived neurotrophic factor (BDNF) in rats that received GTDE. D-gal-induced increase in the lipid peroxidation product 4-hydroxynonenal (4-HNE) was significantly attenuated after the administration of GTDE, and pyrin domain-containing 3 protein (NLRP3) revealed a significant decrease in NLRP3 expression after GTDE administration. Lastly, GTDE significantly reduced the advanced glycosylation end products (AGEs). In conclusion, GTDE increases antioxidant capacity and BDNF expression of the brain, protects the dendritic structure of neurons, and reduces aging-induced neuronal damage, thereby attenuating cognitive impairment caused by aging.
Uncertainty–guided learning with scaled prediction errors in the basal ganglia
Authors: Moritz Möller, Sanjay Manohar, Rafal Bogacz
Journal: PLOS Computational Biology
Accepted: 2022-05-05T00:00:00Z


To accurately predict rewards associated with states or actions, the variability of observations has to be taken into account. In particular, when the observations are noisy, the individual rewards should have less influence on tracking of average reward, and the estimate of the mean reward should be updated to a smaller extent after each observation. However, it is not known how the magnitude of the observation noise might be tracked and used to control prediction updates in the brain reward system. Here, we introduce a new model that uses simple, tractable learning rules that track the mean and standard deviation of reward, and leverages prediction errors scaled by uncertainty as the central feedback signal. We show that the new model has an advantage over conventional reinforcement learning models in a value tracking task, and approaches a theoretic limit of performance provided by the Kalman filter. Further, we propose a possible biological implementation of the model in the basal ganglia circuit. In the proposed network, dopaminergic neurons encode reward prediction errors scaled by standard deviation of rewards. We show that such scaling may arise if the striatal neurons learn the standard deviation of rewards and modulate the activity of dopaminergic neurons. The model is consistent with experimental findings concerning dopamine prediction error scaling relative to reward magnitude, and with many features of striatal plasticity. Our results span across the levels of implementation, algorithm, and computation, and might have important implications for understanding the dopaminergic prediction error signal and its relation to adaptive and effective learning.
Author summary: The basal ganglia system is a collection of subcortical nuclei in the mammalian brain. This system and its dopaminergic inputs are associated with learning from rewards. Here, dopamine is thought to signal errors in reward prediction. The structure and function of the basal ganglia system are not fully understood yet—for example, the basal ganglia are split into two antagonistic pathways, but the reason for this split and the role of the two pathways are unknown. Further, it has been found that under some circumstances, rewards of different sizes lead to dopamine responses of similar size, which cannot be explained with the reward prediction error theory. Here, we propose a new model of learning in the basal ganglia—the scaled prediction error model. According to our model, both reward average and reward uncertainty are tracked and represented in the two basal ganglia pathways. The learned reward uncertainty is then used to scale dopaminergic reward prediction errors, which effectively renders learning adaptive to reward noise. We show that such learning is more robust than learning from unscaled prediction errors and that it explains several physiological features of the basal ganglia system.
Meta-control of social learning strategies
Authors: Anil Yaman, Nicolas Bredeche, Onur Çaylak, Joel Z Leibo, Sang Wan Lee
Journal: PLOS Computational Biology
Accepted: 2022-01-28T00:00:00Z


Social learning, copying other’s behavior without actual experience, offers a cost-effective means of knowledge acquisition. However, it raises the fundamental question of which individuals have reliable information: successful individuals versus the majority. The former and the latter are known respectively as success-based and conformist social learning strategies. We show here that while the success-based strategy fully exploits the benign environment of low uncertainly, it fails in uncertain environments. On the other hand, the conformist strategy can effectively mitigate this adverse effect. Based on these findings, we hypothesized that meta-control of individual and social learning strategies provides effective and sample-efficient learning in volatile and uncertain environments. Simulations on a set of environments with various levels of volatility and uncertainty confirmed our hypothesis. The results imply that meta-control of social learning affords agents the leverage to resolve environmental uncertainty with minimal exploration cost, by exploiting others’ learning as an external knowledge base.
Author summary: Which individuals have reliable information: successful individuals or the majority? Seeking a suitable compromise between individual and social learning is crucial for optimum learning in a population. Motivated by the recent findings in neuroscience showing that the brain can arbitrate between different learning strategies, termed meta-control, we propose a meta-control approach in social learning context. First, we show that environmental uncertainty is a crucial predictor of the performance of the individual and two social learning strategies: success-based and conformist. Our meta social learning model uses environmental uncertainty to find a compromise between these two strategies. In simulations on a set of environments with various levels of volatility and uncertainty, we demonstrate that our model outperforms other meta-social learning approaches. In the subsequent evolutionary analysis, we show that our model dominated others in survival rate. Our work provides a new account of the trade-offs between individual, success-based, and conformist learning strategies in multi-agent settings. Critically, our work unveils an optimal social learning strategy to resolve environmental uncertainty with minimal exploration cost.
Lingual electrotactile discrimination ability is associated with the presence of specific connective tissue structures (papillae) on the tongue surface
Authors: Tyler S Allison, Joel Moritz Jr., Philip Turk, Leslie M Stone-Roy
Journal: PLOS ONE
Accepted: 2020-07-21T00:00:00Z


Electrical stimulation of nerve endings in the tongue can be used to communicate information to users and has been shown to be highly effective in sensory substitution applications. The anterior tip of the tongue has very small somatosensory receptive fields, comparable to those of the finger tips, allowing for precise two-point discrimination and high tactile sensitivity. However, perception of electrotactile stimuli varies significantly between users, and across the tongue surface. Despite this, previous studies all used uniform electrode grids to stimulate a region of the dorsal-medial tongue surface. In an effort to customize electrode layouts for individual users, and thus improve efficacy for sensory substitution applications, we investigated whether specific neuroanatomical and physiological features of the tongue are associated with enhanced ability to perceive active electrodes. Specifically, the study described here was designed to test whether fungiform papillae density and/or propylthiouracil sensitivity are positively or negatively associated with perceived intensity and/or discrimination ability for lingual electrotactile stimuli. Fungiform papillae number and distribution were determined for 15 participants and they were exposed to patterns of electrotactile stimulation (ETS) and asked to report perceived intensity and perceived number of stimuli. Fungiform papillae number and distribution were then compared to ETS characteristics using comprehensive and rigorous statistical analyses. Our results indicate that fungiform papillae density is correlated with enhanced discrimination ability for electrical stimuli. In contrast, papillae density, on average, is not correlated with perceived intensity of active electrodes. However, results for at least one participant suggest that further research is warranted. Our data indicate that propylthiouracil taster status is not related to ETS perceived intensity or discrimination ability. These data indicate that individuals with higher fungiform papillae number and density in the anterior medial tongue region may be better able to use lingual ETS for sensory substitution.
TIAM-1 differentially regulates dendritic and axonal microtubule organization in patterning neuronal development through its multiple domains
Authors: Chih-Hsien Lin, Ying-Chun Chen, Shih-Peng Chan, Chan-Yen Ou
Journal: PLOS Genetics
Accepted: 2022-09-29T00:00:00Z


Axon and dendrite development require the cooperation of actin and microtubule cytoskeletons. Microtubules form a well-organized network to direct polarized trafficking and support neuronal processes formation with distinct actin structures. However, it is largely unknown how cytoskeleton regulators differentially regulate microtubule organization in axon and dendrite development. Here, we characterize the role of actin regulators in axon and dendrite development and show that the RacGEF TIAM-1 regulates dendritic patterns through its N-terminal domains and suppresses axon growth through its C-terminal domains. TIAM-1 maintains plus-end-out microtubule orientation in posterior dendrites and prevents the accumulation of microtubules in the axon. In somatodendritic regions, TIAM-1 interacts with UNC-119 and stabilizes the organization between actin filaments and microtubules. UNC-119 is required for TIAM-1 to control axon growth, and its expression levels determine axon length. Taken together, TIAM-1 regulates neuronal microtubule organization and patterns axon and dendrite development respectively through its different domains.
Author summary: In neurons, microtubules form an acentrosomal organization to support polarized trafficking and development of neuronal processes. While dendritic branches and the axon grow differentially, it is largely unknown how microtubules organize with actin architectures to promote distinct axon and dendrite development. In this work, we show that a multi-domain RacGEF protein TIAM-1 controls dendrite patterning by its N-terminal domains and suppresses axon development by its C-terminal GEF domains. TIAM-1 is required for maintaining microtubule polarity in dendritic regions and suppressing accumulation of axonal cargos and microtubules. In somatodendritic regions, TIAM-1 binds UNC-119 and maintains the organization between actin and microtubule. TIAM-1 prevents axonal distribution of UNC-119 and thus controls axon development. This work demonstrates how dendritic and axonal microtubule organizations are differentially controlled by TIAM-1.
Influence of learning strategy on response time during complex value-based learning and choice
Authors: Shiva Farashahi, Katherine Rowe, Zohra Aslami, Maria Ida Gobbini, Alireza Soltani
Journal: PLOS ONE
Accepted: 2018-04-30T00:00:00Z


Measurements of response time (RT) have long been used to infer neural processes underlying various cognitive functions such as working memory, attention, and decision making. However, it is currently unknown if RT is also informative about various stages of value-based choice, particularly how reward values are constructed. To investigate these questions, we analyzed the pattern of RT during a set of multi-dimensional learning and decision-making tasks that can prompt subjects to adopt different learning strategies. In our experiments, subjects could use reward feedback to directly learn reward values associated with possible choice options (object-based learning). Alternatively, they could learn reward values of options’ features (e.g. color, shape) and combine these values to estimate reward values for individual options (feature-based learning). We found that RT was slower when the difference between subjects’ estimates of reward probabilities for the two alternative objects on a given trial was smaller. Moreover, RT was overall faster when the preceding trial was rewarded or when the previously selected object was present. These effects, however, were mediated by an interaction between these factors such that subjects were faster when the previously selected object was present rather than absent but only after unrewarded trials. Finally, RT reflected the learning strategy (i.e. object-based or feature-based approach) adopted by the subject on a trial-by-trial basis, indicating an overall faster construction of reward value and/or value comparison during object-based learning. Altogether, these results demonstrate that the pattern of RT can be informative about how reward values are learned and constructed during complex value-based learning and decision making.
Pessimistic expectations and poorer experiences: The role of (low) extraversion in anticipated and experienced enjoyment of social interaction
Authors: Korrina A Duffy, Erik G Helzer, Rick H Hoyle, Jun Fukukura Helzer, Tanya L Chartrand
Journal: PLOS ONE
Accepted: 2018-06-03T00:00:00Z


Given research suggesting that social interactions are beneficial, it is unclear why individuals lower in extraversion engage less in social interactions. In this study, we test whether individuals lower in extraversion reap fewer hedonic rewards from social interactions and explore social psychological processes that explain their experiences. Before participants socialized, we measured extraversion, state positive affect, cognitive capacity, and expectations about the social interactions. After participants socialized with one another, we measured state positive affect and cognitive capacity again as well as fear of negative evaluation and belief in limited cognitive capacity. Participants also rated the social skillfulness of each interaction partner. We found that less extraverted individuals expect to feel worse after socializing. However, all but those extremely low in extraversion (17% of sample) actually experience an increase in positive affect after socializing. Surprisingly, those low in extraversion did not show reduced cognitive capacity after socializing. Although they are more likely to believe that cognitive capacity is limited and to be fearful of negative evaluation, these characteristics did not explain the social experience of those low in extraversion.