PenguinMan/ARXIV huggingface dataset:
Reinforcement learning approach to control an inverted pendulum: A general framework for educational purposes
Authors: Sardor Israilov, Li Fu, Jesús Sánchez-Rodríguez, Franco Fusco, Guillaume Allibert, Christophe Raufaste, Médéric Argentina
Journal: PLOS ONE
Accepted: 2022-12-20T00:00:00Z


Machine learning is often cited as a new paradigm in control theory, but is also often viewed as empirical and less intuitive for students than classical model-based methods. This is particularly the case for reinforcement learning, an approach that does not require any mathematical model to drive a system inside an unknown environment. This lack of intuition can be an obstacle to design experiments and implement this approach. Reversely there is a need to gain experience and intuition from experiments. In this article, we propose a general framework to reproduce successful experiments and simulations based on the inverted pendulum, a classic problem often used as a benchmark to evaluate control strategies. Two algorithms (basic Q-Learning and Deep Q-Networks (DQN)) are introduced, both in experiments and in simulation with a virtual environment, to give a comprehensive understanding of the approach and discuss its implementation on real systems. In experiments, we show that learning over a few hours is enough to control the pendulum with high accuracy. Simulations provide insights about the effect of each physical parameter and tests the feasibility and robustness of the approach.
Lack of the Ig cell adhesion molecule BT-IgSF (IgSF11) induced behavioral changes in the open maze, water maze and resident intruder test
Authors: Dirk Montag, Laura Pelz, Fritz G Rathjen
Journal: PLOS ONE
Accepted: 2022-12-21T00:00:00Z


The brain- and testis-specific Ig superfamily protein (BT-IgSF, also termed IgSF11) is a homotypic cell adhesion protein. In the nervous system, BT-IgSF regulates the stability of AMPA receptors in the membrane of cultured hippocampal neurons, modulates the connectivity of chandelier cells and controls gap junction-mediated astrocyte-astrocyte communication. Here, we performed behavioral tests in BT-IgSF-deficient mice. BT-IgSF-deficient mice were similar to control littermates with respect to their reflexes, motor coordination and gating, and associative learning. However, BT-IgSF-deficient mice displayed an increased tendency to stay in the central illuminated areas in the open field and O-Maze paradigms suggesting reduced anxiety or increased scotophobia (fear of darkness). Although BT-IgSF-deficient mice initially found the platform in the water maze their behavior was compromised when the platform was moved, indicating reduced behavioral flexibility. This deficit was overcome by longer training to improve their spatial memory. Furthermore, male BT-IgSF-deficient mice displayed increased aggression towards an intruder. Our results show that specific behaviors are modified by the lack of BT-IgSF and demonstrate a contribution of BT-IgSF to network functions.
Characteristic mango price forecasting using combined deep-learning optimization model
Authors: Xiaoya Ma, Jin Tong, Wu Huang, Haitao Lin
Journal: PLOS ONE
Accepted: 2023-03-06T00:00:00Z


Accurate product price forecasting is helpful for scientific decision-making and precise industrial planning. As a characteristic fruit that drives regional development, mango price prediction is of great significance to several economies. However, owing to the strong volatility of mango prices, forecasting is vulnerable to uncertainties and is very challenging. In this study, a deep-learning combination forecasting model based on a back-propagation (BP) long short-term memory (LSTM) neural network is proposed. Using daily mango price data from a large fruit wholesale trading center in China from January 2nd, 2014, to April 18th, 2022, mango price changes are learned and predicted to support the fruit industry. The results show that the root mean-square error, mean absolute percentage error, and the R2 determination coefficient of the BP-LSTM combination model are 0.0175, 0.14%, and 0.9998, respectively. The prediction results of the combined model are better than those of the separate BP and LSTM models. Furthermore, it best fits the actual price profile and has better generalizability.
Devising novel performance measures for assessing the behavior of multilayer perceptrons trained on regression tasks
Authors: Giuliano Armano, Andrea Manconi
Journal: PLOS ONE
Accepted: 2023-04-25T00:00:00Z


This methodological article is mainly aimed at establishing a bridge between classification and regression tasks, in a frame shaped by performance evaluation. More specifically, a general procedure for calculating performance measures is proposed, which can be applied to both classification and regression models. To this end, a notable change in the policy used to evaluate the confusion matrix is made, with the goal of reporting information about regression performance therein. This policy, called generalized token sharing, allows to a) assess models trained on both classification and regression tasks, b) evaluate the importance of input features, and c) inspect the behavior of multilayer perceptrons by looking at their hidden layers. The occurrence of success and failure patterns at the hidden layers of multilayer perceptrons trained and tested on selected regression problems, together with the effectiveness of layer-wise training, is also discussed.
The patterns of uveitis and the factors affecting visual outcome from Chulalongkorn University Uveitis Cohort (CU2C): A 5-year longitudinal study protocol
Authors: Jakkrit Juhong, Krit Pongpirul, Somtaporn Ueathaweephol, Thanapong Somkijrungroj, Wijak Kongwattananon
Journal: PLOS ONE
Accepted: 2022-09-21T00:00:00Z

Background: In Thailand, several novel laboratory investigations are recently available to help differentiate the uveitic etiologies. The update on uveitis epidemiological data in Thailand is necessary to better understand the disease burden and provide guidance on management. The current study aims to describe the prevalence and identify factors associated with poor visual outcomes of uveitis patients at a tertiary center in Thailand. Methods: A 5-year-prospective study of uveitis cases presented at a tertiary referral center in the central region of Thailand is conducted.
Diapause induces functional axonal regeneration after necrotic insult in C. elegans
Authors: Mauricio Caneo, Victoria Julian, Alexandra B Byrne, Mark J Alkema, Andrea Calixto
Journal: PLOS Genetics
Accepted: 2018-11-29T00:00:00Z


Many neurons are unable to regenerate after damage. The ability to regenerate after an insult depends on life stage, neuronal subtype, intrinsic and extrinsic factors. C. elegans is a powerful model to test the genetic and environmental factors that affect axonal regeneration after damage, since its axons can regenerate after neuronal insult. Here we demonstrate that diapause promotes the complete morphological regeneration of truncated touch receptor neuron (TRN) axons expressing a neurotoxic MEC-4(d) DEG/ENaC channel. Truncated axons of different lengths were repaired during diapause and we observed potent axonal regrowth from somas alone. Complete morphological regeneration depends on DLK-1 but neuronal sprouting and outgrowth is DLK-1 independent. We show that TRN regeneration is fully functional since animals regain their ability to respond to mechanical stimulation. Thus, diapause induced regeneration provides a simple model of complete axonal regeneration which will greatly facilitate the study of environmental and genetic factors affecting the rate at which neurons die.
Author summary: Diapause entry and hibernation have the striking ability to protect the nervous system from diverse types of damage. Here we show that the diapausing dauer larvae of C. elegans regenerate broken mechanosensory neurons that were damaged by the hyperactivation of degenerins (MEC-4d) or by axotomy during diapause. This regeneration is complete and functional, rendering neurons capable of responding to touch after three days in diapause. Genetic inactivation of the insulin receptor DAF-2 promotes regeneration of mec-4d axons in non-dauer animals. Overexpression of the downstream transcription factor DAF-16 promotes neuronal protection in mec-4d neurons while loss of daf-16 accelerates mec-4d induced degeneration. Temperature sensitive activation of DAF-2 during diapause induces the loss of axonal integrity. This indicates that the insulin signaling pathway is an important underlying factor in regeneration. Additionally, we show that complete morphological regeneration depends on DLK-1, a conserved protein required for axonal repair. In this work we introduce a simple model of complete axonal regeneration, which will greatly facilitate the study of environmental and genetic factors affecting neurodegeneration and constitute an advantage in studying axonal regrowth.
Computational geometry for modeling neural populations: From visualization to simulation
Authors: Marc de Kamps, Mikkel Lepperød, Yi Ming Lai
Journal: PLOS Computational Biology
Accepted: 2018-11-26T00:00:00Z


The importance of a mesoscopic description level of the brain has now been well established. Rate based models are widely used, but have limitations. Recently, several extremely efficient population-level methods have been proposed that go beyond the characterization of a population in terms of a single variable. Here, we present a method for simulating neural populations based on two dimensional (2D) point spiking neuron models that defines the state of the population in terms of a density function over the neural state space. Our method differs in that we do not make the diffusion approximation, nor do we reduce the state space to a single dimension (1D). We do not hard code the neural model, but read in a grid describing its state space in the relevant simulation region. Novel models can be studied without even recompiling the code. The method is highly modular: variations of the deterministic neural dynamics and the stochastic process can be investigated independently. Currently, there is a trend to reduce complex high dimensional neuron models to 2D ones as they offer a rich dynamical repertoire that is not available in 1D, such as limit cycles. We will demonstrate that our method is ideally suited to investigate noise in such systems, replicating results obtained in the diffusion limit and generalizing them to a regime of large jumps. The joint probability density function is much more informative than 1D marginals, and we will argue that the study of 2D systems subject to noise is important complementary to 1D systems.
Author summary: A group of slow, noisy and unreliable cells collectively implement our mental faculties, and how they do this is still one of the big scientific questions of our time. Mechanistic explanations of our cognitive skills, be it locomotion, object handling, language comprehension or thinking in general—whatever that may be—is still far off. A few years ago the following question was posed: Imagine that aliens would provide us with a brain-sized clump of matter, with complete freedom to sculpt realistic neuronal networks with arbitrary precision. Would we be able to build a brain? The answer appears to be no, because this technology is actually materializing, not in the form of an alien kick-start, but through steady progress in computing power, simulation methods and the emergence of databases on connectivity, neural cell types, complete with gene expression, etc. A number of groups have created brain-scale simulations, others like the Blue Brain project may not have simulated a full brain, but they included almost every single detail known about the neurons they modelled. And yet, we do not know how we reach for a glass of milk.
A novel cyclic peptide (Naturido) modulates glia–neuron interactions in vitro and reverses ageing-related deficits in senescence-accelerated mice
Authors: Shinichi Ishiguro, Tetsuro Shinada, Zhou Wu, Mayumi Karimazawa, Michimasa Uchidate, Eiji Nishimura, Yoko Yasuno, Makiko Ebata, Piyamas Sillapakong, Hiromi Ishiguro, Nobuyoshi Ebata, Junjun Ni, Muzhou Jiang, Masanobu Goryo, Keishi Otsu, Hidemitsu Harada, Koichi Suzuki
Journal: PLOS ONE
Accepted: 2020-12-26T00:00:00Z


The use of agents that target both glia and neurons may represent a new strategy for the treatment of ageing disorders. Here, we confirmed the presence of the novel cyclic peptide Naturido that originates from a medicinal fungus (Isaria japonica) grown on domestic silkworm (Bombyx mori). We found that Naturido significantly enhanced astrocyte proliferation and activated the single copy gene encoding the neuropeptide VGF and the neuron-derived NGF gene. The addition of the peptide to the culture medium of primary hippocampal neurons increased dendrite length, dendrite number and axon length. Furthermore, the addition of the peptide to primary microglial cultures shifted CGA-activated microglia towards anti-inflammatory and neuroprotective phenotypes. These findings of in vitro glia–neuron interactions led us to evaluate the effects of oral administration of the peptide on brain function and hair ageing in senescence-accelerated mice (SAMP8). In vivo analyses revealed that spatial learning ability and hair quality were improved in Naturido-treated mice compared with untreated mice, to the same level observed in the normal ageing control (SAMR1). These data suggest that Naturido may be a promising glia–neuron modulator for the treatment of not only senescence, but also Alzheimer’s disease and other neurodegenerative diseases.
Reduced coupling between cerebrospinal fluid flow and global brain activity is linked to Alzheimer disease–related pathology
Authors: Feng Han, Jing Chen, Aaron Belkin-Rosen, Yameng Gu, Liying Luo, Orfeu M Buxton, Xiao Liu, the Alzheimer’s Disease Neuroimaging Initiative 
Journal: PLOS Biology
Accepted: 2021-04-14T00:00:00Z


The glymphatic system plays an important role in clearing the amyloid-β (Aβ) and tau proteins that are closely linked to Alzheimer disease (AD) pathology. Glymphatic clearance, as well as Aβ accumulation, is highly dependent on sleep, but the sleep-dependent driving forces behind cerebrospinal fluid (CSF) movements essential to the glymphatic flux remain largely unclear. Recent studies have reported that widespread, high-amplitude spontaneous brain activations in the drowsy state and during sleep, which are shown as large global signal peaks in resting-state functional magnetic resonance imaging (rsfMRI), are coupled with CSF movements, suggesting their potential link to glymphatic flux and metabolite clearance. By analyzing multimodal data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) project, here we showed that the coupling between the global fMRI signal and CSF influx is correlated with AD-related pathology, including various risk factors for AD, the severity of AD-related diseases, the cortical Aβ level, and cognitive decline over a 2-year follow-up. These results provide critical initial evidence for involvement of sleep-dependent global brain activity, as well as the associated physiological modulations, in the clearance of AD-related brain waste.

This study reveals strong coupling between the global fMRI signal and cerebrospinal fluid influx, finding that this is correlated with Alzheimer’s disease-related pathology, disease severity, and cognitive decline. This supports a link between spontaneous low-frequency brain dynamics and Alzheimer’s disease pathology, presumably due to their role in glymphatic clearance.
A unified mechanism for innate and learned visual landmark guidance in the insect central complex
Authors: Roman Goulard, Cornelia Buehlmann, Jeremy E Niven, Paul Graham, Barbara Webb
Journal: PLOS Computational Biology
Accepted: 2021-08-26T00:00:00Z


Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can elicit strong innate behaviours (attraction or menotaxis) but can also be used, after learning, as a specific directional cue as part of a navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for the behavioural integration of innate and learned guidance based on the neuroanatomy of the central complex (CX), adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory in the mushroom bodies (MB) that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple world containing a single visual cue, we show how the generated short-term memory can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with the observed effects of unilateral MB lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a mapping of the environment that describes the geometrical attractiveness (or repulsion). We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimal cue integration.
Author summary: In this paper, we modeled the neural pathway allowing insects to perform landmark guided behaviours using their internal compass. First, by copying available details of the neural connectivity between internal compass neurons and steering neurons in the fruit-fly brain, we show this circuit can produce directed behaviour towards a visual landmark. We then propose a mechanism by which this connectivity could be adapted through experience to support flexible landmark guidance behaviours such as attraction or menotaxis, that is, movement in arbitrary directions relative to the landmark. This mechanism allows a simple goodness/badness signal, from innate or long-term memory pathways, to be converted into an oriented steering signal relative to the visual surroundings. Furthermore, by simulating lesion experiments in the mushroom bodies of wood ants we highlight the consistency of the model with biological observations.
When shared concept cells support associations: Theory of overlapping memory engrams
Authors: Chiara Gastaldi, Tilo Schwalger, Emanuela De Falco, Rodrigo Quian Quiroga, Wulfram Gerstner
Journal: PLOS Computational Biology
Accepted: 2021-11-29T00:00:00Z


Assemblies of neurons, called concepts cells, encode acquired concepts in human Medial Temporal Lobe. Those concept cells that are shared between two assemblies have been hypothesized to encode associations between concepts. Here we test this hypothesis in a computational model of attractor neural networks. We find that for concepts encoded in sparse neural assemblies there is a minimal fraction cmin of neurons shared between assemblies below which associations cannot be reliably implemented; and a maximal fraction cmax of shared neurons above which single concepts can no longer be retrieved. In the presence of a periodically modulated background signal, such as hippocampal oscillations, recall takes the form of association chains reminiscent of those postulated by theories of free recall of words. Predictions of an iterative overlap-generating model match experimental data on the number of concepts to which a neuron responds.
Author summary: Experimental evidence suggests that associations between concepts are encoded in the hippocampus by cells shared between neuronal assemblies (“overlap” of concepts). What is the necessary overlap that ensures a reliable encoding of associations? Under which conditions can associations induce a simultaneous or a chain-like activation of concepts? Our theoretical model shows that the ideal overlap presents a tradeoff: the overlap should be larger than a minimum value in order to reliably encode associations, but lower than a maximum value to prevent loss of individual memories. Our theory explains experimental data from human Medial Temporal Lobe and provides a mechanism for chain-like recall in presence of inhibition, while still allowing for simultaneous recall if inhibition is weak.
FXS causing missense mutations disrupt FMRP granule formation, dynamics, and function
Authors: Emily L Starke, Keelan Zius, Scott A Barbee
Journal: PLOS Genetics
Accepted: 2022-02-08T00:00:00Z


Fragile X Syndrome (FXS) is the most prevalent cause of inherited mental deficiency and is the most common monogenetic cause of autism spectral disorder (ASD). Here, we demonstrate that disease-causing missense mutations in the conserved K homology (KH) RNA binding domains (RBDs) of FMRP cause defects in its ability to form RNA transport granules in neurons. Using molecular, genetic, and imaging approaches in the Drosophila FXS model system, we show that the KH1 and KH2 domains of FMRP regulate distinct aspects of neuronal FMRP granule formation, dynamics, and transport. Furthermore, mutations in the KH domains disrupt translational repression in cells and the localization of known FMRP target mRNAs in neurons. These results suggest that the KH domains play an essential role in neuronal FMRP granule formation and function which may be linked to the molecular pathogenesis of FXS.
Author summary: Fragile X Syndrome (FXS) is the most common inherited neurodevelopmental disorder in humans and single gene cause of autism. Most cases of FXS are caused by the complete loss of a single protein (called FMRP). This has made it particularly difficult to understand which of the normal functions of FMRP are disrupted in cases of FXS. Recently, advances in high-throughput sequencing technologies have led to the discovery of patients with severe FXS caused by single mutations in important regions of the FMRP protein. Using a well-characterized FXS model system, we have found that two disease-causing mutations in FMRP disrupt the formation, dynamics, and function of RNA- and protein-containing granules in neurons. These granules have been shown to be involved in the transport of mRNA cargos in axons and dendrites. Disruption of these granules is linked to defects in synaptic development and plasticity. Our results show that two regions of the FMRP protein play a critical role in the control of FMRP granules. These findings suggest the disruption of these processes may be linked to FXS pathogenesis.