PenguinMan/ARXIV huggingface dataset:
MSPM: A modularized and scalable multi-agent reinforcement learning-based system for financial portfolio management
Authors: Zhenhan Huang, Fumihide Tanaka
Journal: PLOS ONE
Accepted: 2022-01-24T00:00:00Z


Financial portfolio management (PM) is one of the most applicable problems in reinforcement learning (RL) owing to its sequential decision-making nature. However, existing RL-based approaches rarely focus on scalability or reusability to adapt to the ever-changing markets. These approaches are rigid and unscalable to accommodate the varying number of assets of portfolios and increasing need for heterogeneous data input. Also, RL agents in the existing systems are ad-hoc trained and hardly reusable for different portfolios. To confront the above problems, a modular design is desired for the systems to be compatible with reusable asset-dedicated agents. In this paper, we propose a multi-agent RL-based system for PM (MSPM). MSPM involves two types of asynchronously-updated modules: Evolving Agent Module (EAM) and Strategic Agent Module (SAM). An EAM is an information-generating module with a Deep Q-network (DQN) agent, and it receives heterogeneous data and generates signal-comprised information for a particular asset. An SAM is a decision-making module with a Proximal Policy Optimization (PPO) agent for portfolio optimization, and it connects to multiple EAMs to reallocate the corresponding assets in a financial portfolio. Once been trained, EAMs can be connected to any SAM at will, like assembling LEGO blocks. With its modularized architecture, the multi-step condensation of volatile market information, and the reusable design of EAM, MSPM simultaneously addresses the two challenges in RL-based PM: scalability and reusability. Experiments on 8-year U.S. stock market data prove the effectiveness of MSPM in profit accumulation by its outperformance over five different baselines in terms of accumulated rate of return (ARR), daily rate of return (DRR), and Sortino ratio (SR). MSPM improves ARR by at least 186.5% compared to constant rebalanced portfolio (CRP), a widely-used PM strategy. To validate the indispensability of EAM, we back-test and compare MSPMs on four different portfolios. EAM-enabled MSPMs improve ARR by at least 1341.8% compared to EAM-disabled MSPMs.
Identifying extended psychosis phenotypes at school: Associations with socio-emotional adjustment, academic, and neurocognitive outcomes
Authors: Beatriz Lucas-Molina, Alicia Pérez-Albéniz, Encar Satorres, Javier Ortuño-Sierra, Elena Domínguez Garrido, Eduardo Fonseca-Pedrero
Journal: PLOS ONE
Accepted: 2020-08-06T00:00:00Z


The main goal of the present study was to explore the latent structure of extended psychosis phenotypes in a representative sample of adolescents. Moreover, associations with socio-emotional adjustment, academic achievement, and neurocognition performance across the latent profiles were compared. Participants were 1506 students, 667 males (44.3%), derived from random cluster sampling. Various tools were used to measure psychosis risk, subjective well-being, academic performance, and neurocognition. Based on three psychometric indicators of psychosis risk (schizotypal traits, psychotic-like experiences, and bipolar-like experiences), four latent classes were found: non-risk, low-risk, high reality distortion experiences, and high psychosis liability. The high-risk latent groups scored significantly higher on mental health difficulties, and negative affect, and lower on positive affect and well-being, compared to the two non-risk groups. Moreover, these high-risk groups had a significantly higher number of failed academic subjects compared to the non-risk groups. In addition, no statistically significant differences in efficiency performance were found in the neurocognitive domains across the four latent profiles. This study allows us to improve the early identification of adolescents at risk of serious mental disorder in school settings in order to prevent the incidence and burden associated with these kinds of mental health problems.
Resting-state electroencephalography based deep-learning for the detection of Parkinson’s disease
Authors: Mohamed Shaban, Amy W Amara
Journal: PLOS ONE
Accepted: 2022-01-12T00:00:00Z


Parkinson’s disease (PD) is one of the most serious and challenging neurodegenerative disorders to diagnose. Clinical diagnosis on observing motor symptoms is the gold standard, yet by this point nerve cells are degenerated resulting in a lower efficacy of therapeutic treatments. In this study, we introduce a deep-learning approach based on a recently-proposed 20-Layer Convolutional Neural Network (CNN) applied on the visual realization of the Wavelet domain of a resting-state EEG. The proposed approach was able to efficiently and accurately detect PD as well as distinguish subjects with PD on medications from subjects who are off medication. The gradient-weighted class activation mapping (Grad-CAM) was used to visualize the features based on which the approach provided the predictions. A significantly high accuracy, sensitivity, specificity, AUC, and Weighted Kappa Score up to 99.9% were achieved and the visualization of the regions in the Wavelet images that contributed to the deep-learning approach decisions was provided. The proposed framework can then serve as an effective computer-aided diagnostic tool that will support physicians and scientists in further understanding the nature of PD and providing an objective and confident opinion regarding the clinical diagnosis of the disease.
Using machine learning to predict risk of incident opioid use disorder among fee-for-service Medicare beneficiaries: A prognostic study
Authors: Wei-Hsuan Lo-Ciganic, James L Huang, Hao H Zhang, Jeremy C Weiss, C Kent Kwoh, Julie M Donohue, Adam J Gordon, Gerald Cochran, Daniel C Malone, Courtney C Kuza, Walid F Gellad
Journal: PLOS ONE
Accepted: 2020-06-25T00:00:00Z

Objective: To develop and validate a machine-learning algorithm to improve prediction of incident OUD diagnosis among Medicare beneficiaries with ≥1 opioid prescriptions. Methods: This prognostic study included 361,527 fee-for-service Medicare beneficiaries, without cancer, filling ≥1 opioid prescriptions from 2011–2016. We randomly divided beneficiaries into training, testing, and validation samples. We measured 269 potential predictors including socio-demographics, health status, patterns of opioid use, and provider-level and regional-level factors in 3-month periods, starting from three months before initiating opioids until development of OUD, loss of follow-up or end of 2016. The primary outcome was a recorded OUD diagnosis or initiating methadone or buprenorphine for OUD as proxy of incident OUD. We applied elastic net, random forests, gradient boosting machine, and deep neural network to predict OUD in the subsequent three months. We assessed prediction performance using C-statistics and other metrics (e.g., number needed to evaluate to identify an individual with OUD [NNE]). Beneficiaries were stratified into subgroups by risk-score decile. Results: The training (n = 120,474), testing (n = 120,556), and validation (n = 120,497) samples had similar characteristics (age ≥65 years = 81.1%; female = 61.3%; white = 83.5%; with disability eligibility = 25.5%; 1.5% had incident OUD). In the validation sample, the four approaches had similar prediction performances (C-statistic ranged from 0.874 to 0.882); elastic net required the fewest predictors (n = 48). Using the elastic net algorithm, individuals in the top decile of risk (15.8% [n = 19,047] of validation cohort) had a positive predictive value of 0.96%, negative predictive value of 99.7%, and NNE of 104. Nearly 70% of individuals with incident OUD were in the top two deciles (n = 37,078), having highest incident OUD (36 to 301 per 10,000 beneficiaries). Individuals in the bottom eight deciles (n = 83,419) had minimal incident OUD (3 to 28 per 10,000). Conclusions: Machine-learning algorithms improve risk prediction and risk stratification of incident OUD in Medicare beneficiaries.
Effects of preferred music on physiological responses, perceived exertion, and anaerobic threshold determination in an incremental running test on both sexes
Authors: Felipe Marroni Rasteiro, Leonardo Henrique Dalcheco Messias, Pedro Paulo Menezes Scariot, João Pedro Cruz, Rafael Lucas Cetein, Claudio Alexandre Gobatto, Fúlvia Barros Manchado-Gobatto
Journal: PLOS ONE
Accepted: 2020-07-23T00:00:00Z


This study aimed to investigate and compare the effects of preferred music on anaerobic threshold determination in an incremental running test, as well the physiological responses and perceived exertion at this intensity, in physically active men and women. Additionally, by using area under the curve (AUC) analysis of the parameters of interest during the graded test, we studied the effects of music at two physiological moments—before and after anaerobic threshold intensity (iAT)—in men and women. Twenty (men = 10; women = 10) healthy and active participants completed four visits to the laboratory. The first and second sessions were used for sample characterization. In the third and fourth sessions, participants performed an incremental running test (started at 7 km.h-1 with increments of 1 km.h-1 at each 3-minute stage) under preferred music and non-music conditions. Blood lactate ([Lac]), heart rate (HR), and perceived exertion were measured by two scales (RPEBorg and the estimation of time limit ‒ ETL) during all tests, and the total time of effort (TT) was considered as performance. Individual curves of the “intensity vs blood lactate” analyzed by the bissegmentation method provide the iAT and the AUC of [Lac], HR, RPEBorg, and ETL before and after the iAT attainment were calculated. The iAT for men (non-music: 11.5±0.9km.h-1 vs music: 11.6±1.1km.h-1) and women (non-music: 9.8±0.7km.h-1 vs music: 9.7±0.7km.h-1) was not affected by music, and for both sexes, there was no difference between non-music and music conditions in all variables obtained at iAT. The AUC of all variables were not affected by music before the iAT attainment. However, [Lac], HR, and RPEBorg presented higher values of AUC after iAT for the female group with preferred music. This may be due to the fact that 70% of women have increased TT under music conditions. Overall, preferred music did not affect the iAT determination in an incremental running test. However, some physiological responses and perceived exertion after iAT of female subjects seems to be influenced by preferred music.
To what extent naringenin binding and membrane depolarization shape mitoBK channel gating—A machine learning approach
Authors: Monika Richter-Laskowska, Paulina Trybek, Piotr Bednarczyk, Agata Wawrzkiewicz-Jałowiecka
Journal: PLOS Computational Biology
Accepted: 2022-06-16T00:00:00Z


The large conductance voltage- and Ca2+-activated K+ channels from the inner mitochondrial membrane (mitoBK) are modulated by a number of factors. Among them flavanones, including naringenin (Nar), arise as a promising group of mitoBK channel regulators from a pharmacological point of view. It is well known that in the presence of Nar the open state probability (pop) of mitoBK channels significantly increases. Nevertheless, the molecular mechanism of the mitoBK-Nar interactions remains still unrevealed. It is also not known whether the effects of naringenin administration on conformational dynamics can resemble those which are exerted by the other channel-activating stimuli. In aim to answer this question, we examine whether the dwell-time series of mitoBK channels which were obtained at different voltages and Nar concentrations (yet allowing to reach comparable pops) are discernible by means of artificial intelligence methods, including k-NN and shapelet learning. The obtained results suggest that the structural complexity of the gating dynamics is shaped both by the interaction of channel gate with the voltage sensor (VSD) and the Nar-binding site. For a majority of data one can observe stimulus-specific patterns of channel gating. Shapelet algorithm allows to obtain better prediction accuracy in most cases. Probably, because it takes into account the complexity of local features of a given signal. About 30% of the analyzed time series do not sufficiently differ to unambiguously distinguish them from each other, which can be interpreted in terms of the existence of the common features of mitoBK channel gating regardless of the type of activating stimulus. There exist long-range mutual interactions between VSD and the Nar-coordination site that are responsible for higher levels of Nar-activation (Δpop) at deeply depolarized membranes. These intra-sensor interactions are anticipated to have an allosteric nature.
Author summary: The large conductance voltage- and Ca2+-activated K+ channels from the inner mitochondrial membrane (mitoBK) are modulated by a number of factors, including flavanones like naringenin (Nar). In the presence of Nar the open state probability (pop) of mitoBK channels significantly increases, however the molecular mechanism of the mitoBK-Nar interactions remains still unrevealed. It is also not known whether the effects of naringenin administration on channel gating can accurately mimic the dynamical consequences exerted by other channel-activating stimuli. In order to answer this question, we examine whether the dwell-time series describing the mitoBK channel activity obtained at different voltages (Um) and Nar concentrations are discernible by means of artificial intelligence (AI) methods (k-NN, shapelet learning). The key inferences from the current study are as follows:
Visual attention towards food during unplanned purchases – A pilot study using mobile eye tracking technology
Authors: Gerrit Hummel, Saskia Maier, Maren Baumgarten, Cora Eder, Patrick Thomas Strubich, Nanette Stroebele-Benschop
Journal: PLOS ONE
Accepted: 2021-02-14T00:00:00Z


This pilot study aims to investigate the relationships between consumers’ weight status, energy density of food and visual attention towards food during unplanned purchase behavior in a real-world environment. After more than a decade of intensive experimental eye tracking research on food perception, this pilot study attempts to link experimental and field research in this area. Shopping trips of participants with different weight status were recorded with mobile eye tracking devices and their unplanned purchase behavior was identified and analyzed. Different eye movement measurements for initial orientation and maintained attention were analyzed. Differences in visual attention caused by energy density of food were found. There was a tendency across all participants to look at low energy density food longer and more often.
Effects of word familiarity and receptive vocabulary size on speech-in-noise recognition among young adults with normal hearing
Authors: Meredith D Braza, Heather L Porter, Emily Buss, Lauren Calandruccio, Ryan W McCreery, Lori J Leibold
Journal: PLOS ONE
Accepted: 2022-02-11T00:00:00Z


Having a large receptive vocabulary benefits speech-in-noise recognition for young children, though this is not always the case for older children or adults. These observations could indicate that effects of receptive vocabulary size on speech-in-noise recognition differ depending on familiarity of the target words, with effects observed only for more recently acquired and less frequent words. Two experiments were conducted to evaluate effects of vocabulary size on open-set speech-in-noise recognition for adults with normal hearing. Targets were words acquired at 4, 9, 12 and 15 years of age, and they were presented at signal-to-noise ratios (SNRs) of -5 and -7 dB. Percent correct scores tended to fall with increasing age of acquisition (AoA), with the caveat that performance at -7 dB SNR was better for words acquired at 9 years of age than earlier- or later-acquired words. Similar results were obtained whether the AoA of the target words was blocked or mixed across trials. Differences in word duration appear to account for nonmonotonic effects of AoA. For all conditions, a positive correlation was observed between recognition and vocabulary size irrespective of target word AoA, indicating that effects of vocabulary size are not limited to recently acquired words. This dataset does not support differential assessment of AoA, lexical frequency, and other stimulus features known to affect lexical access.
Deep learning for 1-bit compressed sensing-based superimposed CSI feedback
Authors: Chaojin Qing, Qing Ye, Bin Cai, Wenhui Liu, Jiafan Wang
Journal: PLOS ONE
Accepted: 2022-02-23T00:00:00Z


In frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems, 1-bit compressed sensing (CS)-based superimposed channel state information (CSI) feedback has shown many advantages, while still faces many challenges, such as low accuracy of the downlink CSI recovery and large processing delays. To overcome these drawbacks, this paper proposes a deep learning (DL) scheme to improve the 1-bit compressed sensing-based superimposed CSI feedback. On the user side, the downlink CSI is compressed with the 1-bit CS technique, superimposed on the uplink user data sequences (UL-US), and then sent back to the base station (BS). At the BS, based on the model-driven approach and assisted by the superimposition-interference cancellation technology, a multi-task detection network is first constructed for detecting both the UL-US and downlink CSI. In particular, this detection network is jointly trained to detect the UL-US and downlink CSI simultaneously, capturing a globally optimized network parameter. Then, with the recovered bits for the downlink CSI, a lightweight reconstruction scheme, which consists of an initial feature extraction of the downlink CSI with the simplified traditional method and a single hidden layer network, is utilized to reconstruct the downlink CSI with low processing delay. Compared with the 1-bit CS-based superimposed CSI feedback scheme, the proposed scheme improves the recovery accuracy of the UL-US and downlink CSI with lower processing delay and possesses robustness against parameter variations.
Likes and impulsivity: Investigating the relationship between actual smartphone use and delay discounting
Authors: Tim Schulz van Endert, Peter N C Mohr
Journal: PLOS ONE
Accepted: 2020-10-13T00:00:00Z


The omnipresence of smartphones among adolescents and adults gives rise to the questions about excessive use and personality factors which are associated with heavier engagement with these devices. Previous studies have found behavioral similarities between smartphone use and maladaptive behaviors (e.g. drinking, gambling, drug abuse) in the context of intertemporal choice but mostly relied on participants’ self-reports regarding engagement with their phone. In this study, we collected actual usage data by smartphone application from 101 participants and assessed their tendency to discount future rewards, their reward responsiveness, self-control and consideration of future consequences. We found that smartphone screen time was correlated with choosing smaller immediate over larger delayed rewards and that usage of social media and gaming apps predicted delay discounting. Additionally, smartphone use was negatively correlated with self-control but not correlated with consideration of future consequences. Neither psychological variable could mediate the relationship between smartphone usage and delay discounting. Our findings provide further evidence that smartphone use and impulsive decision-making go hand in hand and that engagement with these devices needs to be critically examined by researchers to guide prudent behavior.
Effects of compression garment on muscular efficacy, proprioception, and recovery after exercise-induced muscle fatigue onset for people who exercise regularly
Authors: Wei-Hsien Hong, Sui-Foon Lo, Hsin-Chieh Wu, Min-Chi Chiu
Journal: PLOS ONE
Accepted: 2022-02-11T00:00:00Z


Fatigue is a major cause of exercise-induced muscle damage (EIMD). Compression garments (CGs) can aid post-exercise recovery, therefore, this study explored the effects of CGs on muscular efficacy, proprioception, and recovery after exercise-induced muscle fatigue in people who exercise regularly. Twelve healthy participants who exercised regularly were enrolled in this study. Each participant completed an exercise-induced muscle fatigue test while wearing a randomly assigned lower-body CG or sports pants (SP); after at least 7 days, the participant repeated the test while wearing the other garment. The dependent variables were muscle efficacy, proprioception (displacements of center of pressure/COP, and absolute error), and fatigue recovery (muscle oxygen saturation/SmO2, deoxygenation and reoxygenation rate, and subjective muscle soreness). A two-way repeated measure analysis of variance was conducted to determine the effect of garment type. The results indicated that relative to SP use, CG use can promote muscle efficacy, proprioception in ML displacement of COP, and fatigue recovery. Higher deoxygenation and reoxygenation rates were observed with CG use than with SP use. For CG use, SmO2 quickly returned to baseline value after 10 min of rest and was maintained at a high level until after 1 h of rest, whereas for SP use, SmO2 increased with time after fatigue onset. ML displacement of COP quickly returned to baseline value after 10 min of rest and subsequently decreased until after 1 hour of rest. Relative to SP use, CG use was associated with a significantly lower ML displacement after 20 min of rest. In conclusion, proprioception and SmO2 recovery was achieved after 10 min of rest; however, at least 24 h may be required for recovery pertaining to muscle efficacy and soreness regardless of CG or SP use.
Development of the automated software and device for determination of wicking in textiles using open-source tools
Authors: Predrag M Milanovic, Snezana B Stankovic, Milada Novakovic, Dragana Grujic, Mirjana Kostic, Jovana Z Milanovic
Journal: PLOS ONE
Accepted: 2020-10-19T00:00:00Z


The development of automated software and the device for determination of wicking of textile materials, using open-source ImageJ libraries for image processing, and newly designed additional algorithm for the determination of threshold, is presented in this paper. The description of the device, design of the open-source software “Kapilarko”, as well as an explanation of the steps: image processing, threshold determination and reading of wicking height, are provided. We have also investigated the possibility of using the artificial neural networks for automatic recognition of the wicking height. The results showed that the recognition of the wet area of the sample, based on the application of artificial neural networks was in a very good agreement with the experimental data. The device's utility for the measurement of wicking ability of textile materials was proved by testing various knitted fabrics. The constructed device has the advantages of providing automated measurement and minimization of the subjective errors of the operators; extremely fast or long-term measurements; digital recording of results; consistency of experimental conditions; possibility of using water instead of colors and, last but not least, low cost of the device. Considering the importance and frequent measurements of wicking ability of textile materials, the advantages of the presented device, as well as the fact that commercial software without publishing the source-code, are used for most of the available devices, we believe that our idea to design the automated software and device by applying the "open-source" approach, will be of benefit to scientists and engineers in using or improving wicking experiments.