Miracle-dz/UniFAR-FTUs huggingface dataset:
Online Bootstrap Inference For Policy Evaluation In Reinforcement Learning

Abstract The recent emergence of reinforcement learning (RL) has created a demand for robust statistical inference methods for the parameter estimates computed using these algorithms. Existing methods for inference in online learning are restricted to settings involving independently sampled observations, while inference methods in RL have so far been limited to the batch setting. The bootstrap is a flexible and efficient approach for statistical inference in online learning algorithms, but its efficacy in settings involving Markov noise, such as RL, has yet to be explored. In this article, we study the use of the online bootstrap method for inference in RL policy evaluation. In particular, we focus on the temporal difference (TD) learning and Gradient TD (GTD) learning algorithms, which are themselves special instances of linear stochastic approximation under Markov noise. The method is shown to be distributionally consistent for statistical inference in policy evaluation, and numerical experiments are included to demonstrate the effectiveness of this algorithm across a range of real RL environments. Supplementary materials for this article are available online.
Understanding LuxS-based quorum sensing and its inhibition – molecular dynamics simulation study

Abstract Molecular dynamics simulations were successfully applied to LuxS protein and its protein–ligand complex using the newly developed force field parameters for the iron containing active site. To the best of our knowledge, this was the first attempt to develop force field parameters for the iron containing active site of the LuxS protein. From the simulations, catalytically important amino acid residues were identified which were found to stabilise the ligand. Two residues Glu57 and Asp77 were involved in polar interactions while the protein region in the range between amino acid residue 125 and 131 were predicted to facilitate the entry of ligand to the active site. Other residues like Arg65, Asp77, Ile78 and Ser79 were also recognised as ligand stabilising factors deduced from the simulation. These results were also found to be in good agreement with earlier studies and thus demonstrated the successful application of MD simulations to the LuxS protein. Moreover, the simulation data were expected to be considered for the development of rational approaches in order to identify new LuxS-based quorum sensing antagonists for the treatment of pathologies caused by resistant bacteria.
Intelligent Monitoring of Stress Induced by Water Deficiency in Plants Using Deep Learning

In the recent decade, high-throughput plant phenotyping techniques, which combine noninvasive image analysis and machine learning, have been successfully applied to identify and quantify plant health and diseases. However, these techniques usually do not consider the progressive nature of plant stress and often require images showing severe signs of stress to ensure high confidence detection, thereby reducing the feasibility for early detection and recovery of plants under stress. To overcome the problem mentioned above, we propose a deep learning pipeline for the temporal analysis of the visual changes induced in the plant due to stress and apply it to the specific water stress identification case in Chickpea plant shoot images. For this, we have considered an image dataset of two chickpea varieties JG-62 and Pusa-372, under three water stress conditions: control, young seedling, and before flowering, captured over five months. We have employed a variant of convolutional neural network-long short-term memory (CNN-LSTM) network to learn spatiotemporal patterns from the chickpea plant dataset and use them for water stress classification. Our model has achieved ceiling level classification performance of 98.52% on JG-62 and 97.78% on Pusa-372 chickpea plant data and has outperformed the best reported time-invariant technique by at least 14% for both JG-62 and Pusa-372 species to the best of our knowledge. Furthermore, our CNN-LSTM model has demonstrated robustness to noisy input, with a less than 2.5% dip in average model accuracy and a small standard deviation about the mean for both species. Finally, we have performed an ablation study to analyze the performance of the CNN-LSTM model by decreasing the number of temporal session data used for training.
Blind Source Separation in Polyphonic Music Recordings Using Deep Neural Networks Trained via Policy Gradients

We propose a method for the blind separation of sounds of musical instruments in audio signals. We describe the individual tones via a parametric model, training a dictionary to capture the relative amplitudes of the harmonics. The model parameters are predicted via a U-Net, which is a type of deep neural network. The network is trained without ground truth information, based on the difference between the model prediction and the individual time frames of the short-time Fourier transform. Since some of the model parameters do not yield a useful backpropagation gradient, we model them stochastically and employ the policy gradient instead. To provide phase information and account for inaccuracies in the dictionary-based representation, we also let the network output a direct prediction, which we then use to resynthesize the audio signals for the individual instruments. Due to the flexibility of the neural network, inharmonicity can be incorporated seamlessly and no preprocessing of the input spectra is required. Our algorithm yields high-quality separation results with particularly low interference on a variety of different audio samples, both acoustic and synthetic, provided that the sample contains enough data for the training and that the spectral characteristics of the musical instruments are sufficiently stable to be approximated by the dictionary.
A distinct ssDNA/RNA binding interface in the Nsp9 protein from SARS‐CoV‐2

Severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) is a novel, highly infectious RNA virus that belongs to the coronavirus family. Replication of the viral genome is a fundamental step in the virus life cycle and SARS‐CoV‐2 non‐structural protein 9 (Nsp9) is shown to be essential for virus replication through its ability to bind RNA in the closely related SARS‐CoV‐1 strain. Two recent studies revealing the three‐dimensional structure of Nsp9 from SARS‐CoV‐2 have demonstrated a high degree of similarity between Nsp9 proteins within the coronavirus family. However, the binding affinity to RNA is very low which, until now, has prevented the determination of the structural details of this interaction. In this study, we have utilized nuclear magnetic resonance spectroscopy (NMR) in combination with surface biolayer interferometry (BLI) to reveal a distinct binding interface for both ssDNA and RNA that is different to the one proposed in the recently solved SARS‐CoV‐2 replication and transcription complex (RTC) structure. Based on these data, we have proposed a structural model of a Nsp9‐RNA complex, shedding light on the molecular details of these important interactions.
Stimulated Emission with Nearly 100% Circular Polarization at RT in GaAs-based DHs with Fe/Crystalline AlO X Spin Injectors

We report the realization of room-temperature (RT) electroluminescence (EL) with circular polarization (CP) of PEL = 0.987 in lateral-type spin-LEDs consisting of Fe (in-plane M)/ -like AlOx tunnel contacts formed on AlGaAs/GaAs double heterostructures (DHs). The outstandingly high P value, suggesting the birth of a new light source, is inferred to result from stimulated emission occurring at relatively high current density of J  100 A/cm 2 . Newly developed Fe/-like AlOx contacts seem to contribute significantly on stable charge/spin injection, making it possible to carry out reliable and systematic experiments. Our achievement indicates demonstration of new functionality at RT based on spin injection in semiconductors for the first time.
Vitamin K Intake and Atherosclerotic Cardiovascular Disease in the Danish Diet Cancer and Health Study

Background Dietary vitamin K (K1 and K2) may reduce atherosclerotic cardiovascular disease (ASCVD) risk via several mechanisms. However, studies linking vitamin K intake with incident ASCVD are limited. We aimed to determine the relationship between dietary vitamin K intake and ASCVD hospitalizations. Methods and Results In this prospective cohort study, participants from the Danish Diet, Cancer, and Health Study, with no prior ASCVD, completed a food‐frequency questionnaire at baseline and were followed up for hospital admissions of ASCVD; ischemic heart disease, ischemic stroke, or peripheral artery disease. Intakes of vitamin K1 and vitamin K2 were estimated from the food‐frequency questionnaire, and their relationship with ASCVD hospitalizations was determined using Cox proportional hazards models. Among 53 372 Danish citizens with a median (interquartile range) age of 56 (52–60) years, 8726 individuals were hospitalized for any ASCVD during 21 (17–22) years of follow‐up. Compared with participants with the lowest vitamin K1 intakes, participants with the highest intakes had a 21% lower risk of an ASCVD‐related hospitalization (hazard ratio, 0.79; 95% CI: 0.74–0.84), after multivariable adjustments for relevant demographic covariates. Likewise for vitamin K2, the risk of an ASCVD‐related hospitalization for participants with the highest intakes was 14% lower than participants with the lowest vitamin K2 intake (hazard ratio, 0.86; 95% CI, 0.81–0.91). Conclusions Risk of ASCVD was inversely associated with diets high in vitamin K1 or K2. The similar inverse associations with both vitamin K1 and K2, despite very different dietary sources, highlight the potential importance of vitamin K for ASCVD prevention.
Effect of white tea consumption on serum leptin, TNF-α and UCP1 gene expression in ovariectomized rats

Obesity and dyslipidemia due to estrogen deficiency are among the important health problems in menopausal women. Increasing evidence reports the anti-obesity and anti-hyperlipidemic properties of tea polyphenols. However, the effect of white tea (WT) with high polyphenol content on overweight and lipid profile is uncertain. Here, we aimed to examine the effects of long-term WT consumption on serum leptin, tumor necrosis factor- alpha (TNF-α) and uncoupling protein 1 (UCP1) mRNA gene expression in ovariectomized (OVX) rats. Adult rats were divided into four groups (n = 8): (i) sham, (ii) OVX, (iii) WT and (iv) OVX + WT. WT was given at a dose of 0.5% w/v for 12 weeks. In the study, body weight, serum leptin, TNF, estradiol (E2) levels, lipid profile and UCP1 mRNA gene expression in brown adipose tissue (BAT) were evaluated. There was a significant increase in body weight of OVX rats, which was decreased following WT consumption. While leptin and E2 levels decreased in the OVX group, TNF levels increased. There was no difference between the NF-κB levels of the groups. In addition, BAT UCP1 mRNA expression was significantly decreased in OVX groups, while WT treatment stimulated UCP1 activity. We explain the stimulatory effect of WT on weight loss mainly by the induction of UCP1 gene-mediated thermogenesis and suppression of inflammation. Therefore, we suggest that prolonged WT consumption may have beneficial effects in limiting excess weight gain caused by estrogen deficiency.
Letter to “Intralipid infusion at time of embryo transfer in women with history of recurrent implantation failure: A systematic review and meta‐analysis”

Dear Editor I read this article titled, “Intralipid infusion at time of embryo transfer in women with history of recurrent implantation failure: A systematic review and metaanalysis,” which was recently published in the Journal of Obstetrics and Gynaecology Research, with interest. Intravenous lipid emulsions, which include Intralipid, SMOFlipid, and fish oil-based lipid emulsion, are used for parenteral nutrition, dissolution of drugs (propofol and etomidate), and treatment of drug toxicity induced by local anesthetic or non-local anesthetic drugs. Intralipid has an effect on the pregnancy of patients with reproductive failure and increased natural killer cell cytotoxicity as intravenous immunoglobulin. Systemic review and meta-analysis suggest that there are limited evidences showing that lipid emulsion increases clinical pregnancy. However, according to a meta-analysis study, 20% Intralipid (100 mL) had a tendency to increase clinical pregnancy; however, the increase was not significant compared with control. In addition, 20% Intralipid (2 mL) diluted in normal saline (250 mL) did not affect the frequency of chemical pregnancy. The 20% Intralipid (100 mL) diluted into normal saline (500 mL) was administered for over 2.5 h to patients with lipid emulsion in a meta-analysis study. An admixture (1:1 ratio) of Intralipid and normal saline in one container resulted in a decrease in pH from 7 to 5.1 and increased the size of lipid globule after 24 h of the mixture, indicating incompatibility. Thus, an admixture (presumed dilution ratio 1:5) of Intralipid and normal saline intravenously administered over two and half hours in a container may alter the physiochemical properties of Intralipid, affecting the results of the study. It would be better to intravenously administer either 20% Intralipid alone or a mixture of 20% Intralipid and normal saline using three-way stopcock to conjoin the two separate intravenous lines. Conflict of Interest
Out-of-hospital cardiac arrest in countries of the Gulf Cooperation Council: a scoping review.

Background Published data are lacking on response to and outcomes of out-of-hospital cardiac arrest in the Middle East. What data there are have not been comprehensively analysed. Aims This study aimed to assess the characteristics of people with out-of-hospital cardiac arrest in Gulf Cooperation Council (GCC) countries (Bahrain, Kuwait, Oman, Qatar, Saudi Arabia and United Arab Emirates) and the response to and outcomes of such incidents. Methods This was a scoping review of published and grey literature on out-of-hospital cardiac arrest in GCC countries from 1990 to June 2019. Studies in English and Arabic were eligible for inclusion. MEDLINE, CINAHL, Web of Science and EMBASE were searched as well as relevant non-indexed journals. Google searches were also done. References of included studies were scanned for relevant articles. Experts on the subject in the region were consulted. Results Of 647 citations retrieved, 24 studies were included for data extraction and analysis. No literature was identified for Bahrain. People with out-of-hospital cardiac arrest in the region were younger, predominantly male and had more comorbidity than reported in other regions of the world. Use of emergency medical services was low across the GCC countries, as was bystander cardiopulmonary resuscitation, return of spontaneous circulation and survival to discharge. Conclusions A coordinated effort to address out-of-hospital cardiac arrest, including the generation of research, is lacking within and among GCC countries. Establishment of lead agencies responsible for developing and coordinating strategies to address out-of-hospital cardiac arrest, such as community response, public education and reporting databases, is recommended.
Genome-wide association study and pathway analysis for carcass fatness in Nellore cattle measured by ultrasound.

Identifying genes or genomic regions influencing carcass-quality traits such as fatness (FTN) is essential to optimize the genetic selection processes in beef cattle. The aim of this study was to identify genomic regions associated with FTN in Nellore cattle as well as to elucidate the metabolic pathways related to the phenotypic expression. Ultrasound-based measurements of FTN were collected in 11 750 animals, with 39 903 animals in the pedigree file. Additionally, 1440 animals were genotyped using the GGP-indicus 35K SNP panel, which contained 33 623 SNPs after quality control. Twenty genes related to FTN were found on 11 chromosomes, explaining 12.96% of the total additive genetic variance. Gene ontology revealed seven genes: NR1L2, PKD2, GSK3β, EXT1, RAD51B, SORCS1 and DPH6, associated with important processes related to FTN. In addition, novel candidate genes (MAATS1, LYPD1, CDK5RAP2, RAD51B, c13H2Oorf96 and TRAPPC11) were detected and could provide further knowledge to uncover genetic regions associated to carcass fatness in beef cattle.
Communicating about Mental Health with Youth and Their Families: A Scoping Review of Best Practices and Implications for Youth with Disabilities

ABSTRACT Minimal attention has been placed on supporting the mental health needs of youth with disabilities. Due to a dearth of research on best practices in mental health communication with youth with disabilities, the aim of the scoping review was to identify existing peer-reviewed evidence regarding mental health communication for the general youth population in clinical settings. Three electronic databases were searched. Inclusion criteria were: 1) published in English between 2009 and 2019; 2) children and youth and/or their parents/caregivers; 3) addressed communication-based mental health practices; 4) based in pediatric health care settings. Seven articles were included. Promoting autonomy and engagement, building collaboration and trust, and supplementing conversations with alternative communication approaches were identified as important for having mental health conversations. While implications can be drawn, more work is needed for clinicians to have a rigorous evidence base to draw upon when having these conversations with youth with disabilities.
Treatment Outcomes of IL-17 Inhibitors in Hidradenitis Suppurativa: A Systematic Review

The IL-17 pathway is a potential therapeutic target shown to be implicated in hidradenitis suppurativa (HS), however, it remains unclear whether evidence from mechanistic studies may translate into clinical practice. This systematic review summarizes available treatment outcomes of IL-17 inhibitors in patients with HS. Embase, MEDLINE, PubMed, and clinicaltrials.gov were comprehensively searched on February 26, 2021 to include 16 original studies representing 128 patients with HS (mean age: 36.5 years; age range: 21-47 years; male: 50.0%). Treatment outcomes were reported for the following biologics: secukinumab (n = 105), brodalumab (n = 22), and ixekizumab (n = 1). Patients were classified as responders or non-responders according to achievement of a positive response/improvement based on criteria established for each included study. For secukinumab 57.1% (n = 60/105) of patients were responders in a mean response period of 16.2 weeks and 42.9% (n = 45/105) were non-responders; for brodalumab, 100.0% (n = 22/22) of patients were responders within 4.4 weeks; and the one patient treated with ixekizumab was a responder within 10 weeks. In conclusion, IL-17 inhibitors may serve as an effective therapeutic target in approximately two-thirds of patients with HS and can be considered in those who are refractory to other treatment modalities. We also stress the importance of consistent outcome measures to enhance evidence synthesis, decrease reporting bias, provide potential for future meta-analysis, and ultimately improve clinical outcomes for patients with HS.
Genomic analysis reveals a rapid spread and predominance of lambda (C.37) SARS‐COV‐2 lineage in Peru despite circulation of variants of concern

The pandemic generated by SARS‐Cov‐2 has caused a large number of cases and deaths in the world, but South America has been one of the continents that were most hard hit. The appearance of new variants causes concern because of the possibility that they may evade the protection generated by vaccination campaigns, their greater capacity to be transmitted, or their higher virulence. We analyzed the circulating variants in Peru after improving our Genomic Surveillance program. The results indicate a steep increase of the lambda lineage (C.37) until becoming predominant between January and April 2021, despite the cocirculation of other variants of concern or interest. Lambda lineage deserves close monitoring and could probably become a variant of concern in the near future.
Modulating response of sunflower (Hellianthus annuus) to induced salinity stress through application of engineered urea functionalized hydroxyapatite nanoparticles

Agro‐nanotechnology aims to improve the quality and quantity of plants and plant products while preserving environmental health. Contemporary anecdotal studies that provide representation of the use of nanostructures as fertilizers, pesticides, and plant growth regulators have highlighted the need to determine the effect of such modified nanofertilizers on transforming plant yield under abiotic stress. Present study was performed to modulate the physiological response of Hellianthus annuus through the application of Urea capped hydroxyapatite nanoparticles (Urea‐HANPs) in stressed environment. Hydroxyapatite nanoparticles were synthesized via co‐precipitation method, functionalized with urea and characterized through a series of contemporary techniques of transmission electron microscopy (TEM), energy dispersive X‐ray spectroscopy (EDX), X‐ray diffraction (XRD), and Fourier transform infrared (FTIR) spectroscopy. We observed that Urea‐HANPs significantly (p < .05) ameliorated resistivity in plant to osmotic stress by enhancing agronomic and physiobiochemical attributes. Elevated chlorophyll contents were reported from tested leaves treated with Urea‐HANPs in T6 (0.05 M NaCl + 10 μg/ml Urea‐HANP) under induced salinity stress. Data revealed significant decrease in osmolytes at T3 (0.1 M NaCl), and T4 (0.2 M NaCl) which was significantly ameliorated in T9 (0.1 M NaCl + 10 μg/ml Urea‐HANPs) and T12 (0.2 M NaCl + 10 μg/ml Urea‐HANPs). The antioxidant system was boosted up by the application of Urea‐HANPs preventing the plant from oxidative stress by scavenging reactive oxygen species (ROS). It has been concluded that alleviation in impact of osmotic stress on plant through the use of Urea‐HANPs was coupled with elevation in photosynthetic performance, stimulation of osmolytes and boosting antioxidant system of plants.
Chemotherapy-related cognitive impairment (CRCI) among early-stage breast cancer survivors in Malaysia

ABSTRACT Introduction: Breast cancer survivors frequently develop cognitive impairment following chemotherapy which can significantly hamper their well-being, ability to function independently, and overall quality of life. Evidence of cognitive functioning in breast cancer survivors from lower and middle-income countries remains scarce. We examined the prevalence of cognitive impairment among Malaysian multiethnic early-stage breast cancer survivors one to three years post-chemotherapy. Methods: This cross-sectional study included 160 breast cancer survivors from the University Malaya Medical Center (UMMC). The cognitive assessments used included the Montreal Cognitive Assessment (MoCA-BM), the Rey Auditory and Verbal Learning Test (RAVLT-BM), and the digit span and arithmetic of the Working Memory Index (WMI) of Wechsler Adult Intelligence Scale-IV (WAIS-IV). Data were analyzed using independent sample t-tests and Pearson’s correlation. Results: Our breast cancer survivors demonstrated poor performances in MoCA-BM (31.9%) RAVLT-BM, recall (53.8%), and WMI of WAIS-IV (51.3%) with 30.6% of them performed poorly in all three cognitive tests administered. There were no significant mean group differences in cognitive performances between <24 months after chemotherapy and ≥24 months after chemotherapy. Conclusions: A high proportion of breast cancer survivors exhibited poor performances in the cognitive assessments. Cognitive rehabilitation programmes tailored to the needs of these survivors should be incorporated into cancer care management.