Miracle-dz/UniFAR-FTUs huggingface dataset:
Fixing Weight Decay Regularization in Adam

We note that common implementations of adaptive gradient algorithms, such as Adam, limit the potential benefit of weight decay regularization, because the weights do not decay multiplicatively (as would be expected for standard weight decay) but by an additive constant factor. We propose a simple way to resolve this issue by decoupling weight decay and the optimization steps taken w.r. t. the loss function. We provide empirical evidence that our proposed modification (i) decouples the optimal choice of weight decay factor from the setting of the learning rate for both standard SGD and Adam, and (ii) substantially improves Adam's generalization performance, allowing it to compete with SGD with momentum on image classification datasets (on which it was previously typically outperformed by the latter). We also demonstrate that longer optimization runs require smaller weight decay values for optimal results and introduce a normalized variant of weight decay to reduce this dependence. Finally, we propose a version of Adam with warm restarts (AdamWR) that has strong anytime performance while achieving state-of-the-art results on CIFAR-10 and ImageNet32x32. Our source code will become available after the review process.
Pregnancy loss and risk of ischaemic stroke and myocardial infarction

We investigated whether pregnancy loss increases the risk of arterial thrombosis in young women. Women (age 18–50 years) with ischaemic stroke (IS) or myocardial infarction (MI) and at least one pregnancy were compared for pregnancy loss in a control group. Odds ratios (OR) with 95% confidence intervals (CI), adjusted for matching variables, cardiovascular risk factors, cardiovascular family history and the presence of antiphospholipid antibodies, were calculated for the number of pregnancy losses as well as the type of unsuccessful pregnancy (early miscarriage, late miscarriage and stillbirth). 165 IS cases, 218 MI cases and 743 controls were included. Women with multiple (≥3) pregnancy loss had a doubled risk of arterial thrombosis (OR 2·37, 95%CI 0·99–5·70) compared with women without pregnancy loss, similarly to women who experienced stillbirth (OR 1·68, 95%CI 0·79–3·55). Both relative risks were higher for IS (OR 3·51, 95%CI 1·08–11·35 and 2·06, 95%CI 0·81–5·23, respectively) than for MI (OR 2·04, 95%CI 0·71–5·86 and 1·04, 95%CI 0·39–2·79). Adjustment for antiphospholipid antibodies did not affect the estimates. Multiple pregnancy loss and stillbirth increases the risk of IS and, to a lesser extent, of MI, even when other cardiovascular risk factors and antiphospholipid antibodies are accounted for.
Variety in vegetable and fruit consumption and the risk of gastric and esophageal cancer in the European prospective investigation into cancer and nutrition

Diets high in vegetables and fruits have been suggested to be inversely associated with risk of gastric cancer. However, the evidence of the effect of variety of consumption is limited. We therefore investigated whether consumption of a variety of vegetables and fruit is associated with gastric and esophageal cancer in the European Prospective Investigation into Cancer and Nutrition study. Data on food consumption and follow‐up on cancer incidence were available for 452,269 participants from 10 European countries. After a mean follow‐up of 8.4 years, 475 cases of gastric and esophageal adenocarcinomas (180 noncardia, 185 cardia, gastric esophageal junction and esophagus, 110 not specified) and 98 esophageal squamous cell carcinomas were observed. Diet Diversity Scores were used to quantify the variety in vegetable and fruit consumption. We used multivariable Cox proportional hazard models to calculate risk ratios. Independent from quantity of consumption, variety in the consumption of vegetables and fruit combined and of fruit consumption alone were statistically significantly inversely associated with the risk of esophageal squamous cell carcinoma (continuous hazard ratio per 2 products increment 0.88; 95% CI 0.79–0.97 and 0.76; 95% CI 0.62–0.94, respectively) with the latter particularly seen in ever smokers. Variety in vegetable and/or fruit consumption was not associated with risk of gastric and esophageal adenocarcinomas. Independent from quantity of consumption, more variety in vegetable and fruit consumption combined and in fruit consumption alone may decrease the risk of esophageal squamous cell carcinoma. However, residual confounding by lifestyle factors cannot be excluded.
Twitter-Network Topic Model: A Full Bayesian Treatment for Social Network and Text Modeling

Twitter data is extremely noisy -- each tweet is short, unstructured and with informal language, a challenge for current topic modeling. On the other hand, tweets are accompanied by extra information such as authorship, hashtags and the user-follower network. Exploiting this additional information, we propose the Twitter-Network (TN) topic model to jointly model the text and the social network in a full Bayesian nonparametric way. The TN topic model employs the hierarchical Poisson-Dirichlet processes (PDP) for text modeling and a Gaussian process random function model for social network modeling. We show that the TN topic model significantly outperforms several existing nonparametric models due to its flexibility. Moreover, the TN topic model enables additional informative inference such as authors' interests, hashtag analysis, as well as leading to further applications such as author recommendation, automatic topic labeling and hashtag suggestion. Note our general inference framework can readily be applied to other topic models with embedded PDP nodes.
National Randomized Controlled Trial of Virtual House Calls for People with Parkinson's Disease: Interest and Barriers.

BACKGROUND Delivering specialty care remotely directly into people's homes can enhance access for and improve the healthcare of individuals with chronic conditions. However, evidence supporting this approach is limited. MATERIALS AND METHODS Connect.Parkinson is a randomized comparative effectiveness study that compares usual care of individuals with Parkinson's disease in the community with usual care augmented by virtual house calls with a Parkinson's disease specialist from 1 of 18 centers nationally. Individuals in the intervention arm receive four virtual visits from a Parkinson's disease specialist over 1 year via secure, Web-based videoconferencing directly into their homes. All study activities, including recruitment, enrollment, and assessments, are conducted remotely. Here we report on interest, feasibility, and barriers to enrollment in this ongoing study. RESULTS During recruitment, 11,734 individuals visited the study's Web site, and 927 unique individuals submitted electronic interest forms. Two hundred ten individuals from 18 states enrolled in the study from March 2014 to June 2015, and 195 were randomized. Most participants were white (96%) and college educated (73%). Of the randomized participants, 73% had seen a Parkinson's disease specialist within the previous year. CONCLUSIONS Among individuals with Parkinson's disease, national interest in receiving remote specialty care directly into the home is high. Remote enrollment in this care model is feasible but is likely affected by differential access to the Internet.
Pulmonary Cavity From Mycobacterium malmoense in an HIV-Infected Patient: Complicated by Bronchopleural Fistula

Abstract We present a case of M. malmoense and HIV co-infection complicated by aspergilloma leading to bronchopleural fistula with intractable pneumothorax and pleural aspergillosis, ultimately requiring surgical intervention. Treatment guidelines for M. malmoense are reviewed, literature regarding M. malmoense and HIV co-infection is reviewed, and the epidemiology of M. malmoense in North America is discussed.
Transcrystallization of PTFE fiber/PP composites (I) crystallization kinetics and morphology

Transcrystallization of polypropylene (PP) on the polytetrafluoroethylene (PTFE) fiber was investigated. Both nucleation rate and crystal growth rate were determined by a polarized optical microscope. Based on the theory of heterogeneous nucleation, it has been found that the induction time can correlate well with the nucleation rate in determining the interfacial free energy difference function Δσ. The ratio of Δσ in the bulk matrix to that at the interface is 1.63 which implies the transcrystalline growth is favorable from a thermodynamic point of view. No difference in crystal growth rate of PP has been found in either spherulites or transcrystalline layers. On the basis of regime theory, a transition between regimes II and III was observed at ΔT = 48K. From the morphology studies, it has been found that the thickness of the transcrystalline layer increases with crystallization temperature, from 30 to 120 μm in the temperature range of 110–140°C. The growth of transcrystalline layer is hindered by the spherulites nucleated in the bulk. Moreover, the radius of spherulites adjacent to the transcrystalline layer is much smaller than that distant to the fiber. No significant increase in nucleation density at fiber ends is observed. Effect of internal stresses of fibers on the fiber's nucleating ability is not pronounced. © 1996 John Wiley & Sons, Inc.
The Activin A-Peroxisome Proliferator-Activated Receptor Gamma Axis Contributes to the Transcriptome of GM-CSF-Conditioned Human Macrophages

GM-CSF promotes the functional maturation of lung alveolar macrophages (A-MØ), whose differentiation is dependent on the peroxisome proliferator-activated receptor gamma (PPARγ) transcription factor. In fact, blockade of GM-CSF-initiated signaling or deletion of the PPARγ-encoding gene PPARG leads to functionally defective A-MØ and the onset of pulmonary alveolar proteinosis. In vitro, macrophages generated in the presence of GM-CSF display potent proinflammatory, immunogenic and tumor growth-limiting activities. Since GM-CSF upregulates PPARγ expression, we hypothesized that PPARγ might contribute to the gene signature and functional profile of human GM-CSF-conditioned macrophages. To verify this hypothesis, PPARγ expression and activity was assessed in human monocyte-derived macrophages generated in the presence of GM-CSF [proinflammatory GM-CSF-conditioned human monocyte-derived macrophages (GM-MØ)] or M-CSF (anti-inflammatory M-MØ), as well as in ex vivo isolated human A-MØ. GM-MØ showed higher PPARγ expression than M-MØ, and the expression of PPARγ in GM-MØ was found to largely depend on activin A. Ligand-induced activation of PPARγ also resulted in distinct transcriptional and functional outcomes in GM-MØ and M-MØ. Moreover, and in the absence of exogenous activating ligands, PPARγ knockdown significantly altered the GM-MØ transcriptome, causing a global upregulation of proinflammatory genes and significantly modulating the expression of genes involved in cell proliferation and migration. Similar effects were observed in ex vivo isolated human A-MØ, where PPARγ silencing led to enhanced expression of genes coding for growth factors and chemokines and downregulation of cell surface pathogen receptors. Therefore, PPARγ shapes the transcriptome of GM-CSF-dependent human macrophages (in vitro derived GM-MØ and ex vivo isolated A-MØ) in the absence of exogenous activating ligands, and its expression is primarily regulated by activin A. These results suggest that activin A, through enhancement of PPARγ expression, help macrophages to switch from a proinflammatory to an anti-inflammatory polarization state, thus contributing to limit tissue damage and restore homeostasis.
VISCOUS PROPERTIES OF SYNTHETIC HIGH ALUMINA BLAST FURNACE SLAG

The viscosity of the blast furnace slag, which is greatly influenced by its composition, has to be low at the operating temperature in order to make the slag easy flowing. Such a slag encourages an acceleration of the rate of slag metal reactions/exchanges, thus influencing the efficiency of the blast furnace process. The present project aims at measuring the viscosity of synthetic high alumina Indian blast furnace slags in agreement with the slag compositions encountered in the industries using inner-cylinder-rotating type viscometer (VIS 403). It is observed that the viscosity is greatly influenced by the CaO/ SiO 2 (C/S) ratio, MgO and TiO 2 contents.
Apparent diffusion coefficients in prostate cancer: correlation with molecular markers Ki‐67, HIF‐1α and VEGF

Prostate cancer (PCa) is the second most common cancer in men. The Gleason score (GS) and biomarkers play important roles in the diagnosis and treatment of patients with PCa. The purpose of this study was to investigate the relationship between the apparent diffusion coefficient (ADC) and the molecular markers Ki‐67, hypoxia‐inducible factor‐1α (HIF‐1α) and vascular endothelial growth factor (VEGF) in PCa. Thirty‐nine patients with 39 lesions, who had been diagnosed with PCa, were enrolled in this study. All patients underwent diffusion‐weighted magnetic resonance imaging (DW‐MRI) (b = 800 s/mm2). The expression of Ki‐67, HIF‐1α and VEGF was assessed by immunohistochemistry. Statistical analysis was applied to analyze the association between ADC and prostate‐specific antigen (PSA), GS and the expression of Ki‐67, HIF‐1α and VEGF. The group differences in ADC among different grades of Ki‐67, HIF‐1α and VEGF were also analyzed. The mean ± standard deviation of ADC was (0.76 ± 0.27) × 10−3 mm2/s. ADC correlated negatively with PSA and GS (p < 0.05). The Ki‐67 staining index (SI), HIF‐1α expression and VEGF expression in PCa were correlated inversely with ADC, controlling for age (r = –0.332, p < 0.05; r = −0.662, p < 0.0005; and r = −0.714, p < 0.0005, respectively). ADC showed a significant difference among different grades of Ki‐67 (F = 9.164, p = 0.005), HIF‐1α (F = 40.333, p < 0.0005) and VEGF (F = 22.048, p < 0.0005). In conclusion, ADC was correlated with PSA, GS, and Ki‐67, HIF‐1α and VEGF expression in patients with PCa. ADC may be used to evaluate tumor proliferation, hypoxia and angiogenesis in PCa.
A Comparison of HLA Molecular Mismatch Methods to Determine HLA Immunogenicity

Background Antibody-mediated rejection is a major cause of premature graft loss in kidney transplantation. Multiple scoring systems are available to assess the HLA mismatch between donors and recipients at the molecular level; however, their correlation with the development of de novo donor-specific antibody (dnDSA) has not been compared in recipients on active immunosuppression. Methods HLA-DR&bgr;1/3/4/5/DQ&agr;1&bgr;1 molecular mismatch was determined using eplet analysis, amino acid mismatch, and electrostatic mismatch for 596 renal transplant recipients and correlated with HLA-DR/DQ dnDSA development. The molecular mismatch scores were evaluated in multivariate models of posttransplant dnDSA-free survival. Results Eplet mismatch correlated with amino acid mismatch and electrostatic mismatch (R2 = 0.85-0.96). HLA-DR dnDSA-free survival correlated with HLA-DR eplet mismatch (hazards ratio [HR], 2.50 per 10 eplets mismatched; P < 0.0001), amino acid mismatch (HR, 1.49 per 10 amino acids mismatched; P < 0.0001), and electrostatic mismatch (HR, 1.23 per 10 units mismatched; P < 0.0001). HLA-DQ dnDSA-free survival correlated with HLA-DQ eplet mismatch (HR, 1.98 per 10 eplets mismatched; P < 0.0001), amino acid mismatch (HR, 1.24 per 10 amino acids mismatched; P < 0.0001), and electrostatic mismatch (HR, 1.14 per 10 units mismatched; P < 0.0001). All 3 methods were significant multivariate correlates of dnDSA development after adjustment for recipient age, baseline immunosuppression, and nonadherence. Conclusions HLA molecular mismatch represents a precise method of alloimmune risk assessment for renal transplant patients. The method used to determine the molecular mismatch is likely to be driven by familiarity and ease of use as highly correlated results are produced by each method.
Glutamate modulates [Ca2+]i and gonadotropin-releasing hormone secretion in immortalized hypothalamic GT1-7 neurons.

Glutamate and its receptors are present in the hypothalamus and have been proposed to participate in neuroendocrine regulation, including the control of GnRH secretion. To address the mechanism of glutamate action, we measured [Ca2+]i, inositol phosphate, and secretory responses to glutamate receptor subtype agonists and antagonists in the immortalized GT1-7 cell line of GnRH-secreting hypothalamic neurons. Glutamate, N-methyl-D-aspartate (NMDA), kainate, and trans-(+/-)-1-amino-(1S,3R)-cyclopentanedicarboxylic acid increased GnRH secretion. In monolayer cultures of GT1-7 cells, L- but not D-glutamate induced a moderate, concentration-dependent rise in [Ca2+]i. The action of glutamate on [Ca2+]i was mimicked by NMDA, alpha-amino-2,3-dihydro-5-methyl-3-oxo-4-isoxazolepropanoic acid (AMPA), and kainate. Responses to NMDA were potentiated by the coagonist, glycine, and were inhibited by an antagonist of the glycine site on the NMDA receptor, 5,7-dichlorokynurenic acid (DCKA). NMDA-induced [Ca2+]i responses were also inhibited by Mg2+ and by the NMDA receptor antagonist, (5R,10S)-(+)-5-methyl-10,11-dihydro-5H-dibenzo[a,d]cyclohepten-5,1 0-imine hydrogen maleate (MK-801), but not by the AMPA/kainate antagonist, 6-cyano-7-nitroquinoxaline-2,3-dione (CNQX). In contrast, responses to AMPA and kainate were inhibited by CNQX but not by Mg2+, DCKA, or MK-801. Responses to glutamate were more inhibited by MK-801 plus CNQX than by either antagonist alone. All [Ca2+]i responses were nearly abolished in Ca(2+)-free solution. None of the agonists stimulated inositol phosphate formation. (ABSTRACT TRUNCATED AT 250 WORDS)
Pro3Gres Parser in the CoNLL Domain Adaptation Shared Task

We present Pro3Gres, a deep-syntactic, fast dependency parser that combines a handwritten competence grammar with probabilistic performance disambiguation and that has been used in the biomedical domain. We discuss its performance in the domain adaptation open submission. We achieve average results, which is partly due to difficulties in mapping to the dependency representation used for the shared task.
SybilTrap: A graph‐based semi‐supervised Sybil defense scheme for online social networks

Sybil attacks are increasingly prevalent in online social networks. A malicious user can generate a huge number of fake accounts to produce spam, impersonate other users, commit fraud, and reach many legitimate users. For security reasons, such fake accounts have to be detected and deactivated immediately. Various defense schemes have been proposed to deal with fake accounts. However, most identify fake accounts using only the structure of social graphs, leading to poor performance. In this paper, we propose a new and scalable defense scheme, SybilTrap. SybilTrap uses a semi‐supervised technique that automatically integrates the underlying features of user activities with the social structure into one system. Unlike other machine learning–based approaches, the proposed defense scheme works on unlabeled data, and it is effective in detecting targeted attacks, because it manipulates different levels of features of user profiles. We evaluate SybilTrap on a dataset collected from Twitter. We show that our proposed scheme is able to accurately detect Sybil nodes as well as huge conspiracies among them.
Prevalence of subclinical hypothyroidism in adults visiting primary health-care setting in Riyadh

ABSTRACT Background and objectives: Subclinical hypothyroidism is an asymptomatic condition with normal thyroxin and raised thyroid stimulating hormone (TSH) level. The objective of the study was to determine the prevalence of subclinical hypothyroidism in primary health care (PHC) settings in Riyadh and explore the relationship of TSH level with age, gender, family history, body mass index, and co-morbid conditions. Subjects and methods: A cross-sectional study of adult visitors to nine satellites PHC clinics in military housing in Riyadh was carried out. TSH concentration and free T4 levels were measured. Data were collected by nurses and physicians during routine clinical practice in primary care. Descriptive analysis was performed on all variables in study, and relationships were explored using chi-square, t-test, analysis of variance, and linear regression. Results: A total of 340 out of 394 participants in the study gave blood samples. Subclinical hyperthyroidism was identified in 2.1% (p = .001) and subclinical hypothyroidism in 10.3% (p = .001) of the PHC visitors. TSH levels were found to be significantly higher (p = .047) in elderly population of ≥60 years and those with family history of thyroid disease. Non-significant upward trends were noted in TSH levels with hyperlipidemia and increasing blood pressure. No overt hyperthyroidism or hypothyroidism was found in our study sample. Conclusion: Subclinical hypothyroidism has a prevalence of 10% of adults visiting PHC’s. TSH levels are higher in the elderly, which warrants screening of those aged 60 years and above.
VALIDITY OF SUBSAMPLING AND “PLUG-IN ASYMPTOTIC” INFERENCE FOR PARAMETERS DEFINED BY MOMENT INEQUALITIES

This paper considers inference for parameters defined by moment inequalities and equalities. The parameters need not be identified. For a specified class of test statistics, this paper establishes the uniform asymptotic validity of subsampling, m out of n bootstrap, and “plug-in asymptotic” tests and confidence intervals for such parameters. Establishing uniform asymptotic validity is crucial in moment inequality problems because the pointwise asymptotic distributions of the test statistics of interest have discontinuities as functions of the true distribution that generates the observations. The size results are quite general because they hold without specifying the particular form of the moment conditions—only 2 + δ moments finite are required. The results allow for independent and identically distributed (i.i.d.) and dependent observations and for preliminary consistent estimation of identified parameters.
Prevalence and Predictors of Learning and Psychological Diagnoses Following Pediatric Arterial Ischemic Stroke

ABSTRACT This study examined the prevalence of learning and psychological diagnoses and associated neurological and personal-environmental risk factors following perinatal and childhood arterial ischemic stroke. In our sample of 126 children and youth, 52.4% received a diagnosis following their assessment. Specifically, 32% had a single diagnosis and 21% had two or more diagnoses. Learning disability, attention deficit-hyperactivity disorder, and intellectual disability were the most prevalent diagnoses. Associated risk factors varied by diagnosis with lower intellectual functioning being the common risk factor across categories. Seizure status was associated with intellectual disability whereas family history was related to ADHD and comorbid diagnoses.
Distributed Coordination of Wheeled Mobile Robots for Unknown Moving Targets Interception

This paper investigates distributed coordination of a team of wheeled mobile robots for multiple moving targets interception over a convex domain. In order to successfully intercept potential intruders entering the mission domain from different orientations, mobile robots are dynamically deployed to monitor the whole area and track moving targets once they are detected at a certain location. Due to the lack of knowledge about the numbers and online dynamic models of targets, a time-varying priority function indicating the most probable area where these targets may appear is introduced to increase the chance of intercepting them. Meanwhile, a target switching mechanism is employed to decide when targets should be considered by each mobile robot for interception task. Based on this priority function, a novel distributed coverage control law is designed to guarantee that wheeled mobile robots asymptotically converge to their generalized Centroidal Voronoi Tessellation and minimize the cost function with respect to those moving targets. Simulation results are given to present the advantage of the proposed approach over traditional coverage control strategy.