Miracle-dz/UniFAR-FTUs huggingface dataset:
Faster SGD training by minibatch persistency

It is well known that, for most datasets, the use of large-size minibatches for Stochastic Gradient Descent (SGD) typically leads to slow convergence and poor generalization. On the other hand, large minibatches are of great practical interest as they allow for a better exploitation of modern GPUs. Previous literature on the subject concentrated on how to adjust the main SGD parameters (in particular, the learning rate) when using large minibatches. In this work we introduce an additional feature, that we call minibatch persistency, that consists in reusing the same minibatch for K consecutive SGD iterations. The computational conjecture here is that a large minibatch contains a significant sample of the training set, so one can afford to slightly overfitting it without worsening generalization too much. The approach is intended to speedup SGD convergence, and also has the advantage of reducing the overhead related to data loading on the internal GPU memory. We present computational results on CIFAR-10 with an AlexNet architecture, showing that even small persistency values (K=2 or 5) already lead to a significantly faster convergence and to a comparable (or even better) generalization than the standard "disposable minibatch" approach (K=1), in particular when large minibatches are used. The lesson learned is that minibatch persistency can be a simple yet effective way to deal with large minibatches.
Theoretical Analysis of Image-to-Image Translation with Adversarial Learning

Recently, a unified model for image-to-image translation tasks within adversarial learning framework has aroused widespread research interests in computer vision practitioners. Their reported empirical success however lacks solid theoretical interpretations for its inherent mechanism. In this paper, we reformulate their model from a brand-new geometrical perspective and have eventually reached a full interpretation on some interesting but unclear empirical phenomenons from their experiments. Furthermore, by extending the definition of generalization for generative adversarial nets to a broader sense, we have derived a condition to control the generalization capability of their model. According to our derived condition, several practical suggestions have also been proposed on model design and dataset construction as a guidance for further empirical researches.
A Randomized Controlled Trial of Parent-Child Psychotherapy Targeting Emotion Development for Early Childhood Depression.

OBJECTIVE: Clinical depression in children as young as age 3 has been validated, and prevalence rates are similar to the school-age disorder. Homotypic continuity between early and later childhood depression has been observed, with alterations in brain function and structure similar to those reported in depressed adults. These findings highlight the importance of identifying and treating depression as early as developmentally possible, given the relative treatment resistance and small effect sizes for treatments later in life. The authors conducted a randomized controlled trial of a dyadic parent-child psycho-therapy for early childhood depression that focuses on enhancing the child's emotional competence and emotion regulation. METHOD: A modified version of the empirically tested parent-child interaction therapy with a novel "emotion development" module (PCIT-ED) was compared with a waiting list condition in a randomized controlled trial in 229 parent-child dyads with children 3-6.11 years of age. Both study arms lasted 18 weeks. RESULTS: Children in the PCIT-ED group had lower rates of depression (primary outcome), lower depression severity, and lower impairment compared with those in the waiting list condition (Cohen's d values, >1.0). Measures of child emotional functioning and parenting stress and depression were significantly improved in the PCIT-ED group. CONCLUSIONS: The findings from this randomized controlled trial of a parent-child psychotherapy for early childhood depression suggest that earlier identification and intervention in this chronic and relapsing disorder represents a key new pathway for more effective treatment. Manualized PCIT-ED, administered by master's-level clinicians, is feasible for delivery in community health settings.
Equity Premiums in the Presidential Cycle: the Midterm Election Resolution of Uncertainty

This study shows that since 1927, investors would have earned substantially by investing in the U.S. equity market from November through April in presidential pre-election years. On the other hand, Treasury bond returns performed inversely to the equity returns, i.e., they have been higher in summer (May to October) months and in other-than-pre-election-years (especially in midterm election years). Our equity results suggest that the previously documented Halloween and pre-election year effects are intertwined. The combined Halloween–pre-election year effect shows up consistently in sub-periods; in an extended sample period since 1871; and in international stock markets. It appears to be separate from a January anomaly; it is independent of the political party in the White House; and it doesn’t appear to be a compensation for higher risk. In contrast, small (value) stocks outperform large (growth) stocks in the November–to–April period in years other than presidential pre-election years. We show that the winter–pre-election year premiums align with the Baker et al. (2016) measure of economic policy uncertainty, and we propose that models of political uncertainty potentially explain both the equity and bond results.
Impact of parental weight status on children’s body mass index in early life: evidence from a Chinese cohort

Objectives To understand whether parents’ weight status before conception predicts body mass index (BMI) of their offspring in early life and the differences between the mother–child and father–child associations. Design A birth cohort study. Setting Conducted at the Community Health Service Centre in Shenyang, Wuhan and Guangzhou. Participants A total of 2220 live birth newborns were recruited randomly after consent of their parents, and 1178 were followed up until 2 years old. Methods Parental demographics, maternal characteristics during pregnancy, children’s anthropometric data and feeding patterns at 1 month old were collected. BMI was calculated and BMI Z-scores (BMI_Z) were generated by referring to WHO growth standard. Parental weight status was categorised into underweight, normal weight, and overweight and obese according to the Working Group of Obesity in China. General linear models and generalised linear models were used to assess the associations between parents and offspring. Outcome measures The primary outcomes were descriptive data on child’s sex-specific anthropometric variables. The secondary outcomes were BMI_Z and weight status of children at each time point. Results No gender difference was observed in BMI_Z or overweight or obesity rates from birth to 24 months old, although boys were significantly heavier and had a greater length/height than girls (P<0.05). The overweight and obesity rates of children peaked at 12 months old. Maternal BMI/weight status had a significant but small effect on BMI_Z at birth, but not on the paternal side. The impact of parental BMI on child’s BMI_Z after birth was similar at each follow-up. Offspring with underweight mothers tend to have reduced BMI_Z after birth while overweight/obese fathers had children with a greater BMI_Z. Conclusions Maternal weight status had small effect on both fetal and child growth after birth. Significant but mild paternal influence was only detected after birth.
Inter-Individual Variability in Acute Toxicity of R-Pulegone and R-Menthofuran in Human Liver Slices and Their Influence on miRNA Expression Changes in Comparison to Acetaminophen

Monoterpenes R-pulegone (PUL) and R-menthofuran (MF), abundant in the Lamiaceae family, are frequently used in herb and food products. Although their hepatotoxicity was shown in rodent species, information about their effects in human liver has been limited. The aim of our study was to test the effects of PUL, MF and acetaminophen (APAP, as a reference compound) on cell viability and microRNA (miRNA) expression in human precision-cut liver slices. Slices from five patients were used to follow up on the inter-individual variability. PUL was toxic in all liver samples (the half-maximal effective concentration was 4.0 µg/mg of tissue), while MF and surprisingly APAP only in two and three liver samples, respectively. PUL also changed miRNA expression more significantly than MF and APAP. The most pronounced effect was a marked decrease of miR-155-5p expression caused by PUL even in non-toxic concentrations in all five liver samples. Our results showed that PUL is much more toxic than MF and APAP in human liver and that miR-155-5p could be a good marker of PUL early hepatotoxicity. Marked inter-individual variabilities in all our results demonstrate the high probability of significant differences in the hepatotoxicity of tested compounds among people.
On Poetic Topic Modeling: Extracting Themes and Motifs From a Corpus of Spanish Poetry

This work was supported by the BBVA Foundation: grants for research groups 2016, project Distant Reading Approach to Golden Age Spanish Sonnets (Ayudas fundacion BBVA a equipos de investigacion cientifica, proyecto Analisis distante de base computacional del soneto castellano del Siglo de Oro): http://adso.gplsi. es. It was also partially conducted in the context of the COST Action Distant Reading for European Literary History (CA16204 - Distant-Reading): www.distant-reading.net.
Diffusion Tensor Imaging (DTI) Correlates of Self-Reported Sleep Quality and Depression Following Mild Traumatic Brain Injury

Background: Mild traumatic brain injuries (mTBIs) are a significant social, sport, and military health issue. In spite of advances in the clinical management of these injuries, the underlying pathophysiology is not well-understood. There is a critical need to advance objective biomarkers, allowing the identification and tracking of the long-term evolution of changes resulting from mTBI. Diffusion-weighted imaging (DWI) allows for the assessment of white-matter properties in the brain and shows promise as a suitable biomarker of mTBI pathophysiology. Methods: 34 individuals within a year of an mTBI (age: 24.4 ± 7.4) and 18 individuals with no history of mTBI (age: 23.2 ± 3.4) participated in this study. Participants completed self-report measures related to functional outcomes, psychological health, post-injury symptoms, and sleep, and underwent a neuroimaging session that included DWI. Whole-brain white matter was skeletonized using tract-based spatial statistics (TBSS) and compared between groups as well as correlated within-group with the self-report measures. Results: There were no statistically significant anatomical differences between the two groups. After controlling for time since injury, fractional anisotropy (FA) demonstrated a negative correlation with sleep quality scores (higher FA was associated with better sleep quality) and increasing depressive symptoms in the mTBI participants. Conversely, mean (MD) and radial diffusivity (RD) demonstrated positive correlations with sleep quality scores (higher RD was associated with worse sleep quality) and increasing depressive symptoms. These correlations were observed bilaterally in the internal capsule (anterior and posterior limbs), corona radiata (anterior and superior), fornix, and superior fronto-occipital fasciculi. Conclusion: The results of this study indicate that the clinical presentation of mTBI, particularly with respect to depression and sleep, is associated with reduced white-matter integrity in multiple areas of the brain, even after controlling for time since injury. These areas are generally associated not only with sleep and emotion regulation but also cognition. Consequently, the onset of depression and sleep dysfunction as well as cognitive impairments following mTBI may be closely related to each other and to white-matter integrity throughout the brain.
Work‐specific cognitive symptoms and the role of work characteristics, fatigue, and depressive symptoms in cancer patients during 18 months post return to work

Cancer patients can experience work‐specific cognitive symptoms post return to work. The study aims to (1) describe the course of work‐specific cognitive symptoms in the first 18 months post return to work and (2) examine the associations of work characteristics, fatigue and depressive symptoms with work‐specific cognitive symptoms over time.
Marital status and risk of cardiovascular diseases: a systematic review and meta-analysis

Background The influence of marital status on the incidence of cardiovascular disease (CVD) and prognosis after CVD is inconclusive. We systematically reviewed the literature to determine how marital status influences CVD and prognosis after CVD. Methods A search of MEDLINE and Embase in January 2018 without language restriction was performed to identify studies that evaluated the association between marital status and risk of CVD. Search terms related to both marital status and CVD were used and included studies had to be prospective in design. The outcomes of interest were CVD, coronary heart disease (CHD) or stroke incidence and mortality. We performed random effects meta-analysis stratified by the types of population by calculating odds ratios (OR) and 95% confidence intervals (95% CI). Results Our analysis included 34 studies with more than two million participants. Compared with married participants, being unmarried (never married, divorced or widowed) was associated with increased odds of CVD (OR 1.42; 95% CI 1.00 to 2.01), CHD (OR 1.16,95% CI 1.04 to 1.28), CHD death (OR 1.43,95% CI 1.28 to 1.60) and stroke death (OR 1.55,95% 1.16 to 2.08). Being divorced was associated with increased odds of CHD (P<0.001) for both men and women while widowers were more likely to develop a stroke (P<0.001). Single men and women with myocardial infarction had increased mortality (OR 1.42, 95% CI 1.14 to 1.76) compared with married participants. Conclusions Marital status appears to influence CVD and prognosis after CVD. These findings may suggest that marital status should be considered in the risk assessment for CVD and outcomes of CVD based on marital status merits further investigation.
Physiological and Physical Profile of Snowboarding: A Preliminary Review

The sport of snowboarding has grown in popularity as both a recreational winter activity as well as a prominent Olympic sport. Both forms are comprised of one of three different disciplines within the sport: freestyle, alpine, and snowboard-cross. In recent years, the increased professionalism and substantial growth of snowboarding as a global sport has increasingly attracted the interest of exercise physiologists and sport scientists. Given the small (but growing) number of studies that have been published, the research analyzing the physiological and performance characteristics and requirements of snowboarding remains limited. The absence of such studies signifies a lack of examination into this important but under-explored area of research, which could contribute valuable information to the scientific community and international snowboarding teams. The studies conducted thus far have indicated different requirements of physiological and physical traits dependent upon the specific discipline of snowboarding in question. For example, in order to meet the divers demands of each discipline, athletes must develop various qualities, such as muscular strength and power. This can increase their ability to withstand the high forces and loads on the muscular system during competition, and further decrease their risk of lower limbs injuries. At the same time, the studies acknowledge the potential advantages of aerobic fitness in terms of recovery, to more efficiently sustain the athlete through both competitive and on- and off-snow training sessions. Given the value and breadth of application of these limited studies, further analysis and research could contribute greater knowledge and benefits to the field of snowboarding. Therefore, it is the purpose of this preliminary review to explore the current literature, providing further insight into the physiological and physical demands of snowboarding performance. This preliminary review is intended to stimulate interest among the communities of exercise physiologists, sport scientists and particularly coaches in order to improve our current understanding of snowboarding and its demands as a sport. This preliminary review further seeks to develop protocols and strategies to assess physiological and performance characteristics of snowboarding, monitor athletic performance, provide practical recommendations for training, identify new areas of scientific research, and develop accurate talent identification programs.
Hypoxic‐stabilized EPAS1 proteins transactivate DNMT1 and cause promoter hypermethylation and transcription inhibition of EPAS1 in non‐small cell lung cancer

Non‐small cell lung cancer (NSCLC) is the leading cause of cancer mortality globally. Although cigarette smoking is by far the most important risk factor for lung cancer, the aberrant expression of oncogenes and tumor suppressor genes contributes a great deal to tumorigenesis. Here, we reveal that aberrant expression of endothelial PAS domain‐containing protein 1 (EPAS1) gene, which encodes hypoxia inducible factor 2a, has a critical role in NSCLC. Our results showed EPAS1 mRNA was down‐regulated in 82.5% of NSCLC tissues, and a new region of EPAS1 promoter was found to be highly methylated in lung cancer cell lines and NSCLC tissues. Moreover, the methylation rates were negatively correlated to EPAS1 mRNA expression in lung tissues. Further, demethylation analysis demonstrated EPAS1 was regulated by DNA methyltransferases (DNMTs) in NSCLC. In contrast, DNMT1was verified as an EPAS1 target gene by chromatin immunoprecipitation assay and could be transactivated by stabilized EPAS1 proteins in hypoxic lung cells, thereby decreasing EPAS1 mRNA expression by methylation regulation. Collectively, our study suggests there might be a mechanism of negative‐feedback regulation for EPAS1in NSCLC. That is, hypoxic‐stabilized EPAS1 proteins transactivated ΌΝΜΤΊ, which further promoted the hypermethylation of EPAS1 promoter and decreased EPAS1 mRNA expression levels in NSCLC. —Xu, X. ‐H. , Bao, Y. , Wang, X. , Yan, F. , Guo, S. , Ma, Y. , Xu, D. , Jin, L. , Xu, J., Wang, J. Hypoxic‐stabilized EPAS1 proteins transactivate DNMT1 and cause promoter hypermethylation and transcription inhibition of EPAS1 in non‐small cell lung cancer. FASEB J. 32, 6694–6705 (2018). www.fasebj. org
Predictive Value of Maternal Serum Biomarkers for Preeclampsia and Birth Weight: A Case-Control Study in Chinese Pregnant Women.

BACKGROUND In clinical practice, abnormal biochemical changes often occur in women who eventually develop preeclampsia (PE). The study aims to investigate whether maternal serum biochemical markers in the early third trimester can predict PE and neonatal birth weight. STUDY DESIGN A retrospective case-control study was performed on 287 women who subsequently developed PE (mild = 139; severe = 148) and 143 healthy women. Fasting venous blood samples of all gravidas were drawn for routine biochemical markers screening in the early third trimester (28.49 ± 1.63 weeks). Appropriate statistical methods were selected for analysis with SPSS software. RESULTS (1) The concentrations of plasma triglyceride (TG), low-density lipoprotein cholesterol (LDL), and uric acid (UA) in the severe and mild subgroups of the PE group were significantly higher compared with the respective levels in the normal pregnancy groups (3.90 vs. 4.03 vs. 3.14 mmol/L; 3.41 vs. 3.33 vs. 2.89 mmol/L; 365.42 vs. 318.91 vs. 284.69 μmol/L; p < 0.0001). Serum calcium levels in PE group were significantly lower than those in control group (2.10 vs. 2.18 vs. 2.22 mmol/L; p < 0.0001). (2) By using the receiver operating characteristic curve to estimate the diagnosis rate of screening for PE of each marker, the highest sensitivity appeared by the combination of TG, total cholesterol (TC), LDL, high-density lipoprotein cholesterol (HDL), LDL/HDL, UA, Ca2+, and homocysteine (HCY) (79%). The area under curve (AUC) of UA was 0.70, which was the highest among these eight markers, but the AUC of an eight-marker combination model (0.85) had a better diagnostic indication. (3) In PE, the maximum systolic/diastolic blood pressure was significantly positively correlated with serum UA (r = 0.212/0.205, p < 0.0001); and negatively correlated with serum total calcium (r = -0.193/-0.196, p = 0.001). The neonatal birth weight of PE group had a positive correlation with serum TG levels (r = 0.141, p = 0.017) and serum total calcium levels (r = 0.221, p < 0.0001), and a negative correlation with UA levels (r = -0.265, p < 0.0001). CONCLUSION The individual marker really performs terrible in predicting PE. Joint monitoring and evaluation of these parameters may improve the screening efficiency for the prediction of PE and poor fetal growth early.
Using Mode Connectivity for Loss Landscape Analysis

Mode connectivity is a recently introduced frame- work that empirically establishes the connected- ness of minima by finding a high accuracy curve between two independently trained models. To investigate the limits of this setup, we examine the efficacy of this technique in extreme cases where the input models are trained or initialized differently. We find that the procedure is resilient to such changes. Given this finding, we propose using the framework for analyzing loss surfaces and training trajectories more generally, and in this direction, study SGD with cosine annealing and restarts (SGDR). We report that while SGDR moves over barriers in its trajectory, propositions claiming that it converges to and escapes from multiple local minima are not substantiated by our empirical results.
PAX7 immunohistochemical evaluation of Ewing sarcoma and other small round cell tumours

Ewing sarcoma is a small round cell tumour that affects bone and soft tissues. Although the detection of the specific fusion gene is a robust method of its diagnosis, immunohistochemistry may serve as a practical surrogate. Recent tissue microarray studies suggested that PAX7 is a novel marker, because it was expressed consistently in Ewing sarcoma, in addition to rhabdomyosarcoma and synovial sarcoma. Here, we evaluated the utility of PAX7 immunohistochemistry in whole‐tissue sections of an expanded array of round cell malignancies with adequate molecular characterisation.