Miracle-dz/UniFAR-FTUs huggingface dataset:
Towards A Unified View of Sparse Feed-Forward Network in Pretraining Large Language Model

Large and sparse feed-forward layers (S-FFN) such as Mixture-of-Experts (MoE) have proven effective in scaling up Transformers model size for \textit{pretraining} large language models. By only activating part of the FFN parameters conditioning on input, S-FFN improves generalization performance while keeping training and inference costs (in FLOPs) fixed. In this work, we analyzed two major design choices of S-FFN: the memory block (a.k.a. expert) size and the memory block selection method under a general conceptual framework of sparse neural memory. Using this unified framework, we compare several S-FFN architectures for language modeling and provide insights into their relative efficacy and efficiency. We found a simpler selection method -- \textbf{\texttt{Avg-K}} that selects blocks through their mean aggregated hidden states, achieving lower perplexity in language model pretraining compared to existing MoE architectures including Switch Transformer (Fedus et al., 2021) and HashLayer (Roller et al., 2021).
A Regularized Conditional GAN for Posterior Sampling in Image Recovery Problems

In image recovery problems, one seeks to infer an image from distorted, incomplete, and/or noise-corrupted measurements. Such problems arise in magnetic resonance imaging (MRI), computed tomography, deblurring, super-resolution, inpainting, phase retrieval, image-to-image translation, and other applications. Given a training set of signal/measurement pairs, we seek to do more than just produce one good image estimate. Rather, we aim to rapidly and accurately sample from the posterior distribution. To do this, we propose a regularized conditional Wasserstein GAN that generates dozens of high-quality posterior samples per second. Our regularization comprises an $\ell_1$ penalty and an adaptively weighted standard-deviation reward. Using quantitative evaluation metrics like conditional Fr\'{e}chet inception distance, we demonstrate that our method produces state-of-the-art posterior samples in both multicoil MRI and large-scale inpainting applications. The code for our model can be found here: https://github.com/matt-bendel/rcGAN
When Interdependence Backfires: The Coronavirus Infected Three Times More People in Rice-Farming Areas During Chinese New Year

Interdependent cultures around the world have generally controlled COVID-19 better. We tested this pattern in China based on the rice theory, which argues that historically rice-farming regions of China are more interdependent than wheat-farming areas. Unlike earlier findings, rice-farming areas suffered more COVID-19 cases in the early days of the outbreak. We suspected this happened because the outbreak fell on Chinese New Year, and people in rice areas felt more pressure to visit family and friends. We found historical evidence that people in rice areas visit more family and friends for Chinese New Year than people in wheat areas. In 2020, rice areas also saw more New Year travel. Regional differences in social visits were correlated with COVID-19 spread. These results reveal an exception to the general idea that interdependent culture helps cultures contain COVID-19. When relational duties conflict with public health, interdependence can lead to more spread of disease.
Large‐scale phosphomimetic screening identifies phospho‐modulated motif‐based protein interactions

Phosphorylation is a ubiquitous post‐translation modification that regulates protein function by promoting, inhibiting or modulating protein–protein interactions. Hundreds of thousands of phosphosites have been identified but the vast majority have not been functionally characterised and it remains a challenge to decipher phosphorylation events modulating interactions. We generated a phosphomimetic proteomic peptide‐phage display library to screen for phosphosites that modulate short linear motif‐based interactions. The peptidome covers ~13,500 phospho‐serine/threonine sites found in the intrinsically disordered regions of the human proteome. Each phosphosite is represented as wild‐type and phosphomimetic variant. We screened 71 protein domains to identify 248 phosphosites that modulate motif‐mediated interactions. Affinity measurements confirmed the phospho‐modulation of 14 out of 18 tested interactions. We performed a detailed follow‐up on a phospho‐dependent interaction between clathrin and the mitotic spindle protein hepatoma‐upregulated protein (HURP), demonstrating the essentiality of the phospho‐dependency to the mitotic function of HURP. Structural characterisation of the clathrin‐HURP complex elucidated the molecular basis for the phospho‐dependency. Our work showcases the power of phosphomimetic ProP‐PD to discover novel phospho‐modulated interactions required for cellular function.
Differences in infant negative affectivity during the COVID-19 pandemic

This longitudinal study compared infant temperament rated at 3 months postpartum by 263 United-States-based women who gave birth during the COVID-19 pandemic and 72 who gave birth prior to the pandemic. All women completed questionnaires assessing perinatal mental health, social contact, and infant temperament. Mothers whose infants were born during the pandemic reported higher levels of infant negative affectivity as compared with mothers whose infants were born earlier (F(1, 324) = 18.28, p < . 001), but did not differ in their ratings of surgency or effortful control. Maternal prenatal depressive symptoms, prenatal stress, and postpartum stress mediated differences in infant negative affectivity between pandemic and pre-pandemic groups. Within the pandemic group, decreased postpartum social contact was associated with higher ratings of infant negative affectivity. These findings suggest that the pandemic has affected maternal perceptions of infant temperament, perinatal mental health, and social contact.
Overview of pregnancy in solid-organ transplantation

Purpose of review Pregnancy in solid organ transplantation (SOT) is a very complex part of transplant medicine wherein there is scarce information available in the literature. Solid organ transplant recipients often have comorbidities, such as hypertension and diabetes, which add additional risk to a pregnancy. Recent findings We present this review article on the various aspects of different types of immunosuppressant medications used in pregnancy with added inputs on contraception and fertility after transplant. We described the antepartum and postpartum considerations and discussed the adverse effects of the immunosuppressive medications. Maternal and fetal complications of each SOT have been also discussed in this article. Summary This article will serve as the primary review articles for the use of immunosuppressive medications during pregnancy with consideration during pregnancy after SOT.
Effects of Colletotrichum gloeosporioides and Poplar Secondary Metabolites on the Composition of Poplar Phyllosphere Microbial Communities

Our findings revealed that the inoculation of Colletotrichum gloeosporioides has a greater effect on the fungal community than the bacterial community. In addition, coumarins, organic acids, and flavonoids may have recruitment effects on phyllosphere microorganisms, while indoles may have inhibitory effects on these organisms. These findings may provide the theoretical basis for the prevention and control of poplar anthracnose. ABSTRACT Poplar anthracnose caused by Colletotrichum gloeosporioides is a common disease affecting poplars globally that causes the destruction and alteration of poplar phyllosphere microbial communities; however, few studies have investigated these communities. Therefore, in this study, three species of poplar with different resistances were investigated to explore the effects of Colletotrichum gloeosporioides and poplar secondary metabolites on the composition of poplar phyllosphere microbial communities. Evaluation of the phyllosphere microbial communities before and after inoculation of the poplars with C. gloeosporioides revealed that both bacterial and fungal OTUs decreased after inoculation. Among bacteria, the most abundant genera were Bacillus, Plesiomonas, Pseudomonas, Rhizobium, Cetobacterium, Streptococcus, Massilia, and Shigella for all poplar species. Among fungi, the most abundant genera before inoculation were Cladosporium, Aspergillus, Fusarium, Mortierella, and Colletotrichum, while Colletotrichum was the main genus after inoculation. The inoculation of pathogens may regulate the phyllosphere microorganisms by affecting the secondary metabolites of plants. We investigated metabolite contents in the phyllosphere before and after the inoculation of the three poplar species, as well as the effects of flavonoids, organic acids, coumarins, and indoles on poplar phyllosphere microbial communities. We speculated that coumarin had the greatest recruitment effect on phyllosphere microorganisms, followed by organic acids through regression analysis. Overall, our results provide a foundation for subsequent screening of antagonistic bacteria and fungi against poplar anthracnose and investigations of the mechanism by which poplar phyllosphere microorganisms are recruited. IMPORTANCE Our findings revealed that the inoculation of Colletotrichum gloeosporioides has a greater effect on the fungal community than the bacterial community. In addition, coumarins, organic acids, and flavonoids may have recruitment effects on phyllosphere microorganisms, while indoles may have inhibitory effects on these organisms. These findings may provide the theoretical basis for the prevention and control of poplar anthracnose.
Factors Associated with Turnover Intentions of Nurses Working in Japanese Hospitals Admitting COVID-19 Patients

Three years after the outbreak of the coronavirus disease (COVID-19) pandemic, turnover among frontline nurses has increased. The participants of this study were nurses at two general hospitals in Ishikawa, Japan, receiving COVID-19 patients. An original self-report questionnaire was created based on previous research. The questionnaire was distributed to 400 nurses, and responses were received from 227 nurses (response rate: 56.8%). The factors influencing turnover intention at the facilities were having less time to relax (odds ratio [OR]: 2.88, 95% confidence interval [CI]: 1.12–7.41) and wanting to receive counseling (OR: 5.21, 95% CI: 1.30–20.91). As a strategy to prevent turnover, nurse managers should provide opportunities for nurses to receive counseling during normal working hours and pay particular attention to changes in nurses’ daily lives, such as changes in the time available for relaxation.
Clinical epidemiology and a novel predicting nomogram of central line associated bloodstream infection in burn patients

Abstract Burn patients are at high risk of central line–associated bloodstream infection (CLABSI). However, the diagnosis of such infections is complex, resource-intensive, and often delayed. This study aimed to investigate the epidemiology of CLABSI and develop a prediction model for the infection in burn patients. The study analysed the infection profiles, clinical epidemiology, and central venous catheter (CVC) management of patients in a large burn centre in China from January 2018 to December 2021. In total, 222 burn patients with a cumulative 630 CVCs and 5,431 line-days were included. The CLABSI rate was 23.02 CVCs per 1000 line-days. The three most common bacterial species were Acinetobacter baumannii, Staphylococcus aureus, and Pseudomonas aeruginosa; 76.09% of isolates were multidrug resistant. Compared with a non-CLABSI cohort, CLABSI patients were significantly older, with more severe burns, more CVC insertion times, and longer total line-days, as well as higher mortality. Regression analysis found longer line-days, more catheterisation times, and higher burn wounds index to be independent risk factors for CLABSI. A novel nomogram based on three risk factors was constructed with an area under the receiver operating characteristic curve (AUROC) value of 0.84 (95% CI: 0.782–0.898) with a mean absolute error of calibration curve of 0.023. The nomogram showed excellent predictive ability and clinical applicability, and provided a simple, practical, and quantitative strategy to predict CLABSI in burn patients.
Preserving choice in breast cancer treatment: A different perspective on contralateral prophylactic mastectomy

Contralateral prophylactic mastectomy is the removal of both breasts when only one is affected by cancer. Rates of this controversial cancer treatment have been increasing since the late 1990s, even among women who do not have the kind of family history or known genetic mutation that would put them at high-risk for another breast cancer. Citing contralateral prophylactic mastectomy’s lack of oncologic benefit and increased risk of surgical complications, the American Society of Breast Surgeons discourages contralateral prophylactic mastectomy for average-risk women with unilateral cancer, as does most of the medical literature on this topic. Within this literature, desire for contralateral prophylactic mastectomy is often painted as the product of an emotional overreaction to a cancer diagnosis and misunderstanding of breast cancer risk. Drawing on the personal experience of a breast cancer survivor, as well as relevant medical literature on breast cancer screening and surgery, this article offers a different perspective on the ongoing popularity of contralateral prophylactic mastectomy, one that focuses on practical experiences and logical deliberations about those experiences. Specifically, it calls attention to two features of the contralateral prophylactic mastectomy decision-making situation that have been inadequately covered in the medical literature: (1) the way that breast cancer screening after a breast cancer diagnosis can become a kind of radiological overtreatment, even for “average-risk” women; and (2) how desire for bodily symmetry after breast cancer, which can best be achieved through bilateral reconstruction or no reconstruction, drives interest in contralateral prophylactic mastectomy. The goal of this article is not to suggest that all women who want contralateral prophylactic mastectomy should have the surgery. In some cases, it is not advisable. But many “average-risk” women with unilateral cancer have good reasons for wanting contralateral prophylactic mastectomy, and we believe their right to choose it should be protected.
Towards Visualization Thumbnail Designs that Entice Reading Data-driven Articles

As online news increasingly include data journalism, there is a corresponding increase in the incorporation of visualization in article thumbnail images. However, little research exists on the design rationale for visualization thumbnails, such as resizing, cropping, simplifying, and embellishing charts that appear within the body of the associated article. Therefore, in this paper we aim to understand these design choices and determine what makes a visualization thumbnail inviting and interpretable. To this end, we first survey visualization thumbnails collected online and discuss visualization thumbnail practices with data journalists and news graphics designers. Based on the survey and discussion results, we then define a design space for visualization thumbnails and conduct a user study with four types of visualization thumbnails derived from the design space. The study results indicate that different chart components play different roles in attracting reader attention and enhancing reader understandability of the visualization thumbnails. We also find various thumbnail design strategies for effectively combining the charts' components, such as a data summary with highlights and data labels, and a visual legend with text labels and Human Recognizable Objects (HROs), into thumbnails. Ultimately, we distill our findings into design implications that allow effective visualization thumbnail designs for data-rich news articles. Our work can thus be seen as a first step toward providing structured guidance on how to design compelling thumbnails for data stories.
Study on singularity analysis with differential transform method for 3-RRUR parallel robot based on Jacobian matrix

Parallel robot is used in many different fields nowadays,but the singularity of 3-RRUR parallel robot is more complicated,so a method to analyze the singularity of the 3-RRUR parallel robot is very necessary.First,the Jacobian matrix was built based on the differential transform method through the transfer matrixes between the poles.The connection between the position parameters and singularity condition was built through the analysis of the Jacobian matrix.Second,the effect on the singularity from the position parameters was analyzed,and then the singularity condition was confirmed.The effect on the singularity condition from position parameters was displayed by the curved surface charts to provide a basic method for the designing of the parallel robot.With this method,the singularity condition could be got when the length of each link is firmed,so it can be judged that if a group of parameters are appropriate or not,and the method also provides warrant for workspace and path planning of the parallel robot.
Detection of structural damage via free vibration responses by extended Kalman filter with Tikhonov regularization scheme

It is a challenging problem of assessing the location and extent of structural damages with vibration measurements. In this paper, an improved Extended Kalman filter (EKF) with Tikhonov regularization is proposed to identify structural damages. The state vector of EKF consists of the initial values of modal coordinates and damage parameters of structural elements, therefore the recursive formulas of EKF are simplified and modal truncation technique can be used to reduce the dimension of the state vector. Then Tikhonov regularization is introduced into EKF to restrain the effect of the measurement noise for improving the solution of ill-posed inverse problems. Numerical simulations of a seven-story shear-beam structure and a simply-supported beam show that the proposed method has good robustness and can identify the single or multiple damages accurately with the unknown initial structural state.
Analysis of Smartphone Text Data Related to mpox from a U.S. Sample of Gay, Bisexual, and Other Men Who Have Sex with Men During the 2022 Outbreak

Purpose: We sought to understand technology-based communication regarding mpox (monkeypox) among gay, bisexual, and other men who have sex with men (GBMSM) during the global outbreak in 2022. Methods: Forty-four GBMSM (Mage = 25.3 years, 68.2% cisgender, 43.2% non-White) living in the United States participated. From May 2022 to August 2022, all text data related to mpox (174 instances) were downloaded from the smartphones of GBMSM. Text data and smartphone app usage were analyzed. Results: Content analysis revealed 10 text-based themes and 7 app categories. GBMSM primarily used search and browser, texting, and gay dating apps to share vaccine updates, seek mpox vaccination, find general mpox information, share mpox information with other GBMSM, and discuss links between mpox and gay culture. Data visualizations revealed that changes in communication themes and app usage were responsive to major milestones in the mpox outbreak. Conclusion: GBMSM used apps to facilitate a community-driven mpox response.
Moment Identities for Skorohod Integrals on Guichardet-Fock Spaces

In this paper, we define expectation of f∈E, i.e. E(f)=f(? ), accordingto Wiener-Ito-Segal isomorphic relation between Guichardet-Fock space F and Wienerspace W. Meanwhile, we prove a moment identity for the Skorohod integrals aboutvacuum state.
Associations Among Enacted Stigma, Perceived Chances for Success, Life Satisfaction, and Substance Use Among Sexual Minority and Heterosexual Youth

Abstract Background: Sexual minority youth report high rates of substance use compared to heterosexual youth. Stigma can diminish perceptions of future success and life satisfaction and contribute to elevated substance use. This study examined whether experiences of enacted stigma (i.e., discrimination) and substance use among sexual minority and heterosexual youth were indirectly associated through perceived chances for success and life satisfaction. Method: In a sample of 487 adolescents who indicated their sexual identity (58% female, M age = 16.0, 20% sexual minority), we assessed substance use status and factors that might explain sexual minority disparities in substance use. Using structural equation modeling, we examined indirect associations between sexual minority status and substance use status through these factors. Results: Compared to heterosexual youth, sexual minority youth reported greater stigma, which was associated with both lower perceived chances for success and life satisfaction, which were in turn associated with greater likelihood of substance use. Conclusions: Findings highlight the importance of attending to stigma, perceived chances for success, and general life satisfaction to understand and intervene to prevent substance use among sexual minority youth.
Robust multi-object tracking using deep learning framework

Object appearance representation is crucial to any visual tracker. In order to improve the appearance representation, we propose a deep compact and high-level appearance representation applied to a multi-object tracking algorithm, which is called Deep Multi-object Tracking. In this paper, we adopt the deep learning framework to offline obtain generic image features with auxiliary natural images and online fine-tune our Deep Multi-object Tracking system to adapt to appearance changes of the moving objects. Besides, we have fully considered the temporal information denoting the dynamic duration time of each object. Based on the temporal information and particle filter, our Deep Multi-object Tracking algorithm can effectively generate an online learning and updating model to form a discriminative appearance scheme to achieve successful multi-object tracking. Experiments show that the proposed Deep Multi-object Tracking performs well both indoor and outdoor, where the objects undergo large pose, scale, occlusion, and illumination variations in complex scenes including abnormal ones.