Miracle-dz/UniFAR-FTUs huggingface dataset:
Nonequilibrium mode competition in a pumped dye-filled cavity

We consider a homogeneously pumped photon gas coupled to a dye medium and investigate how its steady state is effected when varying the pump power, the photon cavity lifetime and the cutoff frequency. We study how the interplay between pumping, loss, and dye-induced thermalization influences the selection of the cavity modes that acquire large occupation. Depending on the parameter regime, the latter can be related either to lasing of (typically multiple) modes or to equilibrium-like photon condensation in the ground mode. We calculate and explain the phase diagram of the system, with a particular emphasis on the role played by a mode repulsion that occurs in the regime of weak cavity loss.
Multi-Level Quickening: Ten Years Later

This paper presents important performance improvements for interpreters, exemplified by speedups of up to 5.5$\times$ for CPython. Although the original version of this papers was rejected multiple times, the reported speedups have not been achieved by any other interpreter optimization technique since. In addition, the paper uses a sound evaluation methodology based on a corollary on Amdahl's law to quantify the speedup potential of benchmarks, which also has not been used in any other paper since. This paper documents my best efforts, and includes all of the reviews the paper received, plus some more commentary on my side on what has changed since and what purpose the archived document could serve.
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models

Commonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained during pre-training. Recent works only propose lightweight model updates as models may already possess useful knowledge from past experience, but a challenge remains in understanding what parts and to what extent models should be refined for a given task. In this paper, we investigate what models learn from commonsense reasoning datasets. We measure the impact of three different adaptation methods on the generalization and accuracy of models. Our experiments with two models show that fine-tuning performs best, by learning both the content and the structure of the task, but suffers from overfitting and limited generalization to novel answers. We observe that alternative adaptation methods like prefix-tuning have comparable accuracy, but generalize better to unseen answers and are more robust to adversarial splits.
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models

Existing generative pre-trained language models (e.g., GPT) focus on modeling the language structure and semantics of general texts. However, those models do not consider the numerical properties of numbers and cannot perform robustly on numerical reasoning tasks (e.g., math word problems and measurement estimation). In this paper, we propose NumGPT, a generative pre-trained model that explicitly models the numerical properties of numbers in texts. Specifically, it leverages a prototype-based numeral embedding to encode the mantissa of the number and an individual embedding to encode the exponent of the number. A numeral-aware loss function is designed to integrate numerals into the pre-training objective of NumGPT. We conduct extensive experiments on four different datasets to evaluate the numeracy ability of NumGPT. The experiment results show that NumGPT outperforms baseline models (e.g., GPT and GPT with DICE) on a range of numerical reasoning tasks such as measurement estimation, number comparison, math word problems, and magnitude classification. Ablation studies are also conducted to evaluate the impact of pre-training and model hyperparameters on the performance.
Puzzle Solving without Search or Human Knowledge: An Unnatural Language Approach

The application of Generative Pre-trained Transformer (GPT-2) to learn text-archived game notation provides a model environment for exploring sparse reward gameplay. The transformer architecture proves amenable to training on solved text archives describing mazes, Rubik’s Cube, and Sudoku solvers. The method benefits from fine-tuning the transformer architecture to visualize plausible strategies derived outside any guidance from human heuristics or domain expertise. The large search space (>1019) for the games provides a puzzle environment in which the solution has few intermediate rewards and a final move that solves the challenge.
Phase-Space Correlations among Systems of Satellite Galaxies

Driven by the increasingly complete observational knowledge of systems of satellite galaxies, mutual spatial alignments and relations in velocities among satellites belonging to a common host have become a productive field of research. Numerous studies have investigated different types of such phase-space correlations and were met with varying degrees of attention by the community. The Planes of Satellite Galaxies issue is maybe the best-known example, with a rich field of research literature and an ongoing, controversial debate on how much of a challenge it poses to the ΛCDM model of cosmology. Another type of correlation, the apparent excess of close pairs of dwarf galaxies, has received considerably less attention despite its reported tension with ΛCDM expectations. With the fast expansion of proper motion measurements in recent years, largely driven by the Gaia mission, other peculiar phase-space correlations have been uncovered among the satellites of the Milky Way. Examples are the apparent tangential velocity excess of satellites compared to cosmological expectations, and the unexpected preference of satellites to be close to their pericenters. At the same time, other kinds of correlations have been found to be more in line with cosmological expectations—specifically, lopsided satellite galaxy systems and the accretion of groups of satellite galaxies. The latter has mostly been studied in cosmological simulations thus far, but it offers the potential to address some of the other issues by providing a way to produce correlations among the orbits of a group’s satellite galaxy members. This review is the first to provide an introduction to the highly active field of phase-space correlations among satellite galaxy systems. The emphasis is on summarizing existing, recent research and highlighting interdependencies between the different, currently almost exclusively individually considered types of correlations. Future prospects in light of upcoming observational facilities and our ever-expanding knowledge of satellite galaxy systems beyond the Local Group are also briefly discussed.
Sodium restriction in patients with chronic heart failure and reduced ejection fraction: A randomized controlled trial

Background Sodium restriction is recommended for patients with heart failure (HF) despite the lack of solid clinical evidence from randomized controlled trials. Whether or not sodium restrictions provide beneficial cardiac effects is not known. Methods The present study is a randomized, double-blind, controlled trial of stable HF patients with ejection fraction ≤ 40%. Patients were allocated to sodium restriction (2 g of sodium/day) vs. control (3 g of sodium/day). The primary outcome was change in N-terminal pro-B-type natriuretic peptide (NT-proBNP) at 20 weeks. Secondary outcomes included quality of life and adverse safety events (HF readmission, blood pressure or electrolyte abnormalities). Results Seventy patients were enrolled. Median baseline sodium consumption was 3268 (2225–4537) mg/day. Adherence to the intervention based on 24-hour urinary sodium was 32%. NT-proBNP and quality of life did not significantly change between groups (p > 0.05 for both). Adverse safety events were not significantly different between the arms (p > 0.6 for all). In the per protocol analysis, patients who achieved a sodium intake < 2500 mg/day at the intervention conclusion showed improvements in NT-proBNP levels (between-group difference: −55%, 95% confidence interval −27 to −73%; p = 0.002) and quality of life (between-group difference: −11 ± 5 points; p = 0.04). Blood pressure decreased in patients with lower sodium intake (between-group difference: −9 ± 5 mmHg; p = 0.05) without significant differences in symptomatic hypotension or other safety events (p > 0.3 for all). Conclusions Adherence assessed by 24-hour natriuresis and by the nutritionist was poor. The group allocated to sodium restriction did not show improvement in NT-proBNP. However, patients who achieved a sodium intake < 2500 mg/day appeared to have improvements in NT-proBNP and quality of life without any adverse safety signals. ClinicalTrials.gov Identifier: NCT03351283.
Reduced Error Recognition Explains Post-Error Slowing Differences among Children with Attention Deficit Hyperactivity Disorder

Abstract Objective: Youth with attention deficit hyperactivity disorder (ADHD) often show reduced post-error slowing (PES) compared to typically developing controls. This finding has been interpreted as evidence that children with ADHD have error recognition and adaptive control impairments. However, several studies report mixed results regarding PES differences in ADHD, and among healthy controls, there is considerable debate about the cognitive-behavioral origin of PES. Methods: We tested competing hypotheses aimed at clarifying whether reduced PES in children with ADHD is due to impaired error detection, deficits in adaptive control, and/or attention orienting to novelty. Children aged 7–11 years with a diagnosis of ADHD (n = 74) and controls (n = 30) completed four laboratory-based computer tasks with variable cognitive loads and error types. Results: ADHD diagnosis was associated with shorter PES only on a task with high cognitive load and low error-cuing, consistent with impaired error recognition. In contrast, there was no evidence of impaired adaptive control or heightened novelty orienting among children with ADHD. Conclusions: The cognitive-behavioral origin of PES is multifactorial, but reduced PES among children with an ADHD diagnosis is due to impaired error recognition during cognitively demanding tasks. Behavioral interventions that scaffold error recognition may facilitate improved performance among children with ADHD.
High-risk human papillomavirus infection among women living with HIV in Latin America and the Caribbean: A systematic review and meta-analysis

We carried out a systematic review to summarize available data regarding prevalence of high-risk human papillomavirus (HR-HPV) among women living with HIV (WLHIV) in Latin America and the Caribbean (LAC). A literature search in PubMed and LILACS was conducted and supplemented with cross-referencing and grey literature. The primary outcome was prevalence of HR-HPV by age as a major determinant of HPV infection. Pooled prevalence and weighted averages were obtained. A random effects meta-analysis conducted for HPV- and HIV-associated factors. In total, 6157 women from 19 cross-sectional studies were included. Weighted prevalence of HR-HPV in WLHIV was 51.0% (95% CI 42.8–59.1, I2 = 97.4%) with a bimodal trend by age. No association between antiretroviral therapy and HR-HPV prevalence was observed, but low CD4 cell count was associated (PR 1.64, 95% CI 1.07–2.52). Although not significant, a higher HR-HPV prevalence was observed with Hybrid Capture 2 versus PCR. The high prevalence of HR-HPV among WLHIV in LAC underlines the need for improved cervical cancer prevention and early detection in this vulnerable population. Moreover, the high prevalence across age groups, and particularly in young women, deserves careful consideration for defining target populations of HPV-based screening and HPV immunization programs.
Alteration of Bone Density, Microarchitecture, and Strength in Patients with Camurati–Engelmann Disease: Assessed by HR‐pQCT

Camurati‐Engelmann disease (CED) is a rare autosomal‐dominant skeletal dysplasia caused by mutations in the transforming growth factor‐β1 (TGFB1) gene. In this study, a retrospective review of patients with CED evaluated at Peking Union Medical College Hospital in Beijing, China, between November 30, 2000 and November 30, 2020 was conducted. Data including demographic data, manifestations, and examination results were characterized. Furthermore, bone geometry, density, and microarchitecture were assessed and bone strength was estimated by HR‐pQCT. Results showed the median age at onset was 2.5 years. Common manifestations included pain in the lower limbs (94%, 17/18), abnormal gait (89%, 16/18), genu valgum (89%, 16/18), reduced subcutaneous fat (78%, 14/18), delayed puberty (73%, 8/11), muscle weakness (67%, 12/18), hearing loss (39%, 7/18), hepatosplenomegaly (39%, 7/18), exophthalmos or impaired vision or visual field defect (33%, 6/18), and anemia (33%, 7/18). Twenty‐five percent (4/16) of patients had short stature. Serum level of alkaline phosphatase was elevated in 41% (7/17) of patients whereas beta‐C‐terminal telopeptide was elevated in 91% of patients (10/11). Among 12 patients, the Z‐scores of two patients were greater than 2.5 at the femur neck and the Z‐scores of five patients were lower than −2.5 at the femur neck and/or lumbar spine. HR‐pQCT results showed lower volumetric BMD (vBMD), altered bone microstructure and lower estimated bone strength at the distal radius and tibia in patients with CED compared with controls. In addition, total volume bone mineral density and cortical volumetric bone mineral density at the radius were negatively correlated with age in patients with CED, but positively correlated with age in controls. In conclusion, the largest case series of CED with characterized clinical features in a Chinese population was reported here. In addition, HR‐pQCT was used to investigate bone microstructure at the distal radius and tibia in nine patients with CED, and the alteration of bone density, microstructure, and strength was shown for the first time. © 2021 American Society for Bone and Mineral Research (ASBMR).
Phytoconstituents and renoprotective effect of Polyalthia longifolia leaves extract on radiation-induced nephritis in rats via TGF-β/smad pathway

Abstract Renoprotectors are highly demanded due to environmental nephrotoxic factors. P. longifolia leaves extract alleviating effect was assessed in nephritic-induced rats by whole body shot dose of γ-radiation. Many biomarkers were detected using several assays. Renohistopathological examinations were performed. Moreover, the extract phytoconstituents were identified using spectroscopic analysis. In-vitro anti-inflammatory activity of some compounds was examined using histamine release assay. Post-irradiation treatment with the extract significantly ameliorated all elevated biomarker levels. Creatinine and urea were adjusted, TGF-β/Smad signaling was suppressed causing down-regulation to microRNA-21. Nitric oxide, reactive oxygen species, glutathione and kidney injury molecule-1 were normalized in comparison with the γ-irradiated group. The renohistopathological analysis was consistent with the biochemical study. Phytochemical analysis resulted in the isolation of two diterpenoids (γ-methoxybutenolide clerodane diterpene and 16(R/S)-hydroxycleroda-3,13-dien-16,15-olide-2-one), aporphine alkaloid (anonaine) and flavonol (kaempferol-3-O-rutinoside). The latter two showed moderate anti-histaminic activities. Our results indicated that P. longifolia reduced oxidative stress and nephropathy in rats due to its anti-inflammatory principles. Graphical Abstract
SNU-333 Cells as an Appropriate Cell Line for the Orthotopic Renal Cell Carcinoma Model

Objective: To investigate a feasible candidate for an appropriate cell line for the orthotopic renal cell carcinoma (RCC) model. Methods: Normal human proximal tubule cells (HK-2) and RCC cells were used for MTT assay, Western blotting, sphere-forming assay, and orthotopic injection of BALB/c-nude mice. Immunohistochemistry was adopted in tissue arrays and orthotopic tumors. Results: Primary RCC cells showed resistance to a GPX4 inhibitor compared to HK-2 and to metastatic RCC cells, Caki-1. Caki-2 and SNU-333 cells showed resistance to ferroptosis via increased GPX4 and FTH1, respectively. RCC cells showed increased αSMA, in which Caki-2 and SNU-333 cells exhibited different epithelial–mesenchymal transition and cancer stem cell markers. Caki-1 and SNU-333 cells formed spheres in vitro and orthotopic tumor masses in vivo. The injected SNU-333 tumor only showed high intensities of CD10 and PAX8, markers of renal origin. Conclusion: SNU-333 cell line exhibited resistance via iron metabolism and stemness, and had tumor-initiating capacities in vitro and in vivo. These results suggest that among the cells tested, SNU-333 cells were the most promising for the establishment of an orthotopic RCC model for further researches.
Commonalities and Asymmetries in the Neurobiological Infrastructure for Language Production and Comprehension

Abstract The neurobiology of sentence production has been largely understudied compared to the neurobiology of sentence comprehension, due to difficulties with experimental control and motion-related artifacts in neuroimaging. We studied the neural response to constituents of increasing size and specifically focused on the similarities and differences in the production and comprehension of the same stimuli. Participants had to either produce or listen to stimuli in a gradient of constituent size based on a visual prompt. Larger constituent sizes engaged the left inferior frontal gyrus (LIFG) and middle temporal gyrus (LMTG) extending to inferior parietal areas in both production and comprehension, confirming that the neural resources for syntactic encoding and decoding are largely overlapping. An ROI analysis in LIFG and LMTG also showed that production elicited larger responses to constituent size than comprehension and that the LMTG was more engaged in comprehension than production, while the LIFG was more engaged in production than comprehension. Finally, increasing constituent size was characterized by later BOLD peaks in comprehension but earlier peaks in production. These results show that syntactic encoding and parsing engage overlapping areas, but there are asymmetries in the engagement of the language network due to the specific requirements of production and comprehension.
Multiple regulation and targeting effects of borneol in the neurovascular unit in neurodegenerative diseases

Efficient delivery of brain‐targeted drugs is highly important for the success of therapies in neurodegenerative diseases. Borneol has several biological activities, such as anti‐inflammatory and cell penetration enhancing effect, and can regulate processes in the neurovascular unit (NVU), such as protein toxic stress, autophagosome/lysosomal system, oxidative stress, programmed cell death and neuroinflammation. However, the influence of borneol on NVU in neurodegenerative diseases has not been fully explained. This study searched the keywords ‘borneol’, ‘neurovascular unit’, ‘endothelial cell’, ‘astrocyte’, ‘neuron’, ‘blood–brain barrier’, ‘neurodegenerative diseases’ and ‘brain disease’ in PubMed, BioMed Central, China National Knowledge Infrastructure (CNKI) and Bing search engines to explore the influence of borneol on NVU. In addition to the principle and mechanism of penetration of borneol in the brain, this study also showed its multiple regulation effects on NVU. Borneol was able to penetrate the blood–brain barrier (BBB), affecting the signal transmission between BBB and the microenvironment of the brain, downregulating the expression of inflammatory and oxidative stress proteins in NVU, especially in microglia and astrocytes. In summary, borneol is a potential drug delivery agent for drugs against neurodegenerative diseases.
Implementation of Percutaneous Transforaminal Endoscopic Discectomy in Competitive Elite Athletes With Lumbar Disc Herniation: Original Study and Review of the Literature

Background: Lumbar disc herniation (LDH) represents a frequent clinical entity in athletes. Surgical treatment of LDH with endoscopic spine surgical techniques has been proposed as a feasible alternative in these patients. Purpose: To study the particular outcomes of percutaneous transforaminal endoscopic discectomy (PTED) in competitive elite athletes with surgically treatable LDH. Study Design: Case series; Level of evidence, 4. Methods: A total of 55 competitive elite athletes with diagnosed LDH based on clinical and radiologic criteria were enrolled in this prospectively designed study. All patients underwent successful PTED. Clinical evaluation was conducted with the well-established visual analog scale for lower limb and low back pain separately. The 36-Item Short Form Health Survey (SF-36) was implemented for health-related quality of life analysis. Patients were assessed preoperatively and at regular postoperative intervals: 6 weeks and 3, 6, and 12 months, as well as 2 years. Results: Operated levels were L3-L4 (5.5%), L4-L5 (69.1%), and L5-S1 (25.4%). No major perioperative complications were observed. All patients successfully reached the end of follow-up at 2 years. Both visual analog scale scores (lower limb and low back pain) showed clinically and statistically significant improvement at 6 weeks postoperatively, with subsequent minor improvement and stabilization. All recorded SF-36 parameters demonstrated major clinical amelioration at 6 weeks, with subsequent minor but constant statistically significant improvement until the end of follow-up. Comparative evaluation of the SF-36 revealed that the physical function, bodily pain, role-emotional, and mental health parameters showed quantitatively greater improvement in comparison with rest indices. Conclusion: PTED constitutes a feasible and effective technique for surgical management of LDH in athletes, providing favorable outcomes in terms of postoperative pain and health-related quality of life. Proper performance of technique for specific cases of L5-S1 LDH may be more challenging, and these cases should be evaluated selectively for suitability for this procedure.
Effects of EGF, FGF, and PDGF on Canine Chondrocytes in Three-Dimensional Culture

Summary Three-dimensional (3-D) culture of chondrocytes has been shown to promote cell proliferation, differentiation, and production of matrix while providing for cell morphology and matrix characteristics that resemble normal articular cartilage (1-3). In a recently published study, enhanced glycosaminoglycan (GAG) production was demonstrated in canine chondrocytes in 3-D culture on cancellous bone substrate (3). The effects of growth factors known to be present in cryopreserved bone were suggested to be responsible. Various growth factors including epidermal growth factor (EGF), fibroblast growth factor (FGF), and plateletderived growth factor (PDGF) have been shown to enhance chondrocyte DNA production, mitotic activity, and matrix production (5-10). The objective of the study reported here was to evaluate the effects of one concentration of EGF, FGF, and PDGF on canine chondrocyte proliferation and production of normal matrix constituents in 3-D culture. Canine articular chondrocytes were cultured in three-dimensional medium for 25 days. EGF, FGF, and PDGF were added to the culture medium. Chondrocytes in 3-D culture maintained viability and differentiation. Cell morphology and matrix production resembled that of intact hyaline cartilage. Significant differences with respect to cell counts, glycosaminoglycan concentration, or collagen type II immuno-reactivity as the result of added growth factors were not found.