Miracle-dz/UniFAR-FTUs huggingface dataset:
Luck Matters: Understanding Training Dynamics of Deep ReLU Networks

We analyze the dynamics of training deep ReLU networks and their implications on generalization capability. Using a teacher-student setting, we discovered a novel relationship between the gradient received by hidden student nodes and the activations of teacher nodes for deep ReLU networks. With this relationship and the assumption of small overlapping teacher node activations, we prove that (1) student nodes whose weights are initialized to be close to teacher nodes converge to them at a faster rate, and (2) in over-parameterized regimes and 2-layer case, while a small set of lucky nodes do converge to the teacher nodes, the fan-out weights of other nodes converge to zero. This framework provides insight into multiple puzzling phenomena in deep learning like over-parameterization, implicit regularization, lottery tickets, etc. We verify our assumption by showing that the majority of BatchNorm biases of pre-trained VGG11/16 models are negative. Experiments on (1) random deep teacher networks with Gaussian inputs, (2) teacher network pre-trained on CIFAR-10 and (3) extensive ablation studies validate our multiple theoretical predictions.
High Dimensional Classification via Empirical Risk Minimization: Improvements and Optimality

In this article, we investigate a family of classification algorithms defined by the principle of empirical risk minimization, in the high dimensional regime where the feature dimension $p$ and data number $n$ are both large and comparable. Based on recent advances in high dimensional statistics and random matrix theory, we provide under mixture data model a unified stochastic characterization of classifiers learned with different loss functions. Our results are instrumental to an in-depth understanding as well as practical improvements on this fundamental classification approach. As the main outcome, we demonstrate the existence of a universally optimal loss function which yields the best high dimensional performance at any given $n/p$ ratio.
Anterior debridement may not be necessary in the treatment of tuberculous spondylitis of the thoracic and lumbar spine in adults: a retrospective study.

AIM Many aspects of the surgical treatment of patients with tuberculosis (TB) of the spine, including the use of instrumentation and the types of graft, remain controversial. Our aim was to report the outcome of a single-stage posterior procedure, with or without posterior decompression, in this group of patients. PATIENTS AND METHODS Between 2001 and 2010, 51 patients with a mean age of 62.5 years (39 to 86) underwent long posterior instrumentation and short posterior or posterolateral fusion for TB of the thoracic and lumbar spines, followed by anti-TB chemotherapy for 12 months. No anterior debridement of the necrotic tissue was undertaken. Posterior decompression with laminectomy was carried out for the 30 patients with a neurological deficit. RESULTS The mean kyphotic angle improved from 26.1° (- 1.8° to 62°) to 15.2° (-25° to 51°) immediately after the operation. At a mean follow-up of 68.8 months (30 to 144) the mean kyphotic angle was 16.9° (-22° to 54°), with a mean loss of correction of 1.6° (0° to 10°). There was a mean improvement in neurological status of 1.2 Frankel grades in those with a neurological deficit. Bony union was achieved in all patients, without recurrent infection. CONCLUSIONS Long posterior instrumentation with short posterior or posterolateral fusion is effective in the treatment of TB spine. It controls infection, corrects the kyphosis, and maintains correction and neurological improvement over time. TAKE HOME MESSAGE With effective anti-TB chemotherapy, a posterior only procedure without debridement of anterior lesion is effective in the treatment of TB spondylitis, and an anterior procedure can be reserved for those patients who have not improved after posterior surgery. Cite this article: Bone Joint J 2016;98-B:834-9.
Low-frequency excitations and their localization properties in glasses

Besides the dynamical slowing down signaled by an enormous increase of the viscosity approaching the glass transition, structural glasses show interesting anomalous thermodynamic features at low temperatures that hint at peculiar deviations from Debye's law at low enough frequencies. Theory, numerical simulations, and experiments suggest that deviation from Debye's law is due to soft-localized glassy modes that populate the low-frequency spectrum. We study the localization properties of the low-frequency modes in a three-dimensional supercooled liquid model. The density of states $D(\omega)$ is computed considering the inherent structures of configurations well thermalized at parental temperatures close to the dynamical transition $T_\text d$. We observe a crossover in the probability distribution of the inverse of the participation ratio that happens approaching $T_\text d$ from high temperatures. We show that a similar crossover is observed at high parental temperature when the translational invariance of the system is explicitly broken by a random pinning field.
Modelling high-level cognitive processes

Contents: Preface. Part I: Background. Modelling Cognition. An Introduction to COGENT. Part II: Modelling in Specific Domains. Overview. Arthimetic: A Cognitive Skill. Problem Solving. Deductive Reasoning. Decision Making. Sentence Processing. Executive Processes. Part III: Reflections. Reflections.
Multivitamin use among non-pregnant females of childbearing age in the Western North Carolina multivitamin distribution program.

BACKGROUND Daily consumption of 400 mcg of folic acid prior to conception and throughout the first trimester of pregnancy reduces the risk of neural tube defects (NTDs) by 50%-80%. A daily multivitamin with folic acid can ensure that females receive the recommended amount of folic acid during childbearing years. OBJECTIVE The purpose of this study was to determine if vitamin consumption is influenced by providing a free bottle of multivitamins to non-pregnant women of childbearing age during a face-to-face interaction with a health care provider in health departments. METHODS An eight-question survey was given to a sample of women who had received a free bottle of multivitamins. Vitamin consumption behavior prior to the intervention was compared to current usage at the time of the survey. RESULTS Twenty-five percent of all survey respondents reported taking a daily multivitamin or folic acid tablet before the intervention. Fifty-three percent reported taking a daily multivitamin 8-10 months later, a greater than two-fold increase (PR=2.1). Latino women reported the greatest increase in daily multivitamin intake, from 21% to 70% (PR=3.3). LIMITATIONS The results may be difficult to extrapolate to the general population as the survey population differs from the general population. Prior vitamin use was determined by patient recall. The intervention occurred simultaneously with a multifaceted, public folic acid campaign. CONCLUSIONS Eight to ten months after receiving a free three-month supply of multivitamins during a face-to-face interaction with a health care provider, the number of participants reporting daily use increased significantly.
Excitation/inhibition imbalance and impaired neurogenesis in neurodevelopmental and neurodegenerative disorders

Abstract The excitation/inhibition (E/I) balance controls the synaptic inputs to prevent the inappropriate responses of neurons to input strength, and is required to restore the initial pattern of network activity. Various neurotransmitters affect synaptic plasticity within neural networks via the modulation of neuronal E/I balance in the developing and adult brain. Less is known about the role of E/I balance in the control of the development of the neural stem and progenitor cells in the course of neurogenesis and gliogenesis. Recent findings suggest that neural stem and progenitor cells appear to be the target for the action of GABA within the neurogenic or oligovascular niches. The same might be true for the role of neuropeptides (i.e. oxytocin) in neurogenic niches. This review covers current understanding of the role of E/I balance in the regulation of neuroplasticity associated with social behavior in normal brain, and in neurodevelopmental and neurodegenerative diseases. Further studies are required to decipher the GABA-mediated regulation of postnatal neurogenesis and synaptic integration of newly-born neurons as a potential target for the treatment of brain diseases.
Chronic Pain at 4 Months in Hospitalized Trauma Patients: Incidence and Life Interference

Many studies report on the incidence of chronic pain. However, deficiencies exist in prior research making it difficult to generalize results to trauma patients. This study evaluated the incidence of chronic pain in trauma patients at 4 months posttrauma and effect chronic pain has on life interference. The incidence of chronic pain was present in 79.2% of trauma patients 4 months posttrauma and a strong positive correlation (n = 80, r = 0.79, P < 0.001) existed between chronic pain severity and the effect on life interference. Chronic pain is prevalent and causes significant life interference in traumatically injured patients.
AGING WORKERS

Chronological aging starts at birth and ends at death. Therefore, anyone in the work force (15–64 years of age) can be considered an aging worker. However, the definition of an aging worker is generally based on the period when major changes occur in relevant work related functions during the course of work life. Functional capacities, mainly physical, show a declining trend after the age of 30 years, and the trend can become critical after the next 15–20 years if the physical demands of work do not decline. On the other hand, workers’ perceptions of their ability to work indicate that some of them reach their peak before the age of 50 years, and five years later about 15–25% report that they have a poor ability to work, mainly those workers in physically demanding jobs but also those in some mentally demanding positions. Therefore, the ages of 45 or 50 years have often been used as the base criterion for the term “aging worker”. The main reason for the “early” definition of aging among workers from the occupational health point of view is that it gives better possibilities for preventive measures. The need for early action has been emphasised by the low participation rates of workers who are aged 55 years or older and by the early exit of this age group from work life all over the world.
Constructive Type-Logical Supertagging With Self-Attention Networks

We propose a novel application of self-attention networks towards grammar induction. We present an attention-based supertagger for a refined type-logical grammar, trained on constructing types inductively. In addition to achieving a high overall type accuracy, our model is able to learn the syntax of the grammar’s type system along with its denotational semantics. This lifts the closed world assumption commonly made by lexicalized grammar supertaggers, greatly enhancing its generalization potential. This is evidenced both by its adequate accuracy over sparse word types and its ability to correctly construct complex types never seen during training, which, to the best of our knowledge, was as of yet unaccomplished.
Multiclusters in Networks of Adaptively Coupled Phase Oscillators

Dynamical systems on networks with adaptive couplings appear naturally in real-world systems such as power grid networks, social networks as well as neuronal networks. We investigate a paradigmatic system of adaptively coupled phase oscillators inspired by neuronal networks with synaptic plasticity. One important behaviour of such systems reveals splitting of the network into clusters of oscillators with the same frequencies, where different clusters correspond to different frequencies. Starting from one-cluster solutions we provide existence criteria for multi-cluster solutions and present their explicit form. The phases of the oscillators within one cluster can be organized in different patterns: antipodal, double antipodal, and splay type. Interestingly, multi-clusters are shown to exist where different clusters exhibit different patterns. For instance, an antipodal cluster can coexist with a splay cluster. We also provide stability conditions for one- and multi-cluster solutions. These conditions, in particular, reveal a high level of multistability.
Infection with respiratory syncytial virus influences FasL-mediated apoptosis of pulmonary γδ T cells in a murine model of allergen sensitization

Abstract Background: It has been reported that adoptive transfer of γδ T cells increases the cellular infiltration, especially eosinophils, in the lungs of allergic mice, suggesting that γδ T cells may play a proinflammatory role in allergic airway inflammation. Respiratory syncytial virus (RSV) infection can decrease the number of Th2-type γδ T cells. However, the underlying mechanisms remain unknown. Methods: BALB/c mice were inoculated intranasally with RSV before or after sensitization to OVA. The amounts of Th1/Th2 cytokines as well as the levels of specific antibodies were determined by ELISA. The apoptotic death of pulmonary γδ T cells was analyzed by flow cytometry. Results: Adoptive transfer of γδ T cells increased the production of Th2 cytokines in the lungs and allergy-related antibodies in the serum, further confirming that γδ T cells act as pro-inflammatory cells or a promoter for the development of allergic asthma. RSV infection before sensitization to OVA enhanced apoptotic death of pulmonary γδ T cells. The percentage and absolute number of FasL-expressing γδ T cells in the lungs of allergic mice were elicited significantly by prior RSV infection. Blocking FasL with monoclonal antibody diminished apoptotic death of γδ T cells, suggesting that FasL is important for RSV-induced apoptosis of pulmonary γδ T cells. Conclusions: This work provides evidence that RSV infection suppresses the subsequent development of OVA-induced allergic responses partly by enhancing FasL-mediated apoptosis of pulmonary γδ T cells.
The Amplitude of Solar p-mode Oscillations from Three-dimensional Convection Simulations

The amplitude of solar p-mode oscillations is governed by stochastic excitation and mode damping, both of which take place in the surface convection zone. However, the time-dependent, turbulent nature of convection makes it difficult to self-consistently study excitation and damping processes through the use of traditional one-dimensional (1D) hydrostatic models. To this end, we carried out ab initio three-dimensional (3D), hydrodynamical numerical simulations of the solar atmosphere to investigate how p-modes are driven and dissipated in the Sun. The description of surface convection in the simulations is free from the tunable parameters typically adopted in traditional 1D models. Mode excitation and damping rates are computed based on analytical expressions whose ingredients are evaluated directly from the 3D model. With excitation and damping rates both available, we estimate the theoretical oscillation amplitude and frequency of maximum power, ν max , for the Sun. We compare our numerical results with helioseismic observations, finding encouraging agreement between the two. The numerical method presented here provides a novel way to investigate the physical processes responsible for mode driving and damping, and should be valid for all solar-type oscillating stars.
Taming Combinatorial Challenges in Optimal Clutter Removal Tasks

We examine an important combinatorial challenge in clearing clutter using a mobile robot equipped with a manipulator, seeking to compute an optimal object removal sequence for minimizing the task completion time, assuming that each object is grasped once and then subsequently removed. On the structural side, we establish that such an optimal sequence can be NP-hard to compute, even when no two objects to be removed have any overlap. Then, we construct asymptotically optimal and heuristic algorithms for clutter removal. Employing dynamic programming, our optimal algorithm scales to 40 objects. On the other hand, for random clutter, fast greedy algorithms tend to produce solutions comparable to these generated by the optimal algorithm.
Vogt−Koyanagi−Harada disease

Purpose of review The purpose of this article is to review the current literature on Vogt−Koyanagi−Harada (VKH) disease, including current treatment options and new research directions. Recent findings Recent publications on VKH disease show an increased focus on the immunogenetics and immune pathways associated with the development of VKH disease. There have also been advances in imaging modalities and techniques that may help to better elucidate the disease process in eyes with VKH disease. Summary VKH disease is an autoimmune, multisystem inflammatory disorder, the cause of which is still incompletely understood. Continued research may elucidate the causes and triggers of immune dysregulation in this disease, and in doing so, identify novel therapeutic targets.
How to Optimize Colon Cancer Surveillance in Inflammatory Bowel Disease Patients

Abstract:Colitis-associated colorectal neoplasia (CRN) is a well-known complication of chronic inflammation of the colon either with ulcerative colitis (UC) or colonic Crohn's disease (CD). Studies have shown that inflammatory bowel disease (IBD) patients have an overall higher risk for colorectal dysplasia and cancer compared to the general population and this risk is further increased by certain associated factors, including extent of disease, duration of disease, and age at onset. In addition, other risk factors not related to IBD can also further increase the risk for CRN, such as a family history of sporadic colon cancer and a concomitant diagnosis of primary sclerosing cholangitis. The society guidelines mostly agree on the appropriate time to begin CRN surveillance but vary somewhat on the appropriate intervals between surveillance colonoscopies. In addition, there is not yet a consensus on the appropriate method for surveillance. In this review, we discuss the risk for CRN in colonic IBD, the associated factors that further increase the risk for CRN, the current surveillance guidelines and the current methods available for CRN surveillance.
Commentary: A Host-Produced Quorum-Sensing Autoinducer Controls a Phage Lysis-Lysogeny Decision

With the recent publication by Silpe and Bassler (2019), considering phage detection of a bacterial quorum-sensing (QS) autoinducer, we now have as many as five examples of phage-associated intercellular communication (Table 1). Each potentially involves ecological inferences by phages as to concentrations of surrounding phage-infected or uninfected bacteria. While the utility of phage detection of bacterial QS molecules may at first glance appear to be straightforward, we suggest in this commentary that the underlying ecological explanation is unlikely to be simple.
Thyroid angiogenesis: endotheliotropic chemoattractant activity from rat thyroid cells in culture.

Thyroid enlargement in response to chronic hypersecretion of TSH reflects the coordinated growth of both parenchyma and stroma. Because Wollman et al. observed in propylthiouracil-fed rats that enlargement and remodeling of thyroid capillaries were strictly localized around follicles, they hypothesized that growth of perifollicular blood vessels is stimulated by angiogenic factors secreted by neighboring follicular epithelial cells. In support of this hypothesis, we report that media conditioned by rat thyroid cells were very active in an in vitro angiogenesis bioassay that measures stimulation of endothelial cell migration through chemotaxis membranes in microwell Boyden chamber assemblies. Primary cultures of thyroid cells from collagenase-dispersed glands from male or female Holtzman rats fed 0.01% propylthiouracil in the drinking water released activity that produced up to 5-fold increases in endothelial cell migration rates relative to those in identical unconditioned medium. Thyroid-derived activity was primarily chemotactic (i.e. only weakly chemokinetic) to both rabbit aortic and microvascular endothelial cells. That endotheliotropic activity is derived from thyroid parenchyma is indicated by the finding that media conditioned by FRTL cells, a clonally derived thyroid follicular epithelial cell line, produced parallel chemoattractant responses. Thyroid-conditioned media were also chemoattractant to mouse BALB/c-3T3 cells, which have endothelial cell characteristics. In contrast, thyroid-conditioned media did not increase the high spontaneous migration rate of Walker rat sarcoma (WR256) cells. T4, T3, thyroglobulin, bovine fibroblast growth factor (alpha and beta), and media conditioned by rabbit endothelial cells were inactive. Chemoattractant activity in serum containing conditioned media was retained by both 10,000 and 30,000 mol wt cut-off (MWCO) ultrafilters. Activity in serum-free thyroid-conditioned media was largely retained by 10,000 MWCO filters, but only partially retained by 30,000 MWCO filters; activity in the 30,000 filtrate was recoverable in a 10,000 MWCO retentate. These findings support the hypothesis that capillary growth during thyroid enlargement occurs, at least in part, as a result of a parenchymal-stromal (epithelial-mesenchymal) paracrine interaction mediated by specific endotheliotropic (angiogenic) factors released by follicular epithelial cells and distinct from T3, T4, and thyroglobulin.
Mechanism of Action of Suppressor Cells

The addition of a small proportion (10%) of in vivo concanavalin‐A (Con‐A)‐activated spleen cells to normal spleen cell cultures suppressed the primary immune response to sheep erythrocytes (SRBC) but had no effect on the thymus‐independent primary immune response to 3,5‐dinitro‐4‐hydroxy‐phenacetyl‐conjugated lipopolysaccharide. When Con‐A‐activated cells were added after 24 h, there was no suppression of the anti‐SRBC response but rather an enhanced response when few cells were admixed. Con‐A‐activated cells did not influence activation of normal cells by polyclonal T‐ and B‐cell activators, ft is concluded that Con‐A‐induced suppressor cells do not act on B cells but rather on helper cells (T tells or macrophages) at a very early stage of the immune response to thymus dependent antigens.
Nastaliq optical character recognition

Nastaliq is a calligraphic, beautiful and more aesthetic style of writing Urdu, the national language of Pakistan, also used to read and write in India and other countries of the region. OCRs developed for many world languages are already under efficient use but none exist for Nastaliq -- a calligraphic adaptation of the Arabic scrip which is inherently cursive in nature. In Nastaliq, word and character overlapping makes optical recognition more complex. This paper presents the ongoing research on Nastaliq Optical Character Recognition (NOCR). In this research, we have proposed a novel segmentation-free technique for the design and implementation of a Nastaliq OCR based on cross-correlation.