Miracle-dz/UniFAR-FTUs huggingface dataset:
Proximal Reinforcement Learning: A New Theory of Sequential Decision Making in Primal-Dual Spaces

In this paper, we set forth a new vision of reinforcement learning developed by us over the past few years, one that yields mathematically rigorous solutions to longstanding important questions that have remained unresolved: (i) how to design reliable, convergent, and robust reinforcement learning algorithms (ii) how to guarantee that reinforcement learning satisfies pre-specified "safety" guarantees, and remains in a stable region of the parameter space (iii) how to design "off-policy" temporal difference learning algorithms in a reliable and stable manner, and finally (iv) how to integrate the study of reinforcement learning into the rich theory of stochastic optimization. In this paper, we provide detailed answers to all these questions using the powerful framework of proximal operators. The key idea that emerges is the use of primal dual spaces connected through the use of a Legendre transform. This allows temporal difference updates to occur in dual spaces, allowing a variety of important technical advantages. The Legendre transform elegantly generalizes past algorithms for solving reinforcement learning problems, such as natural gradient methods, which we show relate closely to the previously unconnected framework of mirror descent methods. Equally importantly, proximal operator theory enables the systematic development of operator splitting methods that show how to safely and reliably decompose complex products of gradients that occur in recent variants of gradient-based temporal difference learning. This key technical innovation makes it possible to finally design "true" stochastic gradient methods for reinforcement learning. Finally, Legendre transforms enable a variety of other benefits, including modeling sparsity and domain geometry. Our work builds extensively on recent work on the convergence of saddle-point algorithms, and on the theory of monotone operators.
THE IMPACT OF MUSICAL APTITUDE IN FOREIGN LANGUAGE ACQUISITION

Finnish students with musical aptitude seem to pronounce single isolated English phonemes better than their classmates whose ear for music is less accurate. This claim is supported by evidence from a study in which 71 lower secondary school students presented their English pronunciation skills under language laboratory conditions. Native language habits were transferred into the target language in both discrimination and pronunciation, and it was also shown that the differences between the two sound systems caused production problems. However, students with musical aptitude made clearly fewer mistakes than their non-musical classmates. Could this mean that music and linguistic abilities may share neural resources?
Analysis of commonly reported medical conditions amongst patients receiving dental implant therapy in private practice.

BACKGROUND The population seeking implants in private practice is a demographically and medically unique group. Understanding their medical needs can improve treatment planning and service delivery specifically for this population. METHODS Privately practising dental clinicians from Victoria, Australia, participated in a five-year retrospective study. Data were collected from the medical histories of 4116 patients who met the inclusion criterion of at least one implant placed within the study period of 1 January 2005 to 31 December 2009. Descriptive statistics were used to describe patient demographics and commonly reported medical conditions. RESULTS The most common age group to receive implant therapy was between 51 and 60 years (30.4% of patients). The patient population reported a broad range of co-morbidities including psychiatric disorders (83 patients), cardiovascular disorders (253 patients), gastrointestinal disorders (224 patients) and respiratory disorders (502 patients). Smoking was less prevalent amongst the study population compared to the general population. CONCLUSIONS The population assessed in this study was a medically diverse group. Clinicians must be familiar with their target demographic and understand how the common co-morbidities amongst this patient group can influence clinical decision making and outcomes.
Two viable quintessence models of the Universe: Confrontation of theoretical predictions with observational data

We use some of the recently released observational data to test the viability of two classes of minimally coupled scalar field models of quintessence with exponential potentials for which exact solutions of the Einstein equations are known. These models are very sturdy, depending on only one parameter - the Hubble constant. To compare predictions of our models with observations we concentrate on the following data: the power spectrum of the CMBR anisotropy as measured by WMAP, the publicly available data on type Ia supernovae, and the parameters of large scale structure determined by the 2-degree Field Galaxy Redshift Survey (2dFGRS). We use the WMAP data on the age of the universe and the Hubble constant to fix the free parameters in our models. We then show that the predictions of our models are consistent with the observed positions and relative heights of the first 3 peaks in the CMB power spectrum, with the energy density of dark energy as deduced from observations of distant type Ia supernovae, and with parameters of the large scale structure as determined by 2dFGRS, in particular with the average density of dark matter. Our models are also consistent with the results of the Sloan Digital Sky Survey (SDSS). Moreover, we investigate the evolution of matter density perturbations in our quintessential models, solve exactly the evolution equation for the density perturbations, and obtain an analytical expression for the growth index f . W e verify that the approximate relation f � Ω α also holds in our models.
Low levels of vitamin D in professional basketball players after wintertime : relationship with dietary intake of vitamin D and calcium

Introduction: Although vitamin D deficiency has a high worldwide prevalence among the general population, very little is known about vitamin status in athletes. Aim: To investigate serum vitamin D (2S[OH]D) levels after wintertime in mal e elite basketball players, and to relate these levels to the dietary intake of vitamin D and calcium. Methods: Subjects were 21 players from the same professional Spanish team. B100dsamples to assess 2S(OH)D levels were collected after wintertime during the 2008/2009 (April) and 2009/2010 (March) seasons. In addition, athletes completed 4-day dietary records to estimate energy consumption and a food frequency questionnaire to determine dietary vitamin D and calcium intake. Serum 2S(OH)D levels were 47.8 ± 21.8 nmol/L, with twelve subjects (57 %) being vitamin D deficient « 50 nmol/L), Results: Vitamin D intake was 139 ± 78 IU/day and calcium intake was 948 ± 419 mg/day. Serum 2S(OH)D levels correlated with the daily dietary intake of vitamin D (r = 0.65; P =0.001) and calcium (r =0.82; P < 0.001). Conclusion: Professional basketball players are at higher risk of hypovitaminosis D after wintertime. Adequate intake of dietary calcium and vitamin D is required if athletes are to avoid low serum 2S(OH)D levels when exposure to sunIight is Iimited. (Nutr Hosp . 2011;26:945-951) DOI:I0.330S/nh.2011. 26.S. 50S6
In vivo regulation of histidine ammonia-lyase activity from Streptomyces griseus

The enzyme histidine ammonia-lyase (histidase) is required for growth of Streptomyces griseus on L-histidine as the sole source of nitrogen. Histidase was induced by the inclusion of histidine in the medium, regardless of the presence of other carbon and nitrogen sources. Histidase activity was increased by a shift of culture incubation temperature from 30 to 37 degrees C. Conversely, upon induction of sporulation by either phosphate starvation or nutritional downshift, histidase underwent rapid inactivation. Nutrient replenishment fully reversed histidase inactivation while simultaneously permitting reinitiation of vegetative growth. In contrast to histidase inactivation during sporulation, histidase was activated after transition of a vegetatively growing culture to stationary phase. Although neither activation nor inactivation required de novo protein synthesis, inactivation appeared to involve a heat-labile protein. The results indicate that histidase activity is regulated in vivo by a process that responds to changes in the growth phase of the organism.
The ultrastructure of taeniid cestode oncospheres and localization of host-protective antigens

SUMMARY Taeniid eggs contain an infective larval form of the parasite, known as the oncosphere, which has been found to be highly susceptible to attack by the host's immune system and this fact has been exploited in the development of highly effective vaccines. Relatively little is known about the structure of taeniid oncospheres and the localization of host-protective antigens within or on the oncosphere. Here, we briefly review the current state of knowledge of the structure of the oncosphere and present preliminary data on the localization of a host-protective antigen within the oncospheres of Taenia ovis. The precise localization of the antigens, in the context of a detailed knowledge of the ultrastructure of the parasite, may reveal the immune mechanisms by which the taeniid parasites are killed by vaccine-induced immune responses, which, in turn, may provide clues about how vaccines could be developed against other parasitic helminths.
Optimizing routability in large-scale mixed-size placement

One of the necessary requirements for the placement process is that it should be capable of generating routable solutions. This paper describes a simple but effective method leading to the reduction of the routing congestion and the final routed wirelength for large-scale mixed-size designs. In order to reduce routing congestion and improve routability, we propose blocking narrow regions on the chip. We also propose dummy-cell insertion inside regions characterized by reduced fixed-macro density. Our placer consists of three major components: (i) narrow channel reduction by performing neighbor-based fixed-macro inflation; (ii) dummy-cell insertion inside large regions with reduced fixed-macro density; and (iii) pre-placement inflation by detecting tangled logic structures in the netlist and minimizing the maximum pin density. We evaluated the quality of our placer using the newly released DAC 2012 routability-driven placement contest designs and we compared our results to the top four teams that participated in the placement contest. The experimental results reveal that our placer improves the routability of the DAC 2012 placement contest designs and effectively reduces the routing congestion.
Differential predictability of four dimensions of affect intensity

Individual differences in affect intensity are typically assessed with the Affect Intensity Measure (AIM). Previous factor analyses suggest that the AIM is comprised of four weakly correlated factors: Positive Affectivity, Negative Reactivity, Negative Intensity and Positive Intensity or Serenity. However, little data exist to show whether its four factors relate to other measures differently enough to preclude use of the total scale score. The present study replicated the four-factor solution and found that subscales derived from the four factors correlated differently with criterion variables that assess personality domains, affective dispositions, and cognitive patterns that are associated with emotional reactions. The results show that use of the total AIM score can obscure relationships between specific features of affect intensity and other variables and suggest that researchers should examine the individual AIM subscales.
Biology and chemistry of the inhibition of nitric oxide synthases by pteridine‐derivatives as therapeutic agents

Inhibitors of the family of nitric oxide synthases (NOS‐I–III; EC 1.14.13.39) are of interest as pharmacological agents to modulate pathologically high nitric oxide (NO) levels in inflammation, sepsis, and stroke. In this article, we discuss the approach for targeting the unique (6R)‐5,6,7,8‐tetrahydro‐l‐biopterin (H4Bip) binding site of NOS by appropriate inhibitors. This binding site maximally increases enzyme activity and NO production from the substrate l‐arginine upon cofactor binding. The first generation of H4Bip‐based NOS inhibitors was based on 4‐amino H4Bip derivatives in analogy to anti‐folates such as methotrexate. In addition, we discuss the structure–activity relationship of a related series of 4‐oxo‐pteridine derivatives. Furthermore, molecular modeling studies provide an understanding of pterin antagonism on a structural level based on favorable and unfavorable interactions between protein binding site and ligands. These techniques include 3D‐QSAR (CoMFA, CoMSIA) to understand ligand affinity and GRID/consensus principal component analysis (CPCA) to learn about selectivity requirements. Collectively these approaches, in combination with the presented SAR and structural data, provide useful information for the design of novel NOS inhibitors with increased isoform selectivity. © 2004 Wiley Periodicals, Inc. Med Res Rev, 24, No. 5, 662–684, 2004
Importance of Specificity, Amount, and Intensity of Locomotor Training to Improve Ambulatory Function in Patients Poststroke

Abstract The majority of individuals poststroke recover the ability to walk overground, although residual impairments contribute to reduced walking speed, spatiotemporal asymmetries, inefficient gait, and limited walking activity in the home and community. A substantial number of studies have investigated the effects of various interventions on locomotor function in individuals poststroke; these studies vary widely in types of tasks practiced, the amount of practiced activities, and the intensity or workload during the intervention. In contrast, basic and applied studies have identified specific parameters of training that could be applied towards treatment of patients poststroke. More directly, the specificity, amount, and intensity of walking practice are thought to be critical variables of rehabilitation interventions that can facilitate plasticity of neuromuscular and cardiopulmonary systems and result in improved locomotor function. In the present commentary, we delineate the evidence and physiological rationale for providing large amounts of high-intensity locomotor training to improve ambulatory function in individuals poststroke. Additional evidence is presented to indicate that improvements in non-walking tasks, such as static balance and performance of transfers, may also occur following locomotor training. We further evaluate previous and more recent studies in the context of these parameters and provide suggestions for providing locomotor training for patients with stroke in the clinical setting.
Feature-based time-series analysis

This work presents an introduction to feature-based time-series analysis. The time series as a data type is first described, along with an overview of the interdisciplinary time-series analysis literature. I then summarize the range of feature-based representations for time series that have been developed to aid interpretable insights into time-series structure. Particular emphasis is given to emerging research that facilitates wide comparison of feature-based representations that allow us to understand the properties of a time-series dataset that make it suited to a particular feature-based representation or analysis algorithm. The future of time-series analysis is likely to embrace approaches that exploit machine learning methods to partially automate human learning to aid understanding of the complex dynamical patterns in the time series we measure from the world.
Glue sniffing: A description of social, psychological and neuropsychological factors in a group of South African ‘street children’

Twenty-two black South African boys who had histories of prolonged glue sniffing, but who were currently not abusing solvents, were evaluated by means of neuropsychological and neurological procedures. On the neuropsychological procedures the group demonstrated multiple deficits which included visual-spatial difficulties, visual scanning problems, language deficiencies, motor incoordination, memory deficits, and attention and concentration problems. The neurological examination showed that two boys had cerebellar signs. Nine of the recorded electroencephalograms were found to be abnormal. The backgrounds and personality profiles of the group together with the circumstances which led to their glue-sniffing activities are discussed.
CCR 20th Anniversary Commentary: Preclinical Study of Proteasome Inhibitor Bortezomib in Head and Neck Cancer

In a study published in the May 1, 2001, issue of Clinical Cancer Research, Sunwoo and colleagues provided evidence for proteasome inhibition of NF-κB and tumorigenesis, supporting early-phase clinical trials in solid malignancies of the upper aerodigestive tract. Subsequent clinical studies uncovered a dichotomy of responses in patients with hematopoietic and solid malignancies, and the mechanisms of resistance. Clin Cancer Res; 21(5); 942–3. ©2015 AACR. See related article by Sunwoo et al., Clin Cancer Res 2001;7(5) May 2001;1419–28
Toward Practical and Intelligent Routing in Vehicular Ad Hoc Networks

Apart from vehicle mobility, data rate (bit rate) and multihop data transmission efficiency (including route length) have a significant impact on the performance of a routing protocol for vehicular ad hoc networks (VANETs). Existing routing protocols do not seriously address all these issues and are not evaluated for a real VANET environment. Therefore, it is difficult for these protocols to attain a high performance and to work properly under various scenarios. In this paper, we first discuss the challenges of routing in VANETs based on the data acquired from real-world experiments and then propose a routing protocol that is able to learn the best transmission parameters by interacting with the environment. The protocol takes into account multiple metrics, specifically data transmission rate, vehicle movement, and route length. We use both real-world experiments and computer simulations to evaluate the proposed protocol.
The generation of thrombin in vivo induces the selective loss of high molecular weight multimers of von Willebrand factor and the reversible sequestration of platelets

Summary Various levels of thrombin generation were induced by the infusion of a combination of factor Xa (F.Xa) and phosphatidylcholine/phosphatidylserine (PCPS) vesicles into normal dogs and non‐human primates. In the dog, an immediate loss of von Willebrand factor antigen (vWF:Ag) with a progressive recovery to normal levels by 45 min was observed. Multimeric assay demonstrated a selective loss of high molecular weight multimers (HMWM) with subsequent replacement. At low doses, in non‐human primates (chimpanzees), identical changes to those seen in the dog were observed and this was associated with an equivalent loss of ristocetin co‐factor activity (vWF:RCoF). At high dose B reversal of the wWF response occurred with levels increasing to twice that of baseline values by 2 min and multimeric analysis demonstrated the presence of abnormally large multimers and increased vWF:RCoF specific activity, suggesting that the response at each dosage reflected a net balance of consumption over release. This was supported by in vitro simulation where increasing thrombin generation was associated with a selective loss of HMWM without replacement. In both species, an immediate fall in platelet count occurred and this was directly correlated with the amount of thrombin generated. Full recovery occurred within 45 min and isotopic labelling studies demonstrated that platelet sequestration rather than consumption was occurring. These studies demonstrate that thrombin generation in vivo is associated with a selective loss of the multimeric forms of vWF known to interact with platelets and this may provide an in vivo model to characterize the physiology/pathophysiology of this primary event in haemostasis.
Temporal Logics with Reference Pointers and Computation Tree Logics

ABSTRACT A complete axiomatic system CTLrp is introduced for a temporal logic for finitely branching ω+ -trees in a language extended with so called reference pointers. Syntactic and semantic interpretations are constructed for the branching time computation tree logic CTL* into CTLrp. In particular, that yields a complete axiomatization for the translations of all valid CTL*-formulae. Thus, the temporal logic with reference pointers is brought forward as a simpler (with no path quantifiers), but in a way more expressive medium for reasoning about branching time.
Decreased Transplant Arteriosclerosis in Endothelial Nitric Oxide Synthase-Deficient Mice

Background. Occlusive vascular changes, characterized by the formation of a neointima with lumen obstruction, are key histologic findings of allograft arteriosclerosis. Vascular integrity of the graft is critically dependent on nitric oxide (NO), synthesized by NO synthases (NOS), of which three isoforms have been located in the arterial wall: endothelial NOS (eNOS), inducible NOS, and neuronal NOS (nNOS). We have studied the role of NOS in a murine model of aortic allograft rejection. Methods. The descending thoracic aorta of donor mice (BALB/c mice) was transplanted into two groups of recipients: (a) C57BL/6J and (b) C57BL/6J mice homozygous (−/−) for a knockout of the eNOS gene (eNOS−/−). Results. After 4 weeks, pronounced neointima formation, upregulated expression of adhesion molecules, and increased infiltration by inflammatory cells were demonstrated in wild-type recipient mice, whereas eNOS−/− recipient mice were protected from neointima development by a significantly increased synthesis of NO, as shown by increased formation of cGMP; this was mainly explained by upregulation of inducible NOS and nNOS. Conclusions. Upregulation of inducible NOS and nNOS isoforms may be beneficial in preventing allograft arteriosclerosis in the early posttransplant period.
Does Growing Up in a High Crime Neighborhood Affect Youth Criminal Behavior

This paper investigates the effect of early exposure to neighborhood crime on subsequent criminal behavior of youth exploiting a unique natural experiment between 1986 and 1998 when refugee immigrants to Denmark were assigned to neighborhoods quasi-randomly. We find strong evidence that the share of young people convicted for crimes, in particular violent crimes, in the neighborhood increases convictions of male assignees later in life. No such effects are found for other measures of neighborhood crime including the rate of committed crimes. Our findings suggest social interaction as a key channel through which neighborhood crime is linked to individual criminal behavior.
Maximal expectation as upper confidence bound for multi-armed bandit problems

State of the art algorithms for stochastic multi-armed bandit problem are based on either one of the two principles: optimism in face of uncertainty, and probability matching. In this paper, we provide a unified approach to combine these principles. The major result is a new upper confidence bound formula, UCB-max, by which the p-value of an arm's UCB value roughly matches the arm's probability of been optimal. Our numerical study comparing UCB-max with other competitors (UCB-tuned, UCB-V, MOSS, KL-UCB and Thompson sampling) shows that UCB-max is remarkably efficient and stable.