Miracle-dz/UniFAR-FTUs huggingface dataset:
On policy iteration as a Newton's method and polynomial policy iteration algorithms

Policy iteration is a popular technique for solving Markov decision processes (MDPs). It is easy to describe and implement, and has excellent performance in practice. But not much is known about its complexity. The best upper bound remains exponential, and the best lower bound is a trivial Ω(<i>n</i>) on the number of iterations, where <i>n</i> is the number of states.This paper improves the upper bounds to a polynomial for policy iteration on MDP problems with special graph structure. Our analysis is based on the connection between policy iteration and Newton's method for finding the zero of a convex function. The analysis offers an explanation as to why policy iteration is fast. It also leads to polynomial bounds on several variants of policy iteration for MDPs for which the linear programming formulation requires at most two variables per inequality (MDP(2)). The MDP(2) class includes deterministic MDPs under discounted and average reward criteria. The bounds on the run times include <i>O(mn<sup>2</sup> log m log W)</i> on MDP(2) and <i>O(mn<sup>2</sup> log m)</i> for deterministic MDPs, where <i>m</i> denotes the number of actions and <i>W</i> denotes the magnitude of the largest number in the problem description.
Disruption of Mbd5 in mice causes neuronal functional deficits and neurobehavioral abnormalities consistent with 2q23.1 microdeletion syndrome

2q23.1 microdeletion syndrome is characterized by intellectual disability, motor delay, autistic‐like behaviors, and a distinctive craniofacial phenotype. All patients carry a partial or total deletion of methyl‐CpG‐binding domain protein 5 (MBD5), suggesting that haploinsufficiency of this gene is responsible for the phenotype. To confirm this hypothesis and to examine the role of MBD5 in vivo, we have generated and characterized an Mbd5 gene‐trap mouse model. Our study indicates that the Mbd5+/GT mouse model recapitulates most of the hallmark phenotypes observed in 2q23.1 deletion carriers including abnormal social behavior, cognitive impairment, and motor and craniofacial abnormalities. In addition, neuronal cultures uncovered a deficiency in neurite outgrowth. These findings support a causal role of MBD5 in 2q23.1 microdeletion syndrome and suggest a role for MBD5 in neuronal processes. The Mbd5+/GT mouse model will advance our understanding of the abnormal brain development underlying the emergence of 2q23.1 deletion‐associated behavioral and cognitive symptoms.
Amyloid β Oligomers Disrupt Blood–CSF Barrier Integrity by Activating Matrix Metalloproteinases

The blood–CSF barrier (BCSFB) consists of a monolayer of choroid plexus epithelial (CPE) cells that maintain CNS homeostasis by producing CSF and restricting the passage of undesirable molecules and pathogens into the brain. Alzheimer's disease is the most common progressive neurodegenerative disorder and is characterized by the presence of amyloid β (Aβ) plaques and neurofibrillary tangles in the brain. Recent research shows that Alzheimer's disease is associated with morphological changes in CPE cells and compromised production of CSF. Here, we studied the direct effects of Aβ on the functionality of the BCSFB. Intracerebroventricular injection of Aβ1–42 oligomers into the cerebral ventricles of mice, a validated Alzheimer's disease model, caused induction of a cascade of detrimental events, including increased inflammatory gene expression in CPE cells and increased levels of proinflammatory cytokines and chemokines in the CSF. It also rapidly affected CPE cell morphology and tight junction protein levels. These changes were associated with loss of BCSFB integrity, as shown by an increase in BCSFB leakage. Aβ1–42 oligomers also increased matrix metalloproteinase (MMP) gene expression in the CPE and its activity in CSF. Interestingly, BCSFB disruption induced by Aβ1–42 oligomers did not occur in the presence of a broad-spectrum MMP inhibitor or in MMP3-deficient mice. These data provide evidence that MMPs are essential for the BCSFB leakage induced by Aβ1–42 oligomers. Our results reveal that Alzheimer's disease-associated soluble Aβ1–42 oligomers induce BCSFB dysfunction and suggest MMPs as a possible therapeutic target. SIGNIFICANCE STATEMENT No treatments are yet available to cure Alzheimer's disease; however, soluble Aβ oligomers are believed to play a crucial role in the neuroinflammation that is observed in this disease. Here, we studied the effect of Aβ oligomers on the often neglected barrier between blood and brain, called the blood–CSF barrier (BCSFB). This BCSFB is formed by the choroid plexus epithelial cells and is important in maintaining brain homeostasis. We observed Aβ oligomer-induced changes in morphology and loss of BCSFB integrity that might play a role in Alzheimer's disease progression. Strikingly, both inhibition of matrix metalloproteinase (MMP) activity and MMP3 deficiency could protect against the detrimental effects of Aβ oligomer. Clearly, our results suggest that MMP inhibition might have therapeutic potential.
Analysis of Clinical Feature and Management of Fish Bone Ingestion of Upper Gastrointestinal Tract

Objectives Fish bone impaction in the upper gastrointestinal tract is a common reason for patients to seek emergent care. The aim of this study was to find a clinical characteristics of patients with fish bone impaction in the upper gastrointestinal tract. Methods The study was conducted on 286 fish bone ingestion patients who complained of dysphagia and irritation after eating fish. The patients were treated according to the hospital protocol regarding the removal of fish bone. The parameters for the analysis included the age and sex of the patients, location and characteristics of the foreign body, method of removal, and type of fish. Results The fish bone could be observed by the physical examination in the oral cavity and laryngopharynx in 198 patients (69.23%). For those patients in whom the foreign body could not be observed in oral cavity and laryngopharynx, noncontrast computed tomography (CT) (from nasopharynx to diaphragm) was performed. The fish bone was discovered in the esophagus of 66 patients (23.08%). The esophageal fish bone was successfully removed by transnasal flexible esophagoscopy (TNE) in 55 patients, the fish bone moved to the stomach in 10 patients and one fish bone was removed by rigid esophagoscopy due to esophageal abscess. The esophageal fish bone was mostly found in patients aged 50 years and older. Conclusion Fish bone foreign body ingestion in the esophagus appeared to be more common in older patients. Incorporating noncontrast CT and TNE can facilitate decision-making and adequate treatment for patients with fish bone impactions.
Detection of Toxoplasma gondii copro-prevalence by polymerase chain reaction using repetitive 529 bp gene in feces of pet cats (Felis catus) in Yogyakarta, Indonesia

Aim: The aim of this research was to determine the copro-prevalence of Toxoplasma gondii using polymerase chain reaction (PCR) with repetitive 529 bp gene and to construct the phylogenetic tree of Toxoplasma oocyst from pet cats in Yogyakarta. Materials and Methods: 9 of 132 pet cat samples which serologically positive for Toxoplasma were used in this research. To determine the copro-prevalence of T. gondii in pet cat, 10 g of feces samples taken from practitioners and household cats in Yogyakarta were used in the PCR method utilizing repetitive 529 bp gene sequences. Results: The result shows that copro-prevalence by PCR using repetitive 529 bp gene was 33.3% (3/9). The phylogenetic tree of Toxoplasma grouped into two clades, which clade 1 consists of Toxoplasma isolates collected from pet cats in Yogyakarta Indonesia and T. gondii isolates from China and in clade 2 consist of the T. gondii isolates from India. Conclusion: Copro-prevalence of T. gondii in pet cats in Yogyakarta by means of PCR using repetitive 529 bp gene is around 33.3%.
Exploring the Factors of Foreign Language Anxiety Among Chinese Undergraduate English Majors and Non-English Majors

The study aims to examine three factors of foreign language anxiety i.e. speaking anxiety, foreign language classroom anxiety and teacher-generated anxiety, among Chinese English majors and non-English majors. The data were analysed to find out which of these factors invoke more anxiety. Research data collection was done via Foreign Language Anxiety Scale. A total number of subjects are 101, including 51 English majors and 50 non-English majors, with Chinese as their mother-tongue and learning English as a second language at university. The results revealed that English majors feel the middle level of foreign language speaking and classroom anxiety while Non-English majors experience high level of foreign language speaking and classroom anxiety. Moreover, both groups felt more anxious when they spoke to the teacher. Keeping in view the results of the study, some follow-up studies are recommended.
On some provably correct cases of variational inference for topic models

Variational inference is a very efficient and popular heuristic used in various forms in the context of latent variable models. It's closely related to Expectation Maximization (EM), and is applied when exact EM is computationally infeasible. Despite being immensely popular, current theoretical understanding of the effectiveness of variaitonal inference based algorithms is very limited. In this work we provide the first analysis of instances where variational inference algorithms converge to the global optimum, in the setting of topic models. More specifically, we show that variational inference provably learns the optimal parameters of a topic model under natural assumptions on the topic-word matrix and the topic priors. The properties that the topic word matrix must satisfy in our setting are related to the topic expansion assumption introduced in (Anandkumar et al., 2013), as well as the anchor words assumption in (Arora et al., 2012c). The assumptions on the topic priors are related to the well known Dirichlet prior, introduced to the area of topic modeling by (Blei et al., 2003). It is well known that initialization plays a crucial role in how well variational based algorithms perform in practice. The initializations that we use are fairly natural. One of them is similar to what is currently used in LDA-c, the most popular implementation of variational inference for topic models. The other one is an overlapping clustering algorithm, inspired by a work by (Arora et al., 2014) on dictionary learning, which is very simple and efficient. While our primary goal is to provide insights into when variational inference might work in practice, the multiplicative, rather than the additive nature of the variational inference updates forces us to use fairly non-standard proof arguments, which we believe will be of general interest.
Leptospirosis Prevalence in a Population of Yucatan, Mexico

Objective. To measure the prevalence of leptospirosis with two techniques in inhabitants of Izamal, Yucatan and to determine its relation with some exposure factors. Material and Methods. Transversal study in populations belonging to the HR62—IMSS-Opportunities working force in Izamal, Yucatan. Population, including 6 years of age or more, was randomly selected to participate in the study. A questionnaire was applied for personal ID and exposure factors; blood samples were taken for leptospirosis diagnosis. Simple frequencies, proportions, tendency and dispersion measures, prevalence and odd ratios and confidence intervals (CI) of 95%, and logistic regression model were obtained. Results. 204 patients, between 9 and 80 years old were included; 180 were positive (88.2%) with the dark-field technique; using MAT cutoff at 1 : 40, 178 patients (87.3%) were positive, while at 1 : 80 there were 103 positive (50.5%). The predominant serovar was Hardjo (94%). The highest prevalence was in women (96.3%) and in the >45-year-old group (95.7%); feminine gender (RM = 2.31 IC 95% 3.59–28.6), housewife (RM = 22.8 IC 95% 4.9–106.1), being in contact with stagnant water (RM = 5.2 IC 95% 1.7–15.9), and being in contact with domestic animal feces (RM = 5.1 IC 95% 1.9–13.1), these being the most significant variables in the final logistic regression model. Conclusions. The prevalence found was higher than the one nationally and internationally reported, representing an important finding, being in turn a local public health, maybe nationally. It is urgent to reinforce this research as well as to establish preventive and control measure to avoid exposure and health damages.
Borrelia burgdorferi Promotes the Establishment of Babesia microti in the Northeastern United States

Babesia microti and Borrelia burgdorferi, the respective causative agents of human babesiosis and Lyme disease, are maintained in their enzootic cycles by the blacklegged tick (Ixodes scapularis) and use the white-footed mouse (Peromyscus leucopus) as primary reservoir host. The geographic range of both pathogens has expanded in the United States, but the spread of babesiosis has lagged behind that of Lyme disease. Several studies have estimated the basic reproduction number (R 0) for B. microti to be below the threshold for persistence (<1), a finding that is inconsistent with the persistence and geographic expansion of this pathogen. We tested the hypothesis that host coinfection with B. burgdorferi increases the likelihood of B. microti transmission and establishment in new areas. We fed I. scapularis larva on P. leucopus mice that had been infected in the laboratory with B. microti and/or B. burgdorferi. We observed that coinfection in mice increases the frequency of B. microti infected ticks. To identify the ecological variables that would increase the probability of B. microti establishment in the field, we integrated our laboratory data with field data on tick burden and feeding activity in an R 0 model. Our model predicts that high prevalence of B. burgdorferi infected mice lowers the ecological threshold for B. microti establishment, especially at sites where larval burden on P. leucopus is lower and where larvae feed simultaneously or soon after nymphs infect mice, when most of the transmission enhancement due to coinfection occurs. Our studies suggest that B. burgdorferi contributes to the emergence and expansion of B. microti and provides a model to predict the ecological factors that are sufficient for emergence of B. microti in the wild.
A Computational Model of Afterimage Rotation in the Peripheral Drift Illusion Based on Retinal ON/OFF Responses

Human observers perceive illusory rotations after the disappearance of circularly repeating patches containing dark-to-light luminance. This afterimage rotation is a very powerful phenomenon, but little is known about the mechanisms underlying it. Here, we use a computational model to show that the afterimage rotation can be explained by a combination of fast light adaptation and the physiological architecture of the early visual system, consisting of ON- and OFF-type visual pathways. In this retinal ON/OFF model, the afterimage rotation appeared as a rotation of focus lines of retinal ON/OFF responses. Focus lines rotated clockwise on a light background, but counterclockwise on a dark background. These findings were consistent with the results of psychophysical experiments, which were also performed by us. Additionally, the velocity of the afterimage rotation was comparable with that observed in our psychophysical experiments. These results suggest that the early visual system (including the retina) is responsible for the generation of the afterimage rotation, and that this illusory rotation may be systematically misinterpreted by our high-level visual system.
Regulation by anti-inflammatory cytokines (IL-4, IL-10, IL-13, TGFβ)of interleukin-8 production by LPS- and/ or TNFα-activated human polymorphonuclear cells

The capacity to down-regulate the production of IL-8 by LPS-activated human polymorphonuclear cells (PMN) has been demonstrated for IL-4, IL-10, and TGFβ. We compared their relative capacities and further extended this property to IL-13. We report a great heterogeneity among individuals related to the responsiveness of PMN to the IL-4 and IL-13 inhibitory effects while their response to the IL-10 effect was homogenous. The inhibitory activities were observed at the transcriptional level. IL-8 induction by TNFα was, unlike its induction by LPS, resistant to the inhibitory effects of IL-10, IL-4, IL-13 and TGFβ. Furthermore, IL-10 and IL-4 inhibitory activity were less effective when TNFα was acting synergistically with LPS to induce IL-8 production by PMN. LPS-induced cell-associated IL-8, detected in the PMN cultures, could be marginally inhibited by IL-4 and IL-10. Altogether, our data demonstrate that IL-13 is able to inhibit LPS-induced IL-8 production by human PMN, although IL-10 remains the most active anti-inflammatory cytokine. Despite the capacity of IL-4, IL-10, and IL-13 to limit the production of TNFα-induced IL-8 in a whole blood assay, none was able to inhibit this production when studying isolated human polymorphonuclear cells.
Effects of a Bridging Exercise with Hip Adduction on the EMG Activities of the Abdominal and Hip Extensor Muscles in Females

[Purpose] This study compared the activities of the abdominal and hip extensor muscles between the bridging exercise (BE) and bridging exercise with hip adduction (BEHA) positions in women using electromyography (EMG). [Subjects] We recruited 14 healthy adult females with no history of low back pain. [Methods] The subjects performed bridging exercises with and without hip adduction. The EMG activities of the rectus abdominis (RA), external oblique (EO), internal oblique (IO), and gluteus maximus (GM) muscles were recorded. [Result] The EMG activities of all muscles were significantly increased during the BEHA compared to the BE. [Conclusion] The bridging exercise with hip adduction produced greater activation of the abdominal and hip extensor muscles.
Generation Maintenance Scheduling in Power Market Based on Genetic Algorithm

This paper presents a genetic algorithm methodology for finding the optimum preventive maintenance schedule of generating units of a GENCO in a restructured power system. In this environment, management of GENCOs and grid is separated, each maximizing its own benefit. Therefore, the principle to draw up the unit maintenance scheduling will be changed significantly. The profit of a GENCO is defined as the total profit, which is the sum of the individual units' profits from the auctions over the horizon. So every GENCO hopes to put its maintenance on the weeks when the market clearing price (MCP) is lowest, so that maintenance investment loss (MIL) descends. Therefore, objective function for the GENCO is to sell electricity as much as possible, according to the market clearing price forecast. Various technical constraints such as generation capacity, duration of maintenances and maintenance continuity are being taken in to account. The objective function of ISO is to maximize the reserve capacity of the system at every time interval, subject to the energy purchase cost doesn't increase from a predetermined amount when the units of GENCOs are in outage for maintenance. Therefore two objective functions will be finding for fairly maintenance scheduling in restructured power systems. Each GENCO specifies optimum maintenance scheduling according to its objective function and hands it over to ISO. The ISO compares its reliability index with reliability index related to maintenance scheduling of GENCOs. If they are close enough in terms of reliability, it will be approved; otherwise the units, which violate the constraints, will be identified and ISO asks for time rescheduling
Prediction of human eye fixations using symmetry

Humans are very sensitive to symmetry in visual patterns. Reaction time experiments show that symmetry is detected and recognized very rapidly. This suggests that symmetry is a highly salient feature. Existing computational models of saliency, however, have mainly focused on contrast as a measure of saliency. In this paper, we discuss local symmetry as a measure of saliency. We propose a number of symmetry models and perform an eye-tracking study with human participants viewing photographic images to test the models. The performance of our symmetry models is compared with the contrast-saliency model of Itti, Koch and Niebur (1998). The results show that the symmetry models better match the human data than the contrast model, which indicates that symmetry can be regarded as a salient feature.
Sum-Max Monotonic Ranked Joins for Evaluating Top-K Twig Queries on Weighted Data Graphs

In many applications, the underlying data (the web, an XML document, or a relational database) can be seen as a graph. These graphs may be enriched with weights, associated with the nodes and edges of the graph, denoting application specific desirability/penalty assessments, such as popularity, trust, or cost. A particular challenge when considering such weights in query processing is that results need to be ranked accordingly. Answering keyword-based queries on weighted graphs is shown to be computationally expensive. In this paper, we first show that answering queries with further structure imposed on them remains NP-hard. We next show that, while the query evaluation task can be viewed in terms of ranked structural-joins along query axes, the monotonicity property, necessary for ranked join algorithms, is violated. Consequently, traditional ranked join algorithms are not directly applicable. Thus, we establish an alternative, sum-max monotonicity property and show how to leverage this for developing a self-punctuating, horizon-based ranked join (HR-Join) operator for ranked twig-query execution on data graphs. We experimentally show the effectiveness of the proposed evaluation schemes and the HR-join operator for merging ranked sub-results under sum-max monotonicity.
Black-silicon-structured back-illuminated Ge-on-Si photodiode arrays

Backside illumination enables an increase in photoactive area and numerical aperture of Ge-on-Si photodetectors for SWIR applications. The transparency of silicon in the infrared range (λ > 1.1 μm) allows a nearly lossless propagation of incoming light through the Si substrate and an application of various optical microstructures on the rear side of the Si substrate. Moreover, an aluminum front contact covering the whole top area serves as a mirror which extends the optical propagation of the detectable SWIR light through the absorbing layers and hence increases the quantum efficiency. We developed back-illuminated Ge-on-Si photodiodes to apply such microstructures. Especially the usage of light trapping structures to increase the quantum efficiency of the photodiodes shows great potential. Among the different microstructures we chose black silicon (b-Si) as a promising light trapping candidate. After the fabrication, photodiodes with different configurations were evaluated. The obtained results show a strong increase of the quantum efficiency due to both, the existence of an Al mirror and the application of b-Si.
The Impact of Corporate Social Responsibility on Firm Value: The Role of Customer Awareness

This paper shows that corporate social responsibility (CSR) and firm value are positively related for firms with high customer awareness, as proxied by advertising expenditures. For firms with low customer awareness, the relation is either negative or insignificant. In addition, we find that the effect of awareness on the CSR–value relation is reversed for firms with a poor prior reputation as corporate citizens. This evidence is consistent with the view that CSR activities can add value to the firm but only under certain conditions. This paper was accepted by Bruno Cassiman, business strategy.