Miracle-dz/UniFAR-FTUs huggingface dataset:
Dynamic opponent modelling in two-player games

This thesis investigates decision-making in two-player imperfect information games against opponents whose actions can affect our rewards, and whose strategies may be based on memories of interaction, or may be changing, or both. The focus is on modelling these dynamic opponents, and using the models to learn high-reward strategies. The main contributions of this work are: 1. An approach to learn high-reward strategies in small simultaneous-move games against these opponents. This is done by using a model of the opponent learnt from sequence prediction, with (possibly discounted) rewards learnt from reinforcement learning, to lookahead using explicit tree search. Empirical results show that this gains higher average rewards per game than state-of-the-art reinforcement learning agents in three simultaneous-move games. They also show that several sequence prediction methods model these opponents effectively, supporting the idea of using them from areas such as data compression and string matching; 2. An online expectation-maximisation algorithm that infers an agent's hidden information based on its behaviour in imperfect information games; 3. An approach to learn high-reward strategies in medium-size sequential-move poker games against these opponents. This is done by using a model of the opponent learnt from sequence prediction, which needs its hidden information (inferred by the online expectation-maximisation algorithm), to train a state-of-the-art no-regret learning algorithm by simulating games between the algorithm and the model. Empirical results show that this improves the no-regret learning algorithm's rewards when playing against popular and state-of-the-art algorithms in two simplified poker games; 4. Demonstrating that several change detection methods can effectively model changing categorical distributions with experimental results comparing their accuracies to empirical distributions. These results also show that their models can be used to outperform state-of-the-art reinforcement learning agents in two simultaneous-move games. This supports the idea of modelling changing opponent strategies with change detection methods; 5. Experimental results for the self-play convergence to mixed strategy Nash equilibria of the empirical distributions of plays of sequence prediction and change detection methods. The results show that they converge faster, and in more cases for change detection, than fictitious play.
A friend within the heart: natriuretic peptide receptor signaling.

Cardiovascular disease remains as the leading cause of death throughout the industrialized nations of the world. Central to this statistic is our current inability to effectively repair or otherwise reverse severe forms of cardiac dysfunction and pathologic remodeling that characterizes a failing heart. In response to hypertension, ischemic disease, valvular insufficiency, viral myocarditis, and genetic mutations in sacomeric proteins, the myocardium undergoes a hypertrophic growth phase as a compensatory measure aimed at maintaining cardiac output (1). However, longstanding cardiac hypertrophy often precipitates the development of more serious complications such as sudden death, fibrotic restrictive cardiomyopathy, dilated cardiomyopathy, and overt failure (2). Given the relatively poor clinical prognosis associated with end-stage heart failure, much investigation has focused on understanding the molecular underpinnings associated with the preceding hypertrophic remodeling stage. Indeed, a number of signaling networks have been identified that directly regulate the hypertrophic growth of cardiac myocytes (3). For example, neuroendocrine factors and/or intrinsic stretch-sensitive sensors, which signal through G protein–coupled receptors, receptor tyrosine kinases, or directly to second messengers, are thought to function as the initiating stimulus for the hypertrophic response (Figure ​(Figure1). 1). These upstream events promote signal transduction through a network of kinases and phosphatases thereby coordinating an increase in gene expression, total protein production and/or accumulation, and rRNA content, thus driving the hypertrophic growth of myocytes. However, as is common to most biological response systems, a counter-regulatory network typically exists that buffers or antagonizes the forward cascade to permit selective reversal or graded responsiveness. Indeed, in this issue of the JCI, the article by Holtwick and colleagues provides definitive evidence for the existence of an antihypertrophic regulatory circuit within cardiac myocytes that functions to directly antagonize the hypertrophic growth response (4). This antihypertrophic regulatory circuit consists of the secreted atrial and B-type natriuretic peptides (ANP and BNP, respectively), and the ANP receptor guanylyl cyclase-A (GC-A). Figure 1 Cardiac myocytes have signaling pathways that agonize and antagonize hypertrophic growth. Neuroendocrine factors typically stimulate G protein–coupled receptors (GPCRs) and/or receptor tyrosine kinases (RTKs), which activate an array of intermediate .
Intense emotional experiences and enhanced training prevent memory loss induced by post-training amnesic treatments administered to the striatum, amygdala, hippocampus or substantia nigra

Abstract Most of the work related to the neurobiological basis of memory has been guided by the memory consolidation theory, which was derived from the seminal work of Müller and Pilzecker that was published over a century ago. This theory proposes that the transfer from short- to long-term memory is mediated by a process called consolidation, and while consolidation is taking place, the information to be stored is in a labile state. A great deal of experimentation has given strong support to this proposal, as it has been found repeatedly that interference with neural activity shortly after a learning experience impedes durable retention of that experience. A growing body of evidence, however, indicates that intense emotional experiences prevent memory loss induced by amnesic treatments, even when these treatments are administered intracerebrally shortly after the learning experience. This evidence implies that the memory consolidation theory cannot account for long-term memory formation when neural activity is disrupted while consolidation should be taking place, and it calls for new hypotheses to account for these findings.
Increased aortic stiffness: an unfavorable cardiorenal connection.

Despite the many potentially life-threatening complications that can accompany renal disease, cardiovascular disease (CVD) remains the leading cause of death in these patients. Patients with renal dysfunction have more cardiovascular events at an earlier age and they tolerate these events poorly.1,2 Established renal disease is associated with increased aortic stiffness and left ventricular (LV) hypertrophy, which are two important risk factors for CVD events. Conversely, aortic stiffness and LV mass have been related to each other and to early signs of renal damage, such as microalbuminuria.3,4 There are several potential explanations for this 3-way interrelationship between cardiac, aortic, and renal function. These organs share several increasingly prevalent risk factors, including advanced age, hypertension, and diabetes, which may contribute to a parallel deterioration in function. Alternatively, dysfunction in one organ may damage the others. Unfortunately, our understanding of these complex interrelationships is currently limited. The arterial and renal components of the cardio-aorto-renal menage au trois are highlighted in a review by Safar et al in this issue of Hypertension . 5 In work that has spanned nearly 3 decades, Professor Safar and colleagues have contributed immeasurably to our understanding of the role of abnormal arterial function in renal disease. As detailed in the review, they have shown that after accounting for common risk factors, increased arterial stiffness is present at various stages of renal dysfunction and represents a grave prognostic indicator. In an end-stage renal disease cohort, they demonstrated that arterial wall stiffness was an independent predictor of all-cause and cardiovascular mortality and that failure of arterial stiffness to improve after an intervention that lowered blood pressure was also associated with increased total mortality. Conversely, they found that serum creatinine on an index examination is associated with increased arterial stiffness in a cross-sectional analysis and is an independent predictor …
Relationship Between Insomnia, Depression, and Mortality: A 12-Year Follow-Up of Older Adults in the Community

The purpose of the study was to investigate the natural history of insomnia and its association with depression and mortality. In 1983, 1,870 randomly selected subjects aged 45–65 years answered a questionnaire on sleep and health. Of the 1,604 survivors in 1995, 1,244 (77.6%) answered a new questionnaire with almost identical questions. Mortality data were collected for the 266 subjects that had died during the follow-up period. Chronic insomnia was reported by 36.0% of women and 25.4% of men (χ2 = 9.7; p < .01). About 75% of subjects with insomnia at baseline continued to have insomnia at follow-up. Insomnia in women predicted subsequent depression (odds ratio [OR] = 4.1; 95% confidence interval [CI] 2.1–7.2) but was not related to mortality. In men, insomnia predicted mortality (OR = 1.7; 95% CI 1.2–2.3), but after adjustment for an array of possible risk factors, this association was no longer significant. Men with depression at baseline had an adjusted total death rate that was 1.9 times higher than in the nondepressed men (95% CI: 1.2–3.0).
Normalised LCS-based method for indexing multidimensional data cube

Query processors fail to retrieve information of interest in the presence of misspelled keywords given by users. The above problem persists because most of currently used indexing system does not have fault-tolerance ability to map the misspelled keywords to the correct records stored at physical level of databases. Therefore, the information retrieval systems need additional support of spell check mechanism with limitations for correction of misspelled keywords before submitting them to query processors. In this paper, a data indexing system is introduced for indexing multidimensional data cube, which maps the keywords to the records stored at physical level in multidimensional data structure and also has normalised longest common subsequence-based string approximation method to find correct keywords against misspelled keywords which comes directly to indexing processes through user queries. It provides more than 90% accurate results in mapping misspelled keywords to the physically stored records. These results are consistent even for large datasets.
Evaluating the Quality of Social Media Data in Big Data Architecture

The use of freely available online data is rapidly increasing, as companies have detected the possibilities and the value of these data in their businesses. In particular, data from social media are seen as interesting as they can, when properly treated, assist in achieving customer insight into business decision making. However, the unstructured and uncertain nature of this kind of big data presents a new kind of challenge: how to evaluate the quality of data and manage the value of data within a big data architecture? This paper contributes to addressing this challenge by introducing a new architectural solution to evaluate and manage the quality of social media data in each processing phase of the big data pipeline. The proposed solution improves business decision making by providing real-time, validated data for the user. The solution is validated with an industrial case example, in which the customer insight is extracted from social media data in order to determine the customer satisfaction regarding the quality of a product.
On the Configuration-Dependent Singularity of GFDM Pulse-Shaping Filter Banks

It is known that, under some configurations, the generalized frequency-division multiplexing (GFDM) pulse-shaper matrix is singular. Moreover, a GFDM pulse-shaper matrix may have unequal magnitude gains in different vector-space dimensions. This letter presents a Fourier-transform-based decomposition of the GFDM pulse-shaper matrix from which the above GFDM properties, as well as some other ones, can be readily appreciated. An upper bound on the nullity of the pulse-shaper matrix is obtained. We also show that, for some commonly conceivable designs, the nullity of the pulse-shaper matrix, if singular, is one. In the latter case, we also specify the corresponding null space. From this, GFDM signals can be designed, so that they do not fall in the null space.
Video Annotation by Cascading Microtasks: a Crowdsourcing Approach

This paper presents a general approach to perform crowdsourcing video annotation without requiring trained workers nor experts. It consists of dividing complex annotation tasks into simple and small microtasks and cascading them to generate a final result. Moreover, this approach allows using simple annotation tools rather than complex and expensive annotation systems. Also, it tends to avoid activities that may be tedious and time-consuming for workers. The cascade microtasks strategy is included in a workflow of three steps: Preparation, Annotation, and Presentation. A crowdsourcing video annotation process in which four different microtasks were cascaded was developed to evaluate the proposed approach. In the process, extra content such as images, text, hyperlinks and other elements are applied in the video enrichment. To support the experiment was developed a toolkit that includes Web-based annotation tools and aggregation methods, besides a presentation system for the annotated videos. This toolkit is open source and can be downloaded and used to replicate this experiment, as so to construct different crowdsourcing video annotation systems.
Oxidation Kinetics of Ethanol by Human Cytochrome P450 2E1

A number of cytochrome P450 (P450) 2E1 substrates are known to show kinetic deuterium isotope effects of ∼5 onK m (D K =D K m /H K m ), but not on k cat, in rat liver microsomes (e.g. N-nitrosodimethylamine, ethanol, and CH2Cl2). We observedD K m values of 3–5 for recombinant human P450 2E1-catalyzed ethanol oxidation. Replacing NADPH and O2 with the oxygen surrogate cumene hydroperoxide yielded similar results. Ferric P450 2E1 reduction was fast (k>1000 min−1) even in the absence of substrate. These results indicate that the basis for the increase inK m is in the latter portion of the catalytic cycle. The intrinsic isotope effect (D k) for ethanol oxidation was determined (competitively) to be 3.8, indicating that C–H bond cleavage is isotopically sensitive. Pre-steady-state studies showed a burst of product formation (k = 410 min−1), with the burst amplitude corresponding to the P450 concentration. Deuteration of ethanol resulted in an isotope effect of 3.2 on the rate of the burst. We conclude that product release is rate-limiting in the oxidation of ethanol to acetaldehyde by P450 2E1. The steady-state kinetics can be described by a paradigm in which thek cat approximates the rate of product release, and K m is an expression in which the denominator is dominated by the rate of C–H bond breaking.
Molecular evolution of the insect chemoreceptor gene superfamily in Drosophila melanogaster

The insect chemoreceptor superfamily in Drosophila melanogaster is predicted to consist of 62 odorant receptor (Or) and 68 gustatory receptor (Gr) proteins, encoded by families of 60 Or and 60 Gr genes through alternative splicing. We include two previously undescribed Or genes and two previously undescribed Gr genes; two previously predicted Or genes are shown to be alternative splice forms. Three polymorphic pseudogenes and one highly defective pseudogene are recognized. Phylogenetic analysis reveals deep branches connecting multiple highly divergent clades within the Gr family, and the Or family appears to be a single highly expanded lineage within the superfamily. The genes are spread throughout the Drosophila genome, with some relatively recently diverged genes still clustered in the genome. The Gr5a gene on the X chromosome, which encodes a receptor for the sugar trehalose, has transposed from one such tandem cluster of six genes at cytological location 64, as has Gr61a, and all eight of these receptors might bind sugars. Analysis of intron evolution suggests that the common ancestor consisted of a long N-terminal exon encoding transmembrane domains 1-5 followed by three exons encoding transmembrane domains 6-7. As many as 57 additional introns have been acquired idiosyncratically during the evolution of the superfamily, whereas the ancestral introns and some of the older idiosyncratic introns have been lost at least 48 times independently. Altogether, these patterns of molecular evolution suggest that this is an ancient superfamily of chemoreceptors, probably dating back at least to the origin of the arthropods.
Phytoplankton reduction in near-bottom water caused by filter-feeding Nereis diversicolor - implications for worm growth and population grazing impact

: Studies of vertical profiles of phytoplankton in the field combined with laboratory experi- ments demonstrated that reduction in phytoplankton concentrations in the near-bottom water layer, 5 to 10 cm in thickness on calm days, may play a significant role for the filter-feeding polychaete Nereis diversicolorin realizing its grazing capacity (estimated at 13.8 m3 m-' d-l in the shallow bay of Kertinge Nor, Denmark, in July 1994). Field-growth experiments were performed with worms transferred to U-shaped glass tubes placed at different heights (0, 4, 10 and 20 cm) above the seafloor. A considerably reduced specific growth rate of worms at the sea floor (0.2 * 1.1 'L d-l), compared to worms elevated just 10 cm above the sediment surface (2.5 k 0.8'Y" d.'), indicdtes that extremely meagre food cond~tions may be prevailing at the bottom. Experimental laboratory data on the development of vertical algal cell profiles were compared with predicted values obtained by means of a simple diffusion model. describes a boundary over through
[Expressions of Snail, Slug and KAI1 proteins in cervical carcinoma and their clinicopathological significance].

OBJECTIVE To explore the expression of Snail and Slug in primary cervical squamous cell carcinoma (CSCC) and their relationship with KAI1 expression. METHODS The expressions of Snail, Slug, and KAI1 proteins were examined by immunohistochemistry in 154 specimens of CSCC tissues, 50 specimens of cervical intraepithelial neoplasm (CIN), and 40 specimens of normal cervical tissues. RESULTS The positivity rates of Snail, Slug, and KAI1 expression were 0%, 2.5%, and 95.0% in normal cervical tissues, 32.0%, 34.0% and 64.0% in CIN tissues, and 66.2%, 66.9%, and 43.5% in CSCC tissues, respectively, showing significant differences in the rates among the 3 groups (P<0.05). The expressions of Snail, Slug, and KAI1 were significantly correlated with the histological grades of the tumor, depth of invasion, lymph node metastasis, International Federation of Gynecology and Obstetrics (FIGO) stages, and postoperative survival time (P<0.05). The expressions of Snail and Slug were positively correlated (r=0.752, P<0.001), and both of them were negatively correlated with the expression of KAI1 (P<0.001). Kaplan-Meier analysis showed that patients positive for Snail and Slug had significantly lower survival rates than the negative patients (P<0.001), while a positive expression of KAI1 was associated with a higher survival rate of the patients. Cox regression analysis identified Snail, KAI1, and FIGO stage as independent factors that affected the outcomes of CSCC (P<0.05). CONCLUSION The expressions of Snail, Slug, and KAI1 are related to the tumor grade, FIGO stage, invasive depth, lymph node metastasis, and prognosis of CSCC, and their combined detection can help estimate the outcomes of the patients.
Reliability studies on high current power modules with parallel mosfets

In the current range upto 300 amperes, MOSFETs have proved tobe the most acceptable and cost effective devices in power modules for power and auto sectors; beyond 600 amps, IGBT are the preferred devices. To extend the usable range, MOSFETs in parallel are becoming more and more acceptable, provided the design, manufacturability and long term reliability have been fully evaluated for built in current stresses, thermal stresses under steady and transient current loads and ruggedness under the harsh load environments. A half H bridge module with two mosfets in parallel (per arm of the bridge) with a combined current rating of 220 amps have been evaluated for various manufacturing approaches like heavy Al wirebonding, TAB contacts and Au bump approach. The studies have been done under current and thermal stressing with a view to identify possible failure modes. Studies under SEM / SAM indicate sensitivity to damages, if there is improper current distribution along the die as well as substrate; these local variation in current distributions are improper locations of the die contacts (in wire bonding approach), inherent potential variations arising out of current crowding, variations in the effective conductance / inductance of the source and drain circuits. The studies have resulted in the optimization of a power module design addressing critical second order reliability considerations. This work is significant, as the industry is looking for extension of MOSFET usage in higher power needs and at the same time would like to identify and eliminate all long term failure modes.
Vision and Driving in the Elderly

Background. This is an overview of a program of research to identify visual and cognitive factors which place older drivers at risk for vehicle crashes. Methods. A sample of 294 older drivers participated in a protocol which assessed eye health, visual sensory function (i.e., acuity, contrast sensitivity, peripheral field sensitivity), the size of the useful field of view (UFOV), and cognitive status. The sample was age-and crash-stratified to ensure inclusion of older adults covering a wide range of ages (55 to 90 years) and crash frequencies during the previous 5 years (0 to 4 crashes). The major dependent variable was the number of at-fault crashes incurred during the 5-year period before our protocol test date (retrospective study) and during the 3-year period after our test date (prospective study). Results. Older drivers with visual sensory impairment, cognitive impairment, and/or a constriction in the size of the useful field of view were at greater risk for crashes than were those without these problems. The UFOV test had better sensitivity and specificity than visual sensory or mental status tests in identifying those older drivers at risk for crashes. Conclusions. The UFOV test's superior predictability is most likely due to its reliance on both visual sensory abilities and higher order attentional skills. This study suggests that interventions which reduce either visual sensory or attentional impairment may also reduce accident risk in older drivers, an issue we are currently investigating.
Rationale for the Use of Antimicrobial Agents in Periodontal Disease

Abstract The traditional approach to treating dental decay and periodontal disease has often focused on caries, neglecting periodontal infection. The past 15 years have seen significant advances in the treatment of periodontal disease with antimicrobial therapy, both with and without moretraditional debridement or surgery. This article presents an overview of the use of antimicrobials, including an examination of treatment philosophies and the diagnosis of periodontal infection.