Miracle-dz/UniFAR-FTUs huggingface dataset:
Multiagent learning in the presence of agents with limitations

Learning to act in a multiagent environment is a challenging problem. Optimal behavior for one agent depends upon the behavior of the other agents, which are learning as well. Multiagent environments are therefore non-stationary, violating the traditional assumption underlying single-agent learning. In addition, agents in complex tasks may have limitations, such as physical constraints or designer-imposed approximations of the task that make learning tractable. Limitations prevent agents from acting optimally, which complicates the already challenging problem. A learning agent must effectively compensate for its own limitations while exploiting the limitations of the other agents. My thesis research focuses on these two challenges, namely multiagent learning and limitations, and includes four main contributions. First, the thesis introduces the novel concepts of a variable learning rate and the WoLF (Win or Learn Fast) principle to account for other learning agents. The WoLF principle is capable of making rational learning algorithms converge to optimal policies, and by doing so achieves two properties, rationality and convergence, which had not been achieved by previous techniques. The converging effect of WoLF is proven for a class of matrix games, and demonstrated empirically for a wide-range of stochastic games. Second, the thesis contributes an analysis of the effect of limitations on the game-theoretic concept of Nash equilibria. The existence of equilibria is important if multiagent learning techniques, which often depend on the concept, are to be applied to realistic problems where limitations are unavoidable. The thesis introduces a general model for the effect of limitations on agent behavior, which is used to analyze the resulting impact on equilibria. The thesis shows that equilibria do exist for a few restricted classes of games and limitations, but even well-behaved limitations do not preserve the existence of equilibria, in general. Third, the thesis introduces GraWoLF, a general-purpose, scalable, multiagent learning algorithm. GraWoLF combines policy gradient learning techniques with the WoLF variable learning rate. The effectiveness of the learning algorithm is demonstrated in both a card game with an intractably large state space, and an adversarial robot task. These two tasks are complex and agent limitations are prevalent in both. Fourth, the thesis describes the CMDragons robot soccer team strategy for adapting to an unknown opponent. (Abstract shortened by UMI.)
CS 364 B : Frontiers in Mechanism Design Lecture # 10 : Coverage Valuations and Convex Rounding ∗

Recall that the submodularity condition in (1) is a form of diminishing returns, but is strictly weaker than the gross substitute condition. If we ignore incentives and assume straightforward bidding, the Kelso-Crawford auction achieves a 1 2 -approximation of the optimal welfare. Another 1 2 -approximation is given in Exercise #25. Are there DSIC mechanisms with equally good guarantees? While the answer is “no” in general (see Section 7), this lecture gives an affirmative answer for an interesting subclass of submodular valuations: coverage valuations.
Dealing with multiple incompatible work-related identities: the case of artists

Purpose The purpose of this paper is to examine how artists deal with having multiple potentially incompatible work-related identities as a result of a career transition from making a living exclusively as artists to taking on additional work outside the creative industries. Design/methodology/approach In all, 40 semi-structured in-depth interviews were conducted by telephone with artists in the Netherlands. A grounded theory approach was used to analyze the findings. Findings Four different strategies for dealing with multiple potentially incompatible identities were identified: integration, accumulation, separation and dis-identification. The findings suggest that the informal social context, the support of rejection of important others, influenced the strategy adopted by the artists. Invalidation from the environment often leads to stress and separation or dis-identification strategies, while validation seems to lead to integration and accumulation strategies that are less psychologically straining. Practical implications The findings stress the importance of the external environment. While the workers had to deal with their own psychological stress and regret about not succeeding at working exclusively as artists, they also had to create a feasible story that allowed them to “sell” their transition to others. Originality/value Careers are becoming increasingly non-linear, and the number of workers who need to juggle multiple (potentially conflicting) work-related identities is rising. However, how workers deal with this has received only limited attention from researchers.
Crossover is provably essential for the Ising model on trees

Due to experimental evidence it is incontestable that crossover is essential for some fitness functions. However, theoretical results without assumptions are difficult. So-called real royal road functions are known where crossover is proved to be essential, i.e., mutation-based algorithms have an exponential expected runtime while the expected runtime of a genetic algorithm is polynomially bounded. However, these functions are artificial and have been designed in such a way that crossover is essential only at the very end (or at other well-specified points) of the optimization process.Here, a more natural fitness function based on a generalized Ising model is presented where crossover is essential throughout the whole optimization process. Mutation-based algorithms such as (μ+λ) EAs with constant population size are proved to have an exponential expected runtime while the expected runtime of a simple genetic algorithm with population size 2 and fitness sharing is polynomially bounded.
Early prediction of endocrine therapy effect in advanced breast cancer patients using 99mTc-depreotide scintigraphy.

UNLABELLED In vitro assessment of hormone receptor status using a ligand-binding assay or immunohistochemistry in breast cancer patients predicts endocrine responsiveness with an accuracy of only 60%-70%. Assessment of an end product of estrogen receptor stimulation, such as the progesterone receptor, is assumed to provide a measure of functional receptor content and has proven to increase predictive accuracy. In analogy with the estrogen-dependent regulation of somatostatin receptor (SSTR) expression in endocrine-responsive human breast cancer cell lines, efficient antiestrogen treatment in patients may result in a downregulation of SSTR at the cell surface in breast tumors. In vivo imaging of this molecular event by means of sequential (99m)Tc-depreotide scintigraphy could enable selection of breast cancer patients susceptible to endocrine therapy. METHODS Twenty patients with a diagnosis of advanced breast cancer in whom first- or second-line hormonal therapy was going to be initiated were included. Patients underwent sequential (99m)Tc-depreotide scintigraphy before and 3 wk after initiating hormonal treatment. Follow-up data were retrieved from routine clinical evaluation by means of physical examination, imaging (e.g., bone scan, CT, MRI) and blood analysis. Lesion-to-background ratios (L/BGs) were calculated on planar and SPECT images and a change of >25% between the baseline and follow-up scan was considered significant. RESULTS At 6 mo after initiation of treatment, 8 patients had stable disease and were considered to be responding to hormonal treatment, whereas 10 patients had progressive disease and were considered to be nonresponders. The positive and negative predictive values of baseline (99m)Tc-depreotide scintigraphy for endocrine responsiveness were 73% (8/11) and 100% (7/7), respectively. Sequential scans were always both positive or both negative. The relative change in (99m)Tc-depreotide uptake between sequential scans significantly differed in responders compared with nonresponders (P= 0.017)-uptake decreased in the first group and increased in the latter. As such, baseline (99m)Tc-depreotide scintigraphy combined with the changes in tracer uptake between the baseline and follow-up scan predicted endocrine responsiveness with an accuracy of 100%. CONCLUSION Sequential (99m)Tc-depreotide scintigraphy could allow for separation of responders and nonresponders immediately or as early as 3 wk after initiation of treatment.
Causes of Death among AIDS Patients after Introduction of Free Combination Antiretroviral Therapy (cART) in Three Chinese Provinces, 2010–2011

Introduction Although AIDS-related deaths have had significant economic and social impact following an increased disease burden internationally, few studies have evaluated the cause of AIDS-related deaths among patients with AIDS on combination anti-retroviral therapy (cART) in China. This study examines the causes of death among AIDS-patients in China and uses a methodology to increase data accuracy compared to the previous studies on AIDS-related mortality in China, that have taken the reported cause of death in the National HIV Registry at face-value. Methods Death certificates/medical records were examined and a cross-sectional survey was conducted in three provinces to verify the causes of death among AIDS patients who died between January 1, 2010 and June 30, 2011. Chi-square analysis was conducted to examine the categorical variables by causes of death and by ART status. Univariate and multivariate logistic regression were used to evaluate factors associated with AIDS-related death versus non-AIDS related death. Results This study used a sample of 1,109 subjects. The average age at death was 44.5 years. AIDS-related deaths were significantly higher than non-AIDS and injury-related deaths. In the sample, 41.9% (465/1109) were deceased within a year of HIV diagnosis and 52.7% (584/1109) of the deceased AIDS patients were not on cART. For AIDS-related deaths (n = 798), statistically significant factors included CD4 count <200 cells/mm3 at the time of cART initiation (AOR 1.94, 95%CI 1.24–3.05), ART naïve (AOR 1.69, 95%CI 1.09–2.61; p = 0.019) and age <39 years (AOR 2.96, 95%CI 1.77–4.96). Conclusion For the AIDS patients that were deceased, only those who initiated cART while at a CD4 count ≥200 cells/mm3 were less likely to die from AIDS-related causes compared to those who didn’t initiate ART at all.
A Novel Intrusion Detection System for Ad hoc Networks

Mobile ad hoc network (MANET) is an emerging technology and have great strength to be applied in critical situations like battlefields and commercial applications such as building, traffic surveillance. But due to some of its characteristics like open medium, very dynamic topology, lack of infrastructure and lack of centralized management authority, MANET presents serious vulnerabilities to security attacks. In this paper, I propose an intrusion detection scheme based on extended finite state machines. I provide formal specification of the correct behavior of the routing protocol and by the means of a backward checking algorithm, detect run-time violations of the implementation. I chose the standard proactive routing protocol OLSR as a case study and show that my approach allows detecting several kinds of attacks as well as deal with anomalies
An alert fusion model inspired by artificial immune system

In the recent years one of the most focused topics in the field of network security and more specifically intrusion detection systems was to find a solution to reduce the overwhelming alerts generated by IDSs in the network. Inspired by human defence system and danger theory we propose a complementary subsystem for IDS which can be integrated into any existing IDS models to aggregate the alerts in order to reduce them, and subsequently reduce false alarms among the alerts. After evaluation using different datasets and attack scenarios, our model managed to aggregate the alerts by the average rate of 97.5 percent.
Algorithms for image processing in graph-based volumetric segmentation

The aim of this article is to present a method to detect visual objects from color digital images by volumetric segmentation. We will discuss algorithms for visual and multimedia computing. The problem of partitioning images into homogenous regions or semantic entities is a basic problem for identifying relevant objects. The presented method is a general-purpose volumetric segmentation method and it produces results from two different perspectives: (a) from the perspective of perceptual grouping of regions from the images, and also (b) from the perspective of determining regions if the input spatial images contain visual objects. We present a unified framework for volumetric image segmentation and prism cells used is the first run into volumetric segmentation algorithms. The major concept used in graph-based volumetric segmentation method is the concept of homogeneity of volumes and thus the edge weights are based on color distance. The complexity of our original algorithm for volumetric segmentation is linear.
Conserved regulatory elements of the promoter sequence of the gene rpoH of enteric bacteria.

The rpoH regulatory region of different members of the enteric bacteria family was sequenced or downloaded from GenBank and compared. In addition, the transcriptional start sites of rpoH of Yersinia frederiksenii and Proteus mirabilis, two distant members of this family, were determined. Sequences similar to the sigma(70) promoters P1, P4 and P5, to the sigma(E) promoter P3 and to boxes DnaA1, DnaA2, cAMP receptor protein (CRP) boxes CRP1, CRP2 and box CytR present in Escherichia coli K12, were identified in sequences of closely related bacteria such as: E.coli, Shigella flexneri, Salmonella enterica serovar Typhimurium, Citrobacter freundii, Enterobacter cloacae and Klebsiella pneumoniae. In more distant bacteria, Y.frederiksenii and P.mirabilis, the rpoH regulatory region has a distal P1-like sigma(70) promoter and two proximal promoters: a heat-induced sigma(E)-like promoter and a sigma(70) promoter. Sequences similar to the regulatory boxes were not identified in these bacteria. This study suggests that the general pattern of transcription of the rpoH gene in enteric bacteria includes a distal sigma(70) promoter, >200 nt upstream of the initiation codon, and two proximal promoters: a heat-induced sigma(E)-like promoter and a sigma(70) promoter. A second proximal sigma(70) promoter under catabolite-regulation is probably present only in bacteria closely related to E.coli.
Maximal Strength Training as a Therapeutic Approach in Long-Standing Anorexia Nervosa: A Case Study of a Woman With Osteopenia, Menstrual Dysfunction, and Compulsive Exercise

In persons with anorexia nervosa (AN), compulsive exercise and osteopenia are common symptoms. Although treatment of osteopenia besides weight regain is lacking, maximal strength training (MST) has been found to be effective in other populations. Such training has not been prescribed to those with AN due to uncertainty of tolerance. We therefore examined use of MST in a woman with long-standing AN, osteopenia, menstrual dysfunction, and compulsive exercise. The MST intervention consisted of four exercises: three sets of five repetitions maximum (RM), 3 times per week for 16 weeks. We examined muscle strength, bone mineral density (BMD), AN psychopathology, and compulsive exercise at baseline, posttest, and 6-month follow-up. Attendance rate was 100%. The subject improved muscle strength by 20% to 40%. BMD in lumbar spine improved by 4% to posttest, and by 8% from baseline to 6-month follow-up. The BMD T-scores shifted from values classified as osteopenic to normal values throughout the course of the intervention, despite continuance of menstrual dysfunction and lack of weight gain. No changes in AN psychopathology or levels of compulsive exercise were detected. Perceived psychological benefits including new bodily experiences were self-reported by the subject, emphasizing the importance of close follow-up by competent instructors.
Using fuzzy techniques in Business Performance Management

An important part of business performance management (BPM) is identifying strategic targets for the organisation, cascading them down into tactical and operational targets and finally optimising operational levers or actions as to achieve the given targets. In order to do this, performance metrics have to be defined at all levels and relationships between levers and metrics have to be mathematically modelled. Thereby, traditional BPM cannot deal with imprecise information although imprecision is a commonplace in real world applications. We discuss the most important functions of BPM and show how fuzzy and probabilistic techniques can be applied to process imprecise information. A few of the techniques have already been implemented in a research prototype.
The Timing and Location of Glial Cell Line-Derived Neurotrophic Factor Expression Determine Enteric Nervous System Structure and Function

Ret signaling is critical for formation of the enteric nervous system (ENS) because Ret activation promotes ENS precursor survival, proliferation, and migration and provides trophic support for mature enteric neurons. Although these roles are well established, we now provide evidence that increasing levels of the Ret ligand glial cell line-derived neurotrophic factor (GDNF) in mice causes alterations in ENS structure and function that are critically dependent on the time and location of increased GDNF availability. This is demonstrated using two different strains of transgenic mice and by injecting newborn mice with GDNF. Furthermore, because different subclasses of ENS precursors withdraw from the cell cycle at different times during development, increases in GDNF at specific times alter the ratio of neuronal subclasses in the mature ENS. In addition, we confirm that esophageal neurons are GDNF responsive and demonstrate that the location of GDNF production influences neuronal process projection for NADPH diaphorase-expressing, but not acetylcholinesterase-, choline acetyltransferase-, or tryptophan hydroxylase-expressing, small bowel myenteric neurons. We further demonstrate that changes in GDNF availability influence intestinal function in vitro and in vivo. Thus, changes in GDNF expression can create a wide variety of alterations in ENS structure and function and may in part contribute to human motility disorders.
Control of agents in a multi-agent system using ZCS evolutionary classifier systems

The paper shows the usage of ZCS evolutionary systems in a multi-agent system where each agent is controlled with a different classifier system. This approach was tested on the cleaning robot task with multiple robots cleaning the room. Each robot has like in the original cleaning robot task a limited amount of carried trash and when the robot's stack is full he must go to a container and take out the junk.
Speech Intelligibility Evaluation of Low Bit Rate Speech Codecs

Low bit-rate voice coders are a key component of modern digital communication systems. This work investigates an objective measure of speech intelligibility which can be applied to non-waveform codecs as well as waveform codecs. Speech intelligibility is defined as the percentage of speech that can be correctly understood. Two types of channel impairments are studied including random bit error and bursty bit error. A novel objective speech intelligibility assessment algorithm is proposed based on a speech recognizer. Evaluation of intelligibility is conducted at both word, phoneme, and phoneme group level
Flower image recognition using difference image entropy

In this paper, we suggest and implement a flower image recognition system using Difference Image Entropy (hereinafter, DIE) and contour information of the object. Conventional studies on flower or leaf recognition have restrictions and limitations that include a sharp drop of recognition rate due to the varying positions and number of objects in the original object image. Hence, this paper focuses on 1) contour feature extraction technology by drawing and designating flower region of the user's interest, and 2) a distributed processing-based flower image recognition technology using DIE, for robust flower image recognition from the given original flower image with multi-flower objects. The suggested system was evaluated using ten species of flowers with each ten samples. Experimental results achieved an average recognition rate of 95%.
Generalized Robin Boundary Conditions, Robin-to-Dirichlet Maps, and Krein-Type Resolvent Formulas for Schr\

We study generalized Robin boundary conditions, Robin-to-Dirichlet maps, and Krein-type resolvent formulas for Schr\"odinger operators on bounded Lipschitz domains in $\bbR^n$, $n\ge 2$. We also discuss the case of bounded $C^{1,r}$-domains, $(1/2)
Interorganizational Workflow Nets : a Petri Net Based Approach for Modelling and Analyzing Interorganizational Workflows

Interorganizational workflows represent a new technique that offers companies a solution for managing business processes that involve more than one organization. In this paper, an interorganizational workflow will be modelled using a special class of nested Petri nets, interorganizational workflow nets (IWF-nets). This approach will allow the specification of the local workflows in the organizations involved and of the communication structure between them, permitting a clear distinction between these components. The paper defines a notion of behavioural correctness (soundness) and proves this property is decidable for IWF-
Effect of Core Laboratory and Multiple-Reader Interpretation of Angiographic Images on Follow-Up Outcomes of Coiled Cerebral Aneurysms: A Systematic Review and Meta-Analysis

BACKGROUND AND PURPOSE: Reported rates of recanalization following coil embolization vary widely across studies. Some confounders are known to affect outcomes but others remain questionable. In the current study, we assess differences in reported angiographic outcomes for cerebral aneurysms treated with coil embolization as a function of single vs multiple readers and site investigator vs core laboratory settings. MATERIALS AND METHODS: Our systematic review covered 1999–2011 by using Ovid MEDLINE and EMBASE. Search terms were subarachnoid hemorrhage, intracranial aneurysms, endovascular treatment, and coiling. Inclusion criteria were >50 aneurysms and available imaging follow-up. Study characteristics of interest were readers at the treating site(s) or at an independent core imaging facility, single vs multiple readers, number of aneurysms treated, mean aneurysm size, mean follow-up time, coil type, initial rupture status, and angiographic follow-up. We defined “unfavorable angiographic outcome” as either “recanalization,” <90% occlusion, or “incomplete occlusion. ” RESULTS: There were 104 (2.6%) of 4022 studies that fulfilled our inclusion criteria, comprising a total of 22,134 treated aneurysms, of which 15,969 (72.1%) had reported angiographic follow-up. The overall unfavorable outcome rate was 17.8% (2955/15,969 aneurysms). Eight (7.7%) of 104 studies reported core laboratory readings in which the pooled rate of unfavorable outcomes was 0.23 (95% CI, 0.19–0.28) compared with 0.16 (95% CI, 0.14–0.18) in readings from the treating sites (P < .001). The multivariate meta-regression suggested that core laboratory interpretation was significant for unfavorable outcomes (OR, 5.60; 95% CI, 2.01–15.60; P = .001), after adjustment for initial rupture status, aneurysm size, follow-up duration, and coil type. No significant association was found with use of multiple readers. CONCLUSIONS: Core laboratory studies tend to report higher rates of unfavorable outcomes compared with self-reported studies.