Query: Global-Locally Self-Attentive Dialogue State Tracker

Relevant passages:
The Second Dialog State Tracking Challenge <=SEP=> A spoken dialog system, while communicating with a user, must keep track of what the user wants from the system at each step. This process, termed dialog state tracking, is essential for a successful dialog system as it directly informs the system’s actions. The first Dialog State Tracking Challenge allowed for evaluation of different dialog state tracking techniques, providing common testbeds and evaluation suites. This paper presents a second challenge, which continues this tradition and introduces some additional features – a new domain, changing user goals and a richer dialog state. The challenge received 31 entries from 9 research groups. The results suggest that while large improvements on a competitive baseline are possible, trackers are still prone to degradation in mismatched conditions. An investigation into ensemble learning demonstrates the most accurate tracking can be achieved by combining multiple trackers.

Attention Is All You Need <=SEP=> The dominant sequence transduction models are based on complex recurrent or convolutional neural networks that include an encoder and a decoder. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 28.4 BLEU on the WMT 2014 Englishto-German translation task, improving over the existing best results, including ensembles, by over 2 BLEU. On the WMT 2014 English-to-French translation task, our model establishes a new single-model state-of-the-art BLEU score of 41.2 after training for 4.5 days on eight GPUs, a small fraction of the training costs of the best models from the literature. We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data.

Adam: A Method for Stochastic Optimization <=SEP=> We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters. The method is also appropriate for non-stationary objectives and problems with very noisy and/or sparse gradients. The hyper-parameters have intuitive interpretations and typically require little tuning. Some connections to related algorithms, on which Adam was inspired, are discussed. We also analyze the theoretical convergence properties of the algorithm and provide a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework. Empirical results demonstrate that Adam works well in practice and compares favorably to other stochastic optimization methods. Finally, we discuss AdaMax, a variant of Adam based on the infinity norm.

One Model To Learn Them All <=SEP=> Deep learning yields great results across many fields, from speech recognition, image classification, to translation. But for each problem, getting a deep model to work well involves research into the architecture and a long period of tuning. We present a single model that yields good results on a number of problems spanning multiple domains. In particular, this single model is trained concurrently on ImageNet, multiple translation tasks, image captioning (COCO dataset), a speech recognition corpus, and an English parsing task. Our model architecture incorporates building blocks from multiple domains. It contains convolutional layers, an attention mechanism, and sparsely-gated layers. Each of these computational blocks is crucial for a subset of the tasks we train on. Interestingly, even if a block is not crucial for a task, we observe that adding it never hurts performance and in most cases improves it on all tasks. We also show that tasks with less data benefit largely from joint training with other tasks, while performance on large tasks degrades only slightly if at all.

Incremental LSTM-based dialog state tracker <=SEP=> A dialog state tracker is an important component in modern spoken dialog systems. We present an incremental dialog state tracker, based on LSTM networks. It directly uses automatic speech recognition hypotheses to track the state. We also present the key non-standard aspects of the model that bring its performance close to the state-of-the-art and experimentally analyze their contribution: including the ASR confidence scores, abstracting scarcely represented values, including transcriptions in the training data, and model averaging.

Application of neural networks to inverse lens distortion modelling <=SEP=> The accurate and quick modelling of inverse lens distortion to rectify images or predict the image coordinates of real world objects has long been a challenge. This work investigates the use of artificial neural networks to perform this modelling. Several architectures are investigated and multiple methods of training the networks are used to achieve the best results. The error is expressed as a physical displacement on the imaging chip so that a fair comparison can be made between other published results which are based on cameras with different resolutions. It is shown that the novel application of locally optimised neural networks to residual lens calibration data yields an inverse distortion modelling that is highly competitive with prior published results.

Quantitative function for community detection. <=SEP=> We propose a quantitative function for community partition -- i.e., modularity density or D value. We demonstrate that this quantitative function is superior to the widely used modularity Q and also prove its equivalence with the objective function of the kernel k means. Both theoretical and numerical results show that optimizing the new criterion not only can resolve detailed modules that existing approaches cannot achieve, but also can correctly identify the number of communities.

Learning Rapid-Temporal Adaptations <=SEP=> A hallmark of human intelligence and cognition is its flexibility. One of the longstanding goals in AI research is to replicate this flexibility in a learning machine. In this work we describe a mechanism by which artificial neural networks can learn rapid-temporal adaptation – the ability to adapt quickly to new environments or tasks – that we call adaptive neurons. Adaptive neurons modify their activations with task-specific values retrieved from a working memory. On standard metalearning and few-shot learning benchmarks in both vision and language domains, models augmented with adaptive neurons achieve state-of-the-art results.

Exemplary Automotive Attack Scenarios : Trojan Horses for Electronic Throttle Control System ( ETC ) and Replay Attacks on the Power Window System <=SEP=> The consideration of targeted security attacks is not yet common in the automotive domain where primarily safety requirements are considered. Hence this survey addresses the relatively new field of IT-security in automotive technology in order to motivate further research. With the emergence of automotive technologies like car-to-car (c2c) communication, the challenges increase. In order to show the necessity for such research we describe how in theory, a potential attack on the Electronic Throttle Control (ETC) could succeed, if no countermeasures are taken, with potentially drastic consequences on the safety of the vehicle, its occupants and its environment as a result. Also an attack on the power window system is shown using the implementation techniques already employed in the design of automotive components. Our goal is to show, that such exploited security vulnerabilities are likely to have serious consequences with respect to the vehicles safety. Therefore such attacks need to be considered and suitable countermeasures have to be identified. In order to achieve this, the connection of the two disciplines Safety and Security for automotive IT components needs to be discussed. We introduce two exemplary attacks, the Trojan Horse targeting at the Electronic Throttle Control System (ETC) and a replay attack on the electric window lift. The first attack is mainly discussed in theory, the second is elaborated in a practical simulation scenario. Finally we introduce a general investigation of potential ways of intrusion and present some first practical results from tests with current automotive hardware.

Real-time object detection, localization and verification for fast robotic depalletizing <=SEP=> Depalletizing is a challenging task for manipulation robots. Key to successful application are not only robustness of the approach, but also achievable cycle times in order to keep up with the rest of the process. In this paper, we propose a system for depalletizing and a complete pipeline for detecting and localizing objects as well as verifying that the found object does not deviate from the known object model, e.g., if it is not the object to pick. In order to achieve high robustness (e.g., with respect to different lighting conditions) and generality with respect to the objects to pick, our approach is based on multi-resolution surfel models. All components (both software and hardware) allow operation at high frame rates and, thus, allow for low cycle times. In experiments, we demonstrate depalletizing of automotive and other prefabricated parts with both high reliability (w.r.t. success rates) and efficiency (w.r.t. low cycle times).

Tagging Patient Notes With ICD-9 Codes <=SEP=> There is substantial growth in the amount of medical data being generated in hospitals. With over 96% adoption rate [1], Electronic Medical/Health Records are used to store most of this medical data. If harnessed correctly, this medium provides a very convenient platform for secondary data analysis of these records to improve medical and patient care. One crucial feature of the information stored in these systems are ICD9-diagnosis codes, which are used for billing purposes and integration to other databases. These codes are assigned to medical text and require expert annotators with experience and training. In this paper we formulate this problem as a multi-label classification problem and propose a deep learning framework to classify the ICD-9 codes a patient is assigned at the end of a visit. We demonstrate that a simple LSTM model with a single layer of non-linearity can learn to classify patient notes with their corresponding ICD-9 labels moderately well.

Visualization of patent analysis for emerging technology <=SEP=> Many methods have been developed to recognize those progresses of technologies, and one of them is to analyze patent information. And visualization methods are considered to be proper for representing patent information and its analysis results. However, current visualization methods for patent analysis patent maps have some drawbacks. Therefore, we propose an alternative visualization method in this paper. With colleted keywords from patent documents of a target technology field, we cluster patent documents by the k-Means algorithm. With the clustering results, we form a semantic network of keywords without respect of filing dates. And then we build up a patent map by rearranging each keyword node of the semantic network according to its earliest filing date and frequency in patent documents. Our approach contributes to establishing a patent map which considers both structured and unstructured items of a patent document. Besides, differently from previous visualization methods for patent analysis, ours is based on forming a semantic network of keywords from patent documents. And thereby it visualizes a clear overview of patent information in a more comprehensible way. And as a result of those contributions, it enables us to understand advances of emerging technologies and forecast its trend in the future. 2007 Elsevier Ltd. All rights reserved.

Perceptions of Sex, Gender, and Puberty Suppression: A Qualitative Analysis of Transgender Youth <=SEP=> International guidelines recommend the use of Gonadotropin-Releasing Hormone (GnRH) agonists in adolescents with gender dysphoria (GD) to suppress puberty. Little is known about the way gender dysphoric adolescents themselves think about this early medical intervention. The purpose of the present study was (1) to explicate the considerations of gender dysphoric adolescents in the Netherlands concerning the use of puberty suppression; (2) to explore whether the considerations of gender dysphoric adolescents differ from those of professionals working in treatment teams, and if so in what sense. This was a qualitative study designed to identify considerations of gender dysphoric adolescents regarding early treatment. All 13 adolescents, except for one, were treated with puberty suppression; five adolescents were trans girls and eight were trans boys. Their ages ranged between 13 and 18 years, with an average age of 16 years and 11 months, and a median age of 17 years and 4 months. Subsequently, the considerations of the adolescents were compared with views of clinicians treating youth with GD. From the interviews with the gender dysphoric adolescents, three themes emerged: (1) the difficulty of determining what is an appropriate lower age limit for starting puberty suppression. Most adolescents found it difficult to define an appropriate age limit and saw it as a dilemma; (2) the lack of data on the long-term effects of puberty suppression. Most adolescents stated that the lack of long-term data did not and would not stop them from wanting puberty suppression; (3) the role of the social context, for which there were two subthemes: (a) increased media-attention, on television, and on the Internet; (b) an imposed stereotype. Some adolescents were positive about the role of the social context, but others raised doubts about it. Compared to clinicians, adolescents were often more cautious in their treatment views. It is important to give voice to gender dysphoric adolescents when discussing the use of puberty suppression in GD. Otherwise, professionals might act based on assumptions about adolescents' opinions instead of their actual considerations. We encourage gathering more qualitative research data from gender dysphoric adolescents in other countries.

Good genes, complementary genes and human mate preferences <=SEP=> The past decade has witnessed a rapidly growing interest in the biological basis of human mate choice. Here we review recent studies that demonstrate preferences for traits which might reveal genetic quality to prospective mates, with potential but still largely unknown influence on offspring fitness. These include studies assessing visual, olfactory and auditory preferences for potential good-gene indicator traits, such as dominance or bilateral symmetry. Individual differences in these robust preferences mainly arise through within and between individual variation in condition and reproductive status. Another set of studies have revealed preferences for traits indicating complementary genes, focussing on discrimination of dissimilarity at genes in the major histocompatibility complex (MHC). As in animal studies, we are only just beginning to understand how preferences for specific traits vary and inter-relate, how consideration of good and compatible genes can lead to substantial variability in individual mate choice decisions and how preferences expressed in one sensory modality may reflect those in another. Humans may be an ideal model species in which to explore these interesting complexities.

Anatomy of Forehead, Glabellar, Nasal and Orbital Muscles, and Their Correlation with Distinctive Patterns of Skin Lines on the Upper Third of the Face: Reviewing Concepts <=SEP=> The purpose of this study is to establish a relationship between the skin lines on the upper third of the face in cadavers, which represent the muscle activity in life and the skin lines achieved by voluntary contraction of the forehead, glabellar, and orbital muscles in patients. Anatomical dissection of fresh cadavers was performed in 20 fresh cadavers, 11 females and 9 males, with ages ranging from 53 to 77 years. Subcutaneous dissection identified the muscle shape and the continuity of the fibers of the eyebrow elevator and depress muscles. Subgaleal dissection identified the cutaneous insertions of the muscles. They were correlated with skin lines on the upper third of the face of the cadavers that represent the muscle activity in life. Voluntary contraction was performed by 20 voluntary patients, 13 females and 7 males, with ages ranging from 35 to 62 years. Distinct patterns of skin lines on the forehead, glabellar and orbital areas, and eyebrow displacement were identified. The frontalis exhibited four anatomical shapes with four different patterns of horizontal parallel lines on the forehead skin. The corrugator supercilii showed three shapes of muscles creating six patterns of vertical glabellar lines, three symmetrical and three asymmetrical. The orbicularis oculi and procerus had single patterns. The skin lines exhibited in voluntary contraction of the upper third of the face in patients showed the same patterns of the skin lines achieved in cadavers. Skin lines in cadavers, which are the expression of the muscle activity in life, were similar to those achieved in the voluntary contraction of patients, allowing us to assert that the muscle patterns of patients were similar to those identified in cadavers. This journal requires that authors assign a level of evidence to each submission to which Evidence-Based Medicine rankings are applicable. This excludes Review Articles, Book Reviews, and manuscripts that concern Basic Science, Animal Studies, Cadaver Studies, and Experimental Studies. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors http://www.springer.com/00266 .

Internet addiction: a systematic review of epidemiological research for the last decade. <=SEP=> In the last decade, Internet usage has grown tremendously on a global scale. The increasing popularity and frequency of Internet use has led to an increasing number of reports highlighting the potential negative consequences of overuse. Over the last decade, research into Internet addiction has proliferated. This paper reviews the existing 68 epidemiological studies of Internet addiction that (i) contain quantitative empirical data, (ii) have been published after 2000, (iii) include an analysis relating to Internet addiction, (iv) include a minimum of 1000 participants, and (v) provide a full-text article published in English using the database Web of Science. Assessment tools and conceptualisations, prevalence, and associated factors in adolescents and adults are scrutinised. The results reveal the following. First, no gold standard of Internet addiction classification exists as 21 different assessment instruments have been identified. They adopt official criteria for substance use disorders or pathological gambling, no or few criteria relevant for an addiction diagnosis, time spent online, or resulting problems. Second, reported prevalence rates differ as a consequence of different assessment tools and cut-offs, ranging from 0.8% in Italy to 26.7% in Hong Kong. Third, Internet addiction is associated with a number of sociodemographic, Internet use, and psychosocial factors, as well as comorbid symptoms and disorder in adolescents and adults. The results indicate that a number of core symptoms (i.e., compulsive use, negative outcomes and salience) appear relevant for diagnosis, which assimilates Internet addiction and other addictive disorders and also differentiates them, implying a conceptualisation as syndrome with similar etiology and components, but different expressions of addictions. Limitations include the exclusion of studies with smaller sample sizes and studies focusing on specific online behaviours. Conclusively, there is a need for nosological precision so that ultimately those in need can be helped by translating the scientific evidence established in the context of Internet addiction into actual clinical practice.

Analysis and Characterisation of Spoof Surface Plasmon Polaritons based Wideband Bandpass Filter at Microwave Frequency <=SEP=> This paper presents the wideband bandpass filter (BPF) in the microwave frequency domain. The realisation approach is based on spoof surface plasmon polaritons (SSPPs) phenomenon using plasmonic metamaterial. A novel unit cell is designed for filter design using an LC resonator concept. Then SSPPs BPF is realised using an optimised mode converter and five unit cells. This paper includes a brief design detail of the proposed novel unit cell. The passband of BPF is achieved at approximately 1.20 5.80 GHz, 3dB bandwidth is tentatively 4.60 GHz and the insertion loss is less than 2 dB approximately over the passband. The overall dimension of fabricated filter is (90 x 45) mm. A basic schematic of transmission line representation is also proposed to evaluate the BPF structure.

Hybrid Electric Vehicles: Architecture and Motor Drives <=SEP=> Electric traction is one of the most promising technologies that can lead to significant improvements in vehicle performance, energy utilization efficiency, and polluting emissions. Among several technologies, hybrid electric vehicle (HEV) traction is the most promising technology that has the advantages of high performance, high fuel efficiency, low emissions, and long operating range. Moreover, the technologies of all the component hardware are technically and markedly available. At present, almost all the major automotive manufacturers are developing hybrid electric vehicles, and some of them have marketed their productions, such as Toyota and Honda. This paper reviews the present technologies of HEVs in the range of drivetrain configuration, electric motor drives, and energy storages

Learning from other subjects helps reducing Brain-Computer Interface calibration time <=SEP=> A major limitation of Brain-Computer Interfaces (BCI) is their long calibration time, as much data from the user must be collected in order to tune the BCI for this target user. In this paper, we propose a new method to reduce this calibration time by using data from other subjects. More precisely, we propose an algorithm to regularize the Common Spatial Patterns (CSP) and Linear Discriminant Analysis (LDA) algorithms based on the data from a subset of automatically selected subjects. An evaluation of our approach showed that our method significantly outperformed the standard BCI design especially when the amount of data from the target user is small. Thus, our approach helps in reducing the amount of data needed to achieve a given performance level.

Location Segmentation, Inference and Prediction for Anticipatory Computing <=SEP=> This paper presents an analysis of continuous cellular tower data representing five months of movement from 215 randomly sampled subjects in a major urban city. We demonstrate the potential of existing community detection methodologies to identify salient locations based on the network generated by tower transitions. The tower groupings from these unsupervised clustering techniques are subsequently validated using data from Bluetooth beacons placed in the homes of the subjects. We then use these inferred locations as states within several dynamic Bayesian networks to predict each subject’s subsequent movements with over 90% accuracy. We also introduce the X-Factor model, a DBN with a latent variable corresponding to abnormal behavior. We conclude with a description of extensions for this model, such as incorporating additional contextual and temporal variables already being logged by the

A Novel Self-Reference Technique for STT-RAM Read and Write Reliability Enhancement <=SEP=> Spin-transfer torque random access memory (STT-RAM) has demonstrated great potential in embedded and stand-alone applications. However, process variations and thermal fluctuations greatly influence the operation reliability of STT-RAM and limit its scalability. In this paper, we propose a new field-assisted access scheme to improve the read/write reliability and performance of STT-RAM. During read operations, an external magnetic field is applied to a magnetic tunneling junction (MTJ) device, generating a resistive sense signal without referring to other devices. Such a self-reference scheme offers a very promising alternative approach to overcome the severe cell-to-cell variations at highly scaled technology node. Furthermore, the external magnetic field can be used to assist the MTJ switching during write operations without introducing extra hardware overhead.

Tendinous insertion of semimembranosus muscle into the lateral meniscus <=SEP=> Forty-two cadaver knees were used for morphologic and MRI observations of the tendinous distal expansions of the semimembranosus m. and the posterior capsular structures of the knee. A tendinous branch of the semimembranosus m. inserting into the posterior horn of the lateral meniscus was found in 43.2% of the knees dissected, besides five already known insertional branches; capsular, direct, anterior and inferior, as well as the oblique popliteal ligament. The tendon had three morphologic types; thin, broad and round. All three types moved the lateral meniscus posteriorly when pulled on. Thus, the semimembranosus m. may also have a protective function for the lateral meniscus as well as the already well established function of protecting the medial meniscus in knee flexion. When a semimembranosus tendon attachment to the posterior horn of the lateral meniscus is present, its normal insertion is difficult to differentiate from a lateral meniscus tear in MRI and this may cause misdiagnosis.

Millisecond Coupling of Local Field Potentials to Synaptic Currents in the Awake Visual Cortex <=SEP=> The cortical local field potential (LFP) is a common measure of population activity, but its relationship to synaptic activity in individual neurons is not fully established. This relationship has been typically studied during anesthesia and is obscured by shared slow fluctuations. Here, we used patch-clamp recordings in visual cortex of anesthetized and awake mice to measure intracellular activity; we then applied a simple method to reveal its coupling to the simultaneously recorded LFP. LFP predicted membrane potential as accurately as synaptic currents, indicating a major role for synaptic currents in the relationship between cortical LFP and intracellular activity. During anesthesia, cortical LFP predicted excitation far better than inhibition; during wakefulness, it predicted them equally well, and visual stimulation further enhanced predictions of inhibition. These findings reveal a central role for synaptic currents, and especially inhibition, in the relationship between the subthreshold activity of individual neurons and the cortical LFP during wakefulness.

The underlying structure of visuospatial working memory in children with mathematical learning disability. <=SEP=> This study examined visual, spatial-sequential, and spatial-simultaneous working memory (WM) performance in children with mathematical learning disability (MLD) and low mathematics achievement (LMA) compared with typically developing (TD) children. Groups were matched on reading decoding performance and verbal intelligence. Besides statistical significance testing, we used bootstrap confidence interval estimation and computed effect sizes. Children were individually tested with six computerized tasks, two for each visuospatial WM subcomponent. We found that both MLD and LMA children had low visuospatial WM function in both spatial-simultaneous and spatial-sequential WM tasks. The WM deficit was most expressed in MLD children and less in LMA children. This suggests that WM scores are distributed along a continuum with TD children achieving top scores and MLD children achieving low scores. The theoretical and practical significance of findings is discussed. Statement of Contribution What is already known on this subject? Working memory plays an important role in mathematical achievement. Children with mathematical learning disability (MLD) usually have low working memory resources. Conflicting results have been reported concerning the role of VSWM in individuals with MLD. What the present study adds? Children with different degree of impairment in math achievement and typically developing children were tested. Visual, spatial-sequential, and spatial-simultaneous working memory tasks were examined. Only spatial-sequential and spatial-simultaneous working memory tasks discriminated the two impairments groups.

The neuroscience of social decision-making. <=SEP=> Given that we live in highly complex social environments, many of our most important decisions are made in the context of social interactions. Simple but sophisticated tasks from a branch of experimental economics known as game theory have been used to study social decision-making in the laboratory setting, and a variety of neuroscience methods have been used to probe the underlying neural systems. This approach is informing our knowledge of the neural mechanisms that support decisions about trust, reciprocity, altruism, fairness, revenge, social punishment, social norm conformity, social learning, and competition. Neural systems involved in reward and reinforcement, pain and punishment, mentalizing, delaying gratification, and emotion regulation are commonly recruited for social decisions. This review also highlights the role of the prefrontal cortex in prudent social decision-making, at least when social environments are relatively stable. In addition, recent progress has been made in understanding the neural bases of individual variation in social decision-making.

Audit Log Management in MongoDB <=SEP=> In the past few years, web-based applications and their data management needs have changed dramatically. Relational databases are often being replaced by other viable alternatives, such as NoSQL databases, for reasons of scalability and heterogeneity. MongoDB, a NoSQL database, is an agile database built for scalability, performance and high availability. It can be deployed in single server environment and also on complex multi-site architectures. MongoDB provides high performance for read and write operations by leveraging in-memory computing. Although researchers have motivated the need for MongoDB, not much appears in the area of log management. Efficient log management techniques are needed for various reasons including security, accountability, and improving the performance of the system. Towards this end, we analyze the different logging methods offered by MongoDB and compare them to the NIST standard. Our analysis indicates that profiling and mongosniff are useful for log management and we present a simple model that combines the two techniques.

Bayesian Information Extraction Network <=SEP=> Dynamic Bayesian networks (DBNs) offer an elegant way to integrate various aspects of language in one model. Many existing algorithms developed for learning and inference in DBNs are applicable to probabilistic language modeling. To demonstrate the potential of DBNs for natural language processing, we employ a DBN in an information extraction task. We show how to assemble wealth of emerging linguistic instruments for shallow parsing, syntactic and semantic tagging, morphological decomposition, named entity recognition etc. in order to incrementally build a robust information extraction system. Our method outperforms previously published results on an established benchmark domain. 1 Information Extraction Information extraction ( IE) is the task of filling in template information from previously unseen text which belongs to a pre-defined domain. The resulting database is suited for formal queries and filtering.IE systems generally work by detecting patterns in the text that help identify significant information. Researchers have shown [Freitag and McCallum, 1999; Ray and Craven, 2001 ] that a probabilistic approach allows the construction of robust and well-performing systems. However, the existing probabilistic systems are generally based on Hidden Markov Models ( HMMs). Due to this relatively impoverished representation, they are unable to take advantage of the wide array of linguistic information used by many non-probabilistic IE systems. In addition, existing HMM -based systems model each target category separately, failing to capture relational information, such as typical target order, or the fact that each element only belongs to a single category. This paper shows how to incorporate a wide array of knowledge into a probabilistic IE system, based on dynamic Bayesian networks ( DBN)—a rich probabilistic representation that generalizes HMMs. Let us illustrateIE by describing seminar announcements which got established as one of the most popular benchmark domains in the field[Califf and Mooney, 1999; Freitag and McCallum, 1999; Soderland, 1999; Roth and Yih, 2001; Ciravegna, 2001 ]. People receive dozens of seminar announcements weekly and need to manually extract information and paste it into personal organizers. The goal of an IE system is to automatically identify target fields such as location and topic of a seminar, date and starting time, ending time and speaker. Announcements come in many formats, but usually follow some pattern. We often find a header with a gist in the form “ PostedBy: john@host.domain; Who: Dr. Steals; When: 1 am; ” and so forth. Also in the body of the message, the speaker usually precedes both location and starting time, which in turn precedes ending time as in: ‘‘Dr. Steals presents in Dean Hall at one am.’’ The task is complicated since some fields may be missing or may contain multiple values. This kind of data falls into the so-called semi-structured text category. Instances obey certain structure and usually contain information for most of the expected fields in some order. There are two other categories: free text and structured text. Instructured text , the positions of the information fields are fixed and values are limited to pre-defined set. Consequently, theIE systems focus on specifying the delimiters and order associated with each field. At the opposite end lies the task of extracting information fromfree textwhich, although unstructured, is assumed to be grammatical. Here IE systems rely more on syntactic, semantic and discourse knowledge in order to assemble relevant information potentially scattered all over a large document. IE algorithms face different challenges depending on the extraction targets and the kind of the text they are embedded in. In some cases, the target is uniquely identifiable (singleslot), while in others, the targets are linked together in multislot association frames. For example, a conference schedule has several slots for related speaker, topic and time of the presentation, while a seminar announcement usually refers to a unique event. Sometimes it is necessary to identify each word in a target slot, while some benefit may be reaped from partial identification of the target, such as labeling the beginning or end of the slot separately. Many applications involve processing of domain-specific jargon like Internetese —a style of writing prevalent in news groups, e-mail messages, bulletin boards and online chat rooms. Such documents do not follow a good grammar, spelling or literary style. Often these are more like a stream-of-consciousness ranting in which asciiart and pseudo-graphic sketches are used and emphasis is provided by all-capitals, or using multiple exclamation signs. As we exemplify below, syntactic analysers easily fail on such Position 1 2 3 4 5 6 7 8 9 10 Tag <speaker > <location> <s-time> Phrase Doctor Steals Presents in Dean Hall at 1 am . Lemma Dr. present in hall at am PoS NNP NNP(VB) VB(NNS) IN NNP NN(NNP) IN CD NN(RB) . Syn.segm. NP NP (VP) VP PP NP NP PP NP NP(VP) Semantic Title LstName LstName Location Time Length 3 6 8 2 4 4 2 1 2 1 Case Upper Upper Upper lower Upper Upper lower lower Table 1: Sample phrase and its representation in multiple feature values for ten tokens.

A Framework for Highly-Available Composed Real-Time Internet Services Bhaskaran Raman Qualifying Examination <=SEP=> Applicationservicesfor theend-userareall importantin today’scommunicationnetworks,andcoulddictatethesuccessor failureof technologyor serviceproviders[39]. It is importantto develop and deploy applicationfunctionality quickly [18]. The ability to compose servicesfrom independentprovidersprovidesa flexible way to quickly build new end-to-endfunctionality. Suchcompositionof services acrossthe network and acrossdifferent serviceproviders becomesespeciallyimportant in the context of growing popularityandheterogeneityin 3G+ accessnetworks and devices[25]. In this work, we provide a framework for constructing such composed services on the Internet. Robustnessandhigh-availability arecrucial for Internet services.While cluster-basedmodelsfor resilienceto failureshave beenbuilt for web-servers[27] aswell asproxy services[11, 4], theseareinadequatein thecontext of composedservices.This is especiallyso whenthe application sessionis long-lived, andfailureshaveto behandledduring asession. In the context of composed services, we address the important and challenging issues of resilience to failures, and adapting to changes in overall performance during longlived sessions. Our framework is basedon a connection-orientedoverlay network of compute-clusterson theInternet.Theoverlay network provides the context for composingservices over the wide-area,and monitoring for livenessand performanceof a session. We have performedinitial analysesof the feasibility of network failure detectionover the wide-areaInternet. And we have a preliminaryevaluation of the overheadassociatedwith suchan overlay network. We presentour plansfor furtherevaluationandrefinement of thearchitecture;andfor examiningissuesrelatedto the creationof theoverlaytopology. 1 Intr oduction Application functionality for the end-useris thedriving force behinddevelopmentof technologyandits adoption. It is importantto be ableto developanddeploy new functionality quickly [18]. Compositionof existing servicesto achieve new functionalityenablessuchquick development throughreuseof alreadydeployed components.Consider for example,thescenarioshown in Figure1. Video-on-demand server Replicated instances Service Provider A

Neural Message Passing for Quantum Chemistry <=SEP=> Supervised learning on molecules has incredible potential to be useful in chemistry, drug discovery, and materials science. Luckily, several promising and closely related neural network models invariant to molecular symmetries have already been described in the literature. These models learn a message passing algorithm and aggregation procedure to compute a function of their entire input graph. At this point, the next step is to find a particularly effective variant of this general approach and apply it to chemical prediction benchmarks until we either solve them or reach the limits of the approach. In this paper, we reformulate existing models into a single common framework we call Message Passing Neural Networks (MPNNs) and explore additional novel variations within this framework. Using MPNNs we demonstrate state of the art results on an important molecular property prediction benchmark; these results are strong enough that we believe future work should focus on datasets with larger molecules or more accurate ground truth labels.

Substrate integrated waveguide (SIW) power amplifier using CBCPW-to-SIW transition for matching network <=SEP=> In this paper, for the first time a novel substrate integrated waveguide (SIW)-based 10W power amplifier (PA), designed with conductor-backed coplanar waveguide (CBCPW)-to-SIW transition matching network (MN), is presented. Transition between CBCPW and SIW is employed for both input and output MN designs, the proposed SIW PA can be easily connected with any microstrip or SIW-based circuits. Asymmetrical and symmetrical types of CBCPW-to-SIW transition MN are proposed. Output SIW-based MN is designed with asymmetrical structure by using one inductive metalized post and input SIW-based MN is designed with symmetrical structure by using two identical inductive metalized posts. One SIW-based 10W PA using GaN HEMT at 3.62 GHz is designed, fabricated, and measured. Measured results show that the maximum power added efficiency (PAE) is 54.24 % with 39.74 dBm output power and the maximum gain is 13.31 dB. At the design frequency of 3.6 GHz, the size of proposed SIW-based PA is comparable with other microstrip-based PAs.