title: Guidelines for Financial Forecasting with Neural Networks

text: Neural networks are good at classification, forecasting and recognition. They are also good candidates of financial forecasting tools. Forecasting is often used in the decision making process. Neural network training is an art. Trading based on neural network outputs, or trading strategy is also an art. We will discuss a seven-step neural network forecasting model building approach in this article. Pre and post data processing/analysis skills, data sampling, training criteria and model recommendation will also be covered in this article. 1. Forecasting with Neural Networks Forecasting is a process that produces a set of outputs by given a set of variables. The variables are normally historical data. Basically, forecasting assumes that future occurrences are based, at least in part, on presently observable or past events. It assumes that some aspects of the past patterns will continue into the future. Past relationships can then be discovered through study and observation. The basic idea of forecasting is to find an approximation of mapping between the input and output data in order to discover the implicit rules governing the observed movements. For instance, the forecasting of stock prices can be described in this way. Assume that i u represents today's price, i v represents the price after ten days. If the prediction of a stock price after ten days could be obtained using today's stock price, then there should be a functional mapping i u to i v , where ) ( i i i u v Γ = . Using all ( i u , i v ) pairs of historical data, a general function () Γ which consists of () i Γ could be obtained, that is ) (u v Γ = . More generally, u which consists of more information in today's price could be used in function () Γ . As NNs are universal approximators, we can find a NN simulating this () Γ function. The trained network is then used to predict the movements for the future. NN based financial forecasting has been explored for about a decade. Many research papers are published on various international journals and conferences proceedings. Some companies and institutions are also claiming or marketing the so called advanced forecasting tools or models. Some research results of financial forecasting found in references. For instance, stock trading system[4], stock forecasting [6, 22], foreign exchange rates forecasting [15, 24], option prices [25], advertising and sales volumes [13]. However, Callen et al. [3] claim that NN models are not necessarily superior to linear time series models even when the data are financial, seasonal and nonlinear. 2. Towards a Better Robust Financial Forecasting Model In working towards a more robust financial forecasting model, the following issues are worth examining. First, instead of emphasizing on the forecasting accuracy only, other financial criteria should be considered. Current researchers tend to use goodness of fit or similar criteria to judge or train their models in financial domain. In terms of mathematical calculation this approach is a correct way in theory. As we understand that a perfect forecasting is impossible in reality. No model can achieve such an ideal goal. Under this constraint, seeking a perfect forecasting is not our aim. We can only try to optimize our imperfect forecasts and use other yardsticks to give the most realistic measure. Second, there should be adequate organization and processing of forecasting data. Preprocessing and proper sampling of input data can have impact on the forecasting performance. Choice of indicators as inputs through sensitivity analysis could help to eliminate redundant inputs. Furthermore, NN forecasting results should be used wisely and effectively. For example, as the forecast is not perfect, should we compare the NN output with the previous forecast or with the real data especially when price levels are used as the forecasting targets? Third, a trading system should be used to decide on the best tool to use. NN is not the single tool that can be used for financial forecasting. We also cannot claim that it is the best forecasting tool. In fact, people are still not aware of which kind of time series is the most suitable for NN applications. To conduct post forecasting analysis will allow us to find out the suitability of models and series. We may then conclude that a certain kind of models should be used for a certain kind of time series. Training or building NN models is a trial and error procedure. Some researchers are not willing to test more on their data set [14]. If there is a system that can help us to formalize these tedious exploratory procedures, it will certainly be of great value to financial forecasting. Instead of just presenting one successful experiment, possibility or confidence level can be applied to the outputs. Data are partitioned into several sets to find out the particular knowledge of this time series. As stated by David Wolpert and William Macready about their No-Free-Lunch theorems [28], averaged over all problems, all search algorithms perform equally. Just experimenting on a single data set, a NN model which outperforms other models can be found. However, for another data set one model which outperforms NN model can also be found according to No-Free-Lunch theorems. To avoid such a case of one model outperforming others, we partition the data set into several sub data sets. The recommended NN models are those that outperform other models for all sub time horizons. In other words, only those models incorporated with enough local knowledge can be used for future forecasting. It is very important and necessary to emphasize these three issues here. Different criteria exist for the academics and the industry. In academics, sometime people seek for the accuracy towards 100%. While in industry a guaranteed 60% accuracy is typically aimed for. In addition, profit is the eventual goal of practitioners, so a profit oriented forecasting model may fit their needs. Cohen [5] surveyed 150 papers in the proceedings of the 8th National Conference on artificial intelligence. He discovered that only 42% of the papers reported that a program had run on more than one example; just 30% demonstrated performance in some way; a mere 21% framed hypotheses or made predictions. He then concluded that the methodologies used were incomplete with respect to the goals of designing and analyzing AI system. Tichy [20] showed that in a very large study of over 400 research articles in computer science. Over 40% of the articles are about new designs and the models completely lack experimental data. In a recent IEEE computer journal, he also points out 16 excuses to avoid experimentation for computer scientists [21]. What he is talking is true and not a joke. Prechelt [14] showed that the situation is not better in the NN literature. Out of 190 papers published in wellknown journals dedicated to NNs, 29% did not employ even a single realistic or real learning problem. Only 8% of the articles presented results for more than one problem using real world data. To build a NN forecasting we need sufficient experiments. To test only for one market or just for one particular time period means nothing. It will not lead to a robust model based on manually, trial-and-error, or ad hoc experiments. More robust model is needed but not only in one market or for one time period. Because of the lack of industrial models and because failures in academic research are not published, a single person or even a group of researchers will not gain enough information or experiences to build up a good forecasting model. It is obvious that an automated system dealing with NN models building is necessary. 3. Steps of NN Forecasting: The Art of NN Training As NN training is an art, many searchers and practitioners have worked in the field to work towards successful prediction and classification. For instance, William Remus and Marcus O'connor [16] suggest some principles for NN prediction and classification are of critical importance in the chapter, “Principles of Forecasting” in “A Handbook for Researchers and Practitioners”: • Clean the data prior to estimating the NN model. • Scale and deseasonalize data prior to estimating the model. • Use appropriate methods to choose the right starting point. • Use specialized methods to avoid local optima. • Expand the network until there is no significant improvement in fit. • Use pruning techniques when estimating NNs and use holdout samples when evaluating NNs. • Take care to obtain software that has in-built features to avoid NN disadvantages. • Build plausible NNs to gain model acceptance by reducing their size. • Use more approaches to ensure that the NN model is valid. With the authors' experience and sharing from other researchers and practitioners, we propose a seven-step approach for NN financial forecasting model building. The seven steps are basic components of the automated system and normally involved in the manual approach. Each step deals with an important issue. They are data preprocessing, input and output selection, sensitive analysis, data organization, model construction, post analysis and model recommendation. Step 1. Data Preprocessing A general format of data is prepared. Depending on the requirement, longer term data, e.g. weekly, monthly data may also be calculated from more frequently sampled time series. We may think that it makes sense to use as frequent data sampling as possible for experiments. However, researchers have found that increasing observation frequency does not always help to improve the accuracy of forecasting [28]. Inspection of data to find outliers is also important as outliers make it difficult for NNs and other forecasting models to model the true underlying functional. Although NNs have been shown to be universal approximators, it had been found that NNs had difficulty modeling seasonal patterns in time series [11].When a time series contains significant seasonality, the data


title: Backing Rich Credentials with a Blockchain PKI ∗

text: This is the second of a series of papers describing the results of a project whose goal was to identify five remote identity proofing solutions that can be used as alternatives to knowledge-based verification. This paper describes the second solution, which makes use of a rich credential adapted for use on a blockchain and backed by a blockchain PKI. A rich credential, also used in Solution 1, allows the subject to identify him/herself to a remote verifier with which the subject has no prior relationship by presenting verification factors including possession of a private key, knowledge of a password, and possession of one or more biometric features, with selective disclosure of attributes and selective presentation of verification factors. In Solution 2 the issuer is a bank and the biometric verification factor is speaker recognition, which can be combined with face recognition to defeat voice morphing. The paper describes in detail the concept of a blockchain PKI, and shows that it has remarkable advantages over a traditional PKI, notably the fact that revocation checking is performed on the verifier’s local copy of the blockchain without requiring CRLs or OCSP.


title: Advanced Message Queuing Protocol

text: The advanced message queuing protocol (AMQP) working group's goal is to create an open standard for an interoperable enterprise-scale asynchronous messaging protocol. AMQP is finally addressing the lack of enterprise messaging interoperability standards. This relatively simple yet compellingly powerful enterprise messaging protocol is thus poised to open up a bright new era for enterprise messaging


title: Taking Empowerment to the Next Level : A Multiple-Level Model of Empowerment , Performance , and Satisfaction

text: Most research to date has approached employee empowerment as an individual-level phenomenon. In this study we proposed a work-unit-level construct, empowerment climate, and tested a multiple-level model integrating macro and micro approaches to empowerment. Empowerment climate was shown to be empirically distinct from psychological empowerment and positively related to manager ratings of work-unit performance. A cross-level mediation analysis using hierarchical linear modeling showed that psychological empowerment mediated the relationships between empowerment climate and individual performance and job satisfaction.


title: Lattice-based motion planning for a general 2-trailer system

text: Motion planning for a general 2-trailer system poses a hard problem for any motion planning algorithm and previous methods have lacked any completeness or optimality guarantees. In this work we present a lattice-based motion planning framework for a general 2-trailer system that is resolution complete and resolution optimal. The solution will satisfy both differential and obstacle imposed constraints and is intended either as a part of an autonomous system or as a driver support system to automatically plan complicated maneuvers in backward and forward motion. The proposed framework relies on a precomputing step that is performed offline to generate a finite set of kinematically feasible motion primitives. These motion primitives are then used to create a regular state lattice that can be searched for a solution using standard graph-search algorithms. To make this graph-search problem tractable for real-time applications a novel parametrization of the reachable state space is proposed where each motion primitive moves the system from and to a selected set of circular equilibrium configurations. The approach is evaluated over three different scenarios and impressive real-time performance is achieved.


title: Labelling strategies for hierarchical multi-label classification techniques

text: Many hierarchical multi-label classification systems predict a real valued score for every (instance, class) couple, with a higher score reflecting more confidence that the instance belongs to that class. These classifiers leave the conversion of these scores to an actual label set to the user, who applies a cut-off value to the scores. The predictive performance of these classifiers is usually evaluated using threshold independent measures like precision-recall curves. However, several applications require actual label sets, and thus an automatic labelling strategy. In this article, we present and evaluate different alternatives to perform the actual labelling in hierarchical multi-label classification. We investigate the selection of both single and multiple thresholds. Despite the existence of multiple threshold selection strategies in non-hierarchical multi-label classification, they can not be applied directly to the hierarchical context. The proposed strategies are implemented within two main approaches: optimisation of a certain performance measure of interest (such as F-measure or hierarchical loss), and simulating training set properties (such as class distribution or label cardinality) in the predictions. We assess the performance of the proposed labelling schemes on 10 datasets from different application domains. Our results show that selecting multiple thresholds may result in ∗Corresponding author. Tel : +32(0)9 331 36 93 Fax : +32(0)9 221 76 73 Email addresses: Isaac.Triguero@irc.vib-UGent.be (Isaac Triguero), Celine.Vens@kuleuven-kulak.be (Celine Vens) Preprint submitted to Elsevier January 29, 2016 an efficient and effective solution for hierarchical multi-label problems.


title: Building a Robust Implementation of Bearing-only Inertial SLAM for a UAV

text: This paper presents the on-going design and implementation of a robust inertial sensor based Simultaneous Localisation And Mapping (SLAM) algorithm for an Unmanned Aerial Vehicle (UAV) using bearing-only observations. A single colour vision camera is used to observe the terrain from which image points corresponding to features in the environment are extracted. The SLAM algorithm estimates the complete 6-DoF motion of the UAV along with the three-dimensional position of the features in the environment. An Extended Kalman Filter (EKF) approach is used where a technique of delayed initialisation is performed to initialise the 3D position of features from bearing-only observations. Data association is achieved using a multi-hypothesis innovation gate based on the spatial uncertainty of each feature. Results are presented by running the algorithm off-line using inertial sensor and vision data collected during a flight test of a UAV.


title: Normative rational agents-A BDI approach

text: This paper proposes an approach on how to accommodate norms to an already existing architecture of rational agents. Starting from the famous BDI model, an extension of the BDI execution loop will be presented; it will address such issues as norm instantiation and norm internalization, with a particular emphasis on the problem of norm consistency. A proposal for the resolution of conflicts between newly occurring norms, on one side, and already existing norms or mental states, on the other side, will be described. While it is fairly difficult to imagine an evaluation for the proposed architecture, a challenging scenario inspired form the science-fiction literature will be used to give the reader an intuition of how the proposed approach will deal with situations of normative conflicts.


title: Temporal QoS-aware web service recommendation via non-negative tensor factorization

text: With the rapid growth of Web Service in the past decade, the issue of QoS-aware Web service recommendation is becoming more and more critical. Since the Web service QoS information collection work requires much time and effort, and is sometimes even impractical, the service QoS value is usually missing. There are some work to predict the missing QoS value using traditional collaborative filtering methods based on user-service static model. However, the QoS value is highly related to the invocation context (e.g., QoS value are various at different time). By considering the third dynamic context information, a Temporal QoS-aware Web Service Recommendation Framework is presented to predict missing QoS value under various temporal context. Further, we formalize this problem as a generalized tensor factorization model and propose a Non-negative Tensor Factorization (NTF) algorithm which is able to deal with the triadic relations of user-service-time model. Extensive experiments are conducted based on our real-world Web service QoS dataset collected on Planet-Lab, which is comprised of service invocation response-time and throughput value from 343 users on 5817 Web services at 32 time periods. The comprehensive experimental analysis shows that our approach achieves better prediction accuracy than other approaches.


title: Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays

text: Recent advances in sensing technology have enabled a new generation of tabletop displays that can sense multiple points of input from several users simultaneously. However, apart from a few demonstration techniques [17], current user interfaces do not take advantage of this increased input bandwidth. We present a variety of multifinger and whole hand gestural interaction techniques for these displays that leverage and extend the types of actions that people perform when interacting on real physical tabletops. Apart from gestural input techniques, we also explore interaction and visualization techniques for supporting shared spaces, awareness, and privacy. These techniques are demonstrated within a prototype room furniture layout application, called RoomPlanner.


title: Introduction to Modern Information Retrieval

text: Come with us to read a new book that is coming recently. Yeah, this is a new coming book that many people really want to read will you be one of them? Of course, you should be. It will not make you feel so hard to enjoy your life. Even some people think that reading is a hard to do, you must be sure that you can do it. Hard will be felt when you have no ideas about what kind of book to read. Or sometimes, your reading material is not interesting enough.


title: Cyberguide: A mobile context-aware tour guide

text: Future computing environments will free the user from the constraints of the desktop. Applications for a mobile environment should take advantage of contextual information, such as position, to o er greater services to the user. In this paper, we present the Cyberguide project, in which we are building prototypes of a mobile context-aware tour guide. Knowledge of the user's current location, as well as a history of past locations, are used to provide more of the kind of services that we come to expect from a real tour guide. We describe the architecture and features of a variety of Cyberguide prototypes developed for indoor and outdoor use on a number of di erent hand-held platforms. We also discuss the general research issues that have emerged in our context-aware applications development in a mobile environment.


title: Interacting with Paper on the Digital Desk

text: real world can be overcome in VR, and physical tools can. be m a d e obsolete by more flexible, virtual alternatives'.. Physical tools can be hard to replace , however. At one time it seemed that paper might become obsolete, for example, and visionaries predicted the "paperlless office" would dominate within a few years. But the trouble is that people like paper. It is easier to read than a screen [5], it is cheap, universally accepted , tactile, and portable. According to some studies, paperwork in the office has increased by a l~actor of six since 1970, and is now growing at 20% annually [14]. Like electronic documents, paper has properties that people just cannot seem to give up, making it resilient in the face of computer-based alternatives [10]. Consequently, we have two desks: one for "paper pushing" and the other for "pixel pushing." Although activities on the two desk.s are often related, the two are quite isolated from each other. Printers and scanners provide a way for documents to move back ;and forth between desk-tops, but this conversion process is inconvenient. Wang's Freestyle system [3], for example, was. a "paper-less office" system that attempted to coexist with partially paper-based processes. A key factor necessary for adoption of that system was to minimize the printing and scanning re-RoE.ALL o quired, because too many of these tasks would cause the process to revert entirely back to paper. Trade-offs between electronic and paper documents can make the choice of medium difficult, but imagine if we did not have to choose, and we had a space where documents could be both paper and electronic at the same time. Instead of putting the user in the virtual world of the computer , we could do the opposite: add the computer to the real world of the user and create a Computer Augmented Environment for paper (see guest editors' introduction.). Instead of replacing paper with computers, we could enhance paper with computation. The Xerox PaperWorks product [8] takes a step in this direction with its fax-based paper user interface (UI) to a storage and retrieval system. With this system, ordinary paper forms are enhanced to control a PC through a fax machine. These paper documents gain some properties of electronic documents, but fax machines are slow compared to computer screens. Response time is limited by the delay it takes to scan and print a …


title: Keeping track of time: evidence for episodic-like memory in great apes

text: Episodic memory, as defined by Tulving, can be described in terms of behavioural elements (what, where and when information) but it is also accompained by an awareness of one’s past (chronesthesia) and a subjective conscious experience (autonoetic awareness). Recent experiments have shown that corvids and rodents recall the where, what and when of an event. This capability has been called episodic-like memory because it only fulfils the behavioural criteria for episodic memory. We tested seven chimpanzees, three orangutans and two bonobos of various ages by adapting two paradigms, originally developed by Clayton and colleagues to test scrub jays. In Experiment 1, subjects were fed preferred but perishable food (frozen juice) and less preferred but non-perishable food (grape). After the food items were hidden, subjects could choose one of them either after 5 min or 1 h. The frozen juice was still available after 5 min but melted after 1 h and became unobtainable. Apes chose the frozen juice significantly more after 5 min and the grape after 1 h. In Experiment 2, subjects faced two baiting events happening at different times, yet they formed an integrated memory for the location and time of the baiting event for particular food items. We also included a memory task that required no temporal encoding. Our results showed that apes remember in an integrated fashion what, where and when (i.e., how long ago) an event happened; that is, apes distinguished between different events in which the same food items were hidden in different places at different times. The temporal control of their choices was not dependent on the familiarity of the platforms where the food was hidden. Chimpanzees’ and bonobos’ performance in the temporal encoding task was age-dependent, following an inverted U-shaped distribution. The age had no effect on the performance of the subjects in the task that required no temporal encoding.


title: DESH: Database evaluation system with hibernate ORM framework

text: Relational databases have been the predominant choice for back-ends in enterprise applications for several decades. JDBC - a Java API - that is used for developing such applications and persisting data on the back-end requires enormous time and effort. JDBC makes the application logic to become tightly coupled with the database and consequently is inadequate for building enterprise applications that need to adopt to dynamic requirements. Hence, ORM frameworks such as Hibernate, became prominent. However, even with ORM, the relational back-end often faces a drawback of lack of scalability and flexibility. In this context, NoSQL databases are increasingly gaining popularity. Existing research works have either benchmarked Hibernate with an RDBMS or with one of the NoSQL databases. However, it has not been attempted in the literature to test both an RDBMS and a NoSQL database for their performance within the context of a single application developed using the features of Hibernate. This kind of a study will provide an insight that using Hibernate ORM solution would help us to develop database-independent applications and how much performance gain can be achieved when an application is ported from an RDBMS back-end to a NoSQL database backend. The objective of this work is to develop a business application using Hibernate framework that can individually communicate with an RDBMS as well as a specific NoSQL database and to evaluate the performance of both these databases.


title: Neural Approaches to Conversational AI

text: This tutorial surveys neural approaches to conversational AI that were developed in the last few years. We group conversational systems into three categories: (1) question answering agents, (2) task-oriented dialogue agents, and (3) social bots. For each category, we present a review of state-of-the-art neural approaches, draw the connection between neural approaches and traditional symbolic approaches, and discuss the progress we have made and challenges we are facing, using specific systems and models as case studies.


title: Towards Twitter hashtag recommendation using distributed word representations and a deep feed forward neural network

text: Hashtags are useful for categorizing and discovering content and conversations in online social networks. However, assigning hashtags requires additional user effort, hampering their widespread adoption. Therefore, in this paper, we introduce a novel approach for hashtag recommendation, targeting English language tweets on Twitter. First, we make use of a skip-gram model to learn distributed word representations (word2vec). Next, we make use of the distributed word representations learned to train a deep feed forward neural network. We test our deep neural network by recommending hashtags for tweets with user-assigned hashtags, using Mean Squared Error (MSE) as the objective function. We also test our deep neural network by recommending hashtags for tweets without user-assigned hashtags. Our experimental results show that the proposed approach recommends hashtags that are specific to the semantics of the tweets and that preserve the linguistic regularity of the tweets. In addition, our experimental results show that the proposed approach is capable of generating hashtags that have not been seen before.


title: Review of Charge Pump Topologies for Micro Energy Harvesting Systems

text: Corresponding Author: Michelle Lim Sern Mi Institute of Microengineering and Nanoelectronics (IMEN), UKM, 43600 Bangi, Selangor, Malaysia Email: mlsm_2002@yahoo.com Abstract: This paper reviews CMOS based charge pump topologies used within autonomous embedded micro-systems. These charge pump structures have evolved from its simplistic diode-tied, single-branches with major threshold drops to exponential type, dual-branches with sophisticated gate and substrate control for lower voltage operation. Published charge pumps are grouped based on architecture, operation principles and pump optimization techniques with their pros and cons compared and results contrasted. The various charge pump topologies and schemes used are considered based on pumping efficiency, power efficiency, charge transferability, circuit complexity, pumping capacitors, form factor and minimum supply voltages with an optimum load. This article concludes with an overview of suitable techniques and recommendations that will aid a designer in selecting the most suitable charge pump topology especially for low ambient micro energy harvesting applications.


title: Private Query on Encrypted Data in Multi-user Settings

text: Searchable encryption schemes allow users to perform keyword based searches on an encrypted database. Almost all existing such schemes only consider the scenario where a single user acts as both the data owner and the querier. However, most databases in practice do not just serve one user; instead, they support search and write operations by multiple users. In this paper, we systematically study searchable encryption in a practical multi-user setting. Our results include a set of security notions for multi-user searchable encryption as well as a construction which is provably secure under the newly introduced security notions.


title: SMIT: Stochastic Multi-Label Image-to-Image Translation

text: Cross-domain mapping has been a very active topic in recent years. Given one image, its main purpose is to translate it to the desired target domain, or multiple domains in the case of multiple labels. This problem is highly challenging due to three main reasons: (i) unpaired datasets, (ii) multiple attributes, and (iii) the multimodality associated with the translation. Most of the existing state-of-theart has focused only on two reasons, i.e. producing disentangled representations from unpaired datasets in a one-toone domain translation or producing multiple unimodal attributes from unpaired datasets. In this work, we propose a joint framework of diversity and multi-mapping image-toimage translations, using a single generator to conditionally produce countless and unique fake images that hold the underlying characteristics of the source image. Extensive experiments over different datasets demonstrate the effectiveness of our proposed approach with comparisons to the state-of-the-art in both multi-label and multimodal problems. Additionally, our method is able to generalize under different scenarios: continuous style interpolation, continuous label interpolation, and multi-label mapping.


title: Instagram #Instasad?: Exploring Associations Among Instagram Use, Depressive Symptoms, Negative Social Comparison, and Strangers Followed

text: As the use and influence of social networking continues to grow, researchers have begun to explore its consequences for psychological well-being. Some research suggests that Facebook use can have negative consequences for well-being. Instagram, a photo-sharing social network created in 2010, has particular characteristics that may make users susceptible to negative consequences. This study tested a theoretically grounded moderated meditation model of the association between Instagram use and depressive symptoms through the mechanism of negative social comparison, and moderation by amount of strangers one follows. One hundred and seventeen 18-29 year olds completed online questionnaires containing demographics, frequency of Instagram use, amount of strangers followed on Instagram, the Center for Epidemiological Resources Scale for Depression, and the Social Comparison Rating Scale. Instagram use was marginally positively associated with depressive symptoms, and positive social comparison was significantly negatively associated with depressive symptoms. Amount of strangers followed moderated the associations of Instagram use with social comparison (significantly) and depressive symptoms (marginally), and further significantly moderated the indirect association of Instagram use with depressive symptoms through social comparison. Findings generally suggest that more frequent Instagram use has negative associations for people who follow more strangers, but positive associations for people who follow fewer strangers, with social comparison and depressive symptoms. Implications of negative associations of social networking for people who follow strangers and the need for more research on Instagram use given its increasing popularity are explored.


title: Processing capacity defined by relational complexity: implications for comparative, developmental, and cognitive psychology.

text: Working memory limits are best defined in terms of the complexity of the relations that can be processed in parallel. Complexity is defined as the number of related dimensions or sources of variation. A binary relation has one argument and one source of variation; its argument can be instantiated in only one way at a time. A binary relation has two arguments, two sources of variation, and two instantiations, and so on. Dimensionality is related to the number of chunks, because both attributes on dimensions and chunks are independent units of information of arbitrary size. Studies of working memory limits suggest that there is a soft limit corresponding to the parallel processing of one quaternary relation. More complex concepts are processed by "segmentation" or "conceptual chunking." In segmentation, tasks are broken into components that do not exceed processing capacity and can be processed serially. In conceptual chunking, representations are "collapsed" to reduce their dimensionality and hence their processing load, but at the cost of making some relational information inaccessible. Neural net models of relational representations show that relations with more arguments have a higher computational cost that coincides with experimental findings on higher processing loads in humans. Relational complexity is related to processing load in reasoning and sentence comprehension and can distinguish between the capacities of higher species. The complexity of relations processed by children increases with age. Implications for neural net models and theories of cognition and cognitive development are discussed.


title: What causes hidradenitis suppurativa?

text: Hidradenitis suppurativa (HS)--a rather common, very chronic and debilitating inflammatory skin appendage disorder with a notoriously underestimated burden of disease--has long been a playground for the high priests of nomenclature: Ask a bunch of eminent dermatologists and skin pathologists to publicly share their thoughts on what causes HS, and they will soon get entrenched in a heated debate on whether this historical term is a despicable misnomer. Fortunately, the recently founded Hidradenitis Suppurativa Foundation (HSF; http://www.hs-foundation.org), to which EXP DERMATOL serves as home journal, has broken with this unproductive tradition and has encouraged publication of the current CONTROVERSIES feature. This is exclusively devoted to discussing the pathobiology of this chronic neutrophilic folliculitis of unknown origin. Although traces of terminological bickering remain visible, it does the HS experts in our virtual debate room credit that they engage in a constructive and comprehensive dissection of potential pathogenesis pathways that may culminate in the clinical picture we know under the competing terms HS or acne inversa. These experts sketch more often complementary than mutually exclusive pathogenesis scenarios, and the outlines of a conceivable consensus on the many open pathobiology questions begin to emerge in these CONTROVERSIES. Hopefully, this heralds a welcome new tradition: to get to the molecular heart of HS pathogenesis, which can only be achieved by a renaissance of solid basic HS research, as the key to developing more effective HS therapy.


title: Achievable cases in an asynchronous environment

text: The paper deals with achievability of fault tolerant goals in a completely asynchronous distributed system. Fischer, Lynch, and Paterson [FLP] proved that in such a system "nontrivial agreement" cannot be achieved even in the (possible) presence of a single "benign" fault. In contrast, we exhibit two pairs of goals that are achievable even in the presence of up to t ≪ n/2 faulty processors, contradicting the widely held assumption that no nontrivial goals are attainable in such a system. The first pair deals with renaming processors so as to reduce the size of the initial name space. When only uniqueness is required of the new names, we present a lower bound of n + 1 on the size of the new name space, and a renaming algorithm which establishes an upper bound of n + t. In case the new names are required also to preserve the original order, a tight bound of 2t(n- t + 1) - 1 is obtained. The second pair of goals deals with the multi-slot critical section problem. We present algorithms for controlled access to a critical section. As for the number of slots required, a tight bound of t + 1 is proved in case the slots are identical. In the case of distinct slots the upper bound is 2t + 1.


title: Steerable Higher Order Mode Dielectric Resonator Antenna With Parasitic Elements for 5G Applications

text: This paper presents the findings of a steerable higher order mode (TE<inline-formula> <tex-math notation="LaTeX">$^{\mathrm {y}}_{1\delta 3}$ </tex-math></inline-formula>) dielectric resonator antenna with parasitic elements. The beam steering was successfully achieved by switching the termination capacitor on the parasitic element. In this light, all of the dielectric resonator antennas (DRAs) have the same dielectric permittivity similar to that of ten and excited by a <inline-formula> <tex-math notation="LaTeX">$50\Omega $ </tex-math></inline-formula> microstrip with a narrow aperture. The effect of the mutual coupling on the radiation pattern and the reflection coefficient, as well as the array factor, was investigated clearly using MATLAB version 2014b and ANSYS HFSS version 16. As the result, the antenna beam of the proposed DRA array managed to steer from −32° to +32° at 15 GHz. Furthermore, the measured antenna array showed the maximum gain of 9.25 dBi and the reflection coefficients which are less than −10 dB with the bandwidth more than 1.3 GHz, which is viewed as desirable for device-to-device communication in 5G Internet of Things applications.


title: Autonomous UAV Surveillance in Complex Urban Environments

text: We address the problem of multi-UAV-based surveillance in complex urban environments with occlusions. The problem consists of controlling the flight of UAVs with on-board cameras so that the coverage and recency of the information about the designated area is maximized. In contrast to the existing work, sensing constraints due to occlusions and UAV motion constraints are modeled realistically and taken into account. We propose a novel \emph{occlusion-aware} surveillance algorithm based on a decomposition of the surveillance problem into a variant of the 3D art gallery problem and an instance of traveling salesman problem for Dubins vehicles. The algorithm is evaluated on the high-fidelity \textsc{AgentFly} UAV simulation testbed which accurately models all constraints and effects involved. The results confirm the importance of occlusion-aware flight path planning, in particular in the case of narrow-street areas and low UAV flight altitudes.


title: Spatial augmented reality — A tool for 3D data visualization

text: This paper presents a proposal for the use of Spatial Augmented Reality as a tool for 3D data visualizations. The use of traditional display technologies such as LCD monitors provides a fish tank metaphor for the user, i.e. the information is behind a plane of glass. The use of VR technologies allows the user to be immersed in the 3D volume and remove this fish tank problem, but can limit the set of techniques that allow users to interact with spatial data. Spatial Augmented Reality employed in conjunction with a highresolution monitor provides an elegant blend of spatial reasoning, tangible interaction, and detailed information viewing. This paper purposes a range of usages for SAR in 3D visualizations.


title: Learning deep semantic attributes for user video summarization

text: This paper presents a Semantic Attribute assisted video SUMmarization framework (SASUM). Compared with traditional methods, SASUM has several innovative features. Firstly, we use a natural language processing tool to discover a set of keywords from an image and text corpora to form the semantic attributes of visual contents. Secondly, we train a deep convolution neural network to extract visual features as well as predict the semantic attributes of video segments which enables us to represent video contents with visual and semantic features simultaneously. Thirdly, we construct a temporally constrained video segment affinity matrix and use a partially near duplicate image discovery technique to cluster visually and semantically consistent video frames together. These frame clusters can then be condensed to form an informative and compact summary of the video. We will present experimental results to show the effectiveness of the semantic attributes in assisting the visual features in video summarization and our new technique achieves state-of-the-art performance.


title: Infants’ Metaphysics: The Case of Numerical Identity

text: Adults conceptualize the world in terms of enduring physical objects. Sortal concepts provide conditions of individuation (establishing the boundaries of objects) and numerical identity (establishing whether an object is the same one as one encountered at some other time). In the adult conceptual system, there are two roughly hierarchical levels of object sortals. Most general is the sortal bounded physical object itself, for which spatiotemporal properties provide the criteria for individuation and identity. More specific sortals, such as dog or car, rely on additional types of properties to provide criteria for individuation and identity. We conjecture that young infants might represent only the general sortal, object, and construct more specific sortals later (the Object-first Hypothesis). This is closely related to Bower's (1974) conjecture that infants use spatiotemporal information to trace identity before they use property information. Five studies using the visual habituation paradigm were conducted to address the Object-first Hypothesis. In these studies, 10-month-old infants were able to use spatiotemporal information but failed to use property/kind information to set up representations of numerically distinct individuals, thus providing empirical evidence for the Object-first Hypothesis. Finally, infants succeed at object individuation in terms of more specific sortals by 12 months. The relation between success at our task and early noun comprehension is discussed.


title: The Google effect in doctoral theses

text: It is often said that successive generations of researchers face an increasing educational burden due to knowledge accumulation. On the other hand, technological advancement over time can improve the productivity of researchers and even change their cognitive processes. This paper presents a longitudinal study (2004–2011) of citation behavior in doctoral theses at the Massachusetts Institute of Technology’s Department of Electrical Engineering and Computer Science. It is found that the number of references cited has increased over the years. At the same time, there has been a decrease in the length of time in the doctoral program and a relative constancy in the culture of the department. This suggests that students are more productive in facing an increased knowledge burden, and indeed seem to encode prior literature as transactive memory to a greater extent, as evidenced by the greater use of older literature.


title: W-Band Large-Scale High-Gain Planar Integrated Antenna Array

text: This communication presents a 32 × 32 high-gain patch array antenna fed by the substrate integrated waveguide (SIW) structure at W-band. The array antenna consists of two layers to achieve a compact topology, which allows for mass production using a standard PCB fabrication process. The wideband feeding network is placed in the bottom layer while the radiating patches are on the top layer. This configuration also resolves the trade-off between gain and bandwidth of conventional SIW array antennas. Measured gain of the 32 × 32 antenna array is within the range 28.81-29.97 dBi in the working bandwidth of 91-97 GHz. Measured impedance bandwidth covers the same frequency band for . The cross-polarization of the antenna array is less than 40 dB at the beam direction. Good agreement between the simulated and measured results validates our design.


title: Position and Orientation Estimation Through Millimeter-Wave MIMO in 5G Systems

text: Millimeter-wave (mm-wave) signals and large antenna arrays are considered enabling technologies for future 5G networks. While their benefits for achieving high-data rate communications are well-known, their potential advantages for accurate positioning are largely undiscovered. We derive the Cramér-Rao bound (CRB) on position and rotation angle estimation uncertainty from mm-wave signals from a single transmitter, in the presence of scatterers. We also present a novel two-stage algorithm for position and rotation angle estimation that attains the CRB for average to high signal-to-noise ratio. The algorithm is based on multiple measurement vectors matching pursuit for coarse estimation, followed by a refinement stage based on the space-alternating generalized expectation maximization algorithm. We find that accurate position and rotation angle estimation is possible using signals from a single transmitter, in either line-of-sight, non-line-of-sight, or obstructed-line-of-sight conditions.


title: Enhancing the TED-LIUM Corpus with Selected Data for Language Modeling and More TED Talks

text: In this paper, we present improvements made to the TED-LIUM corpus we released in 2012. These enhancements fall into two categories. First, we describe how we filtered publicly available monolingual data and used it to estimate well-suited language models (LMs), using open-source tools. Then, we describe the process of selection we applied to new acoustic data from TED talks, providing additions to our previously released corpus. Finally, we report some experiments we made around these improvements.


title: Blockchain challenges and opportunities: a survey

text: Copyright © 2017 Inderscience Enterprises Ltd. 2 Blockchain has numerous benefits such as decentralization, persistency, anonymity and auditability. There is a wide spectrum of blockchain applications ranging from cryptocurrency, financial services, risk management, Internet of Things to public and social services. Although a number of studies focus on using the blockchain technology in various application aspects, there is no comprehensive survey on the blockchain technology in both technological and application perspectives. To fill this gap, we conduct a comprehensive survey on the blockchain technology. In particular, this paper gives the blockchain taxonomy, introduces typical blockchain consensus algorithms, reviews blockchain applications and discusses technical challenges as well as recent advances in tackling the challenges. Moreover, this paper also points out the future directions in the blockchain technology.


title: A Real Time Audio Fingerprinting System for Advertisement Tracking and Reporting in FM Radio

text: In this paper we present a system designed to detect, identify and track commercial segments transmitted by a radio station. The program is entirely written in Visual C++ and uses state of the art audio fingerprinting technologies to achieve a great performance, being able to operate several times faster than real time while keeping a moderate computational load.


title: Detecting and discriminating behavioural anomalies

text: This paper aims to address the problem of anomaly detection and discrimination in complex behaviours, where anomalies are subtle and difficult to detect owing to the complex temporal dynamics and correlations among multiple objects’ behaviours. Specifically, we decompose a complex behaviour pattern according to its temporal characteristics or spatial-temporal visual contexts. The decomposed behaviour is then modelled using a cascade of Dynamic Bayesian Networks (CasDBNs). In contrast to existing standalone models, the proposed behaviour decomposition and cascade modelling offers distinct advantage in simplicity for complex behaviour modelling. Importantly, the decomposition and cascade structure map naturally to the structure of complex behaviour, allowing for a more effective detection of subtle anomalies in surveillance videos. Comparative experiments using both indoor and outdoor data are carried out to demonstrate that, in addition to the novel capability of discriminating different types of anomalies, the proposed framework outperforms existing methods in detecting durational anomalies in complex behaviours and subtle anomalies that are difficult to detect when objects are viewed in isolation. & 2010 Elsevier Ltd. All rights reserved.


title: Mobile Virtual Network Admission Control and Resource Allocation for Wireless Network Virtualization: A Robust Optimization Approach

text: Wireless network virtualization is a promising technology in next generation wireless networks. In this paper, motivated by the experience of user equipment (UE) admission control in traditional wireless networks, we propose a novel concept of mobile virtual network (MVN) admission control for wireless virtualization. By limiting the number of MVNs embedded in the physical network, MVN admission control can effectively guarantee quality of service (QoS) experienced by users of MVNs and maximize the utilization of the physical networks at the same time. Specifically, we propose a two-stage MVN embedding mechanism that can decouple short-term physical resource allocation from long-term admission control and resource leasing. With recent advances in robust optimization, we formulate the MVN admission control problem as a robust optimization problem. Both the long-term admission control and short- term resource allocation problems are transformed to convex problems, which can be solved efficiently. Simulation results are presented to show the effectiveness of the proposed scheme.


The Experience of Nature A Psychological Perspective


A novel framework for SMS spam filtering is introduced in this paper to prevent mobile phone users from unsolicited SMS messages. The framework makes use of two distinct feature selection approaches based on information gain and chi-square metrics to find out discriminative features representing SMS messages. The discriminative feature subsets are then employed in two different Bayesian-based classifiers, so that SMS messages are categorized as either spam or legitimate. Moreover, the paper introduces a real-time mobile application for Android™ based mobile phones utilizing the proposed spam filtering scheme, as well. Hence, SMS spam messages are silently filtered out without disturbing phone users. Effectiveness of the filtering framework is evaluated on a large SMS message collection including legitimate and spam messages. Following the evaluation, remarkably accurate classification results are obtained for both spam and legitimate messages.


title: Forecasting stock price directional movements using technical indicators: Investigating window size effects on one-step-ahead forecasting

text: Accurate forecasting of directional changes in stock prices is important for algorithmic trading and investment management. Technical analysis has been successfully used in financial forecasting and recently researchers have explored the optimization of parameters for technical indicators. This study investigates the relationship between the window size used for calculating technical indicators and the accuracy of one-step-ahead (variable steps) forecasting. The directions of the future price movements are predicted using technical analysis and machine learning algorithms. Results show a correlation between window size and forecasting step size for the Support Vector Machines approach but not for the other approaches.


title: Scene Graph Generation by Belief RNNs

text: Understanding and describing the scene beyond an image has great value. It is a 1 step forward from recognizing individual objects and their relationships in isolation. 2 In addition, Scene graph is a crucial step towards a deeper understanding of a visual 3 scene. We present a method in an end-to-end model that given an image generates 4 a scene graph including nodes that corresponds to the objects in the image and 5 an edges corresponds to relationship between objects. Our main contribution is 6 introducing a novel deep structure prediction module Belief RNNs that performs 7 learning on a large graphs in a very efficient and generic way. 8


title: A new Design Criteria for Hash-Functions

text: The most common way of constructing a hash function (e.g., SHA-1) is to iterate a compression function on the input message. The compression function is usually designed from scratch or made out of a block-cipher. In this paper, we introduce a new security notion for hash-functions, stronger than collision-resistance. Under this notion, the arbitrary length hash function H must behave as a random oracle when the fixed-length building block is viewed as an ideal primitive. This enables to eliminate all possible generic attacks against iterative hash-functions. In this paper, we show that the current design principle behind hash functions such as SHA-1 and MD5 — the (strengthened) Merkle-Damg̊ard transformation — does not satisfy this security notion. We provide several constructions that provably satisfy this notion; those new constructions introduce minimal changes to the plain Merkle-Damg̊ard construction and are easily implementable in practice. This paper is a modified version of a paper to appear at Crypto 2005.


title: Ordinary magic. Resilience processes in development.

text: The study of resilience in development has overturned many negative assumptions and deficit-focused models about children growing up under the threat of disadvantage and adversity. The most surprising conclusion emerging from studies of these children is the ordinariness of resilience. An examination of converging findings from variable-focused and person-focused investigations of these phenomena suggests that resilience is common and that it usually arises from the normative functions of human adaptational systems, with the greatest threats to human development being those that compromise these protective systems. The conclusion that resilience is made of ordinary rather than extraordinary processes offers a more positive outlook on human development and adaptation, as well as direction for policy and practice aimed at enhancing the development of children at risk for problems and psychopathology.


title: An automated framework for generating variable-accuracy battery models from datasheet information

text:
Models based on an electrical circuit equivalent have become the most popular choice for modeling the behavior of batteries, thanks to their ease of co-simulation with other parts of a digital system. Such circuit models are actually model templates: the specific values of their electrical elements must be derived by the analysis of the specific battery devices to be modeled. This process requires either to measure the battery characteristics or to derive them from the datasheet. In the latter case, however, very often not all information are available and the model fitting becomes then unfeasible.
 In this paper we present a methodology for deriving, in a semi-automatic way, circuit equivalent battery models solely from data available in a battery datasheet. In order to account for the different amount of information available, we introduce the concept of "level" of a model, so that models with different accuracy can be derived depending on the available data. The methodology requires only minimal intervention by the designer and it automatically generates MATLAB models once the required data for the corresponding model level are transcribed from the datasheet.
 Simulation results show that our methodology allows to accurately reconstruct the information reported in the datasheet as well as to derive missing ones.


title: Spatial Reference in Linguistic Human-Robot Interaction: Iterative, Empirically Supported Development of a Model of Projective Relations

text: The aim of our research is to enable spontaneous and efficient spatial reference to objects in human-robot interaction situations. This paper presents the iterative, empirically based design of a robotic system that uses a computational model for identifying objects on the basis of a range of spatial reference systems. The efficiency of the system is evaluated by two successive empirical studies involving uninformed users. The linguistic analysis points to the striking variability in speakers’ spontaneous strategies and preferences, and it motivates a number of modifications of the computational model.


title: Mobile Media Use, Multitasking and Distractibility

text: Portable media devices are ubiquitous and their use has become a core component of many people’s daily experience, but to what effect? In this paper, the authors review research on the ways in which media use and multitasking relate to distraction, distractibility and impulsivity. They review recent research on the effects of media multitasking on driving, walking, work, and academic performance. The authors discuss earlier research concerning the nature of media’s impact on attention and review cognitive and neuropsychological findings on the effects of divided attention. Research provides clear evidence that mobile media use is distracting, with consequences for safety, efficiency and learning. Greater use of media is correlated with higher levels of trait impulsivity and distractibility, but the direction of causality has not been established. Individuals may become more skilled at media multitasking over time, but intervention is currently required to improve the safe and effective use of mobile media. DOI: 10.4018/ijcbpl.2012070102 16 International Journal of Cyber Behavior, Psychology and Learning, 2(3), 15-29, July-September 2012 Copyright © 2012, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited. and neuropsychological research on the effects of divided attention. Finally, we explore how high levels of media multitasking might alter our general responses to experience in ways that are marked by changes in distractibility and impulsivity. THE DISTRACTING EFFECTS OF MULTITASKING WITH MOBILE MEDIA


title: Multileaved Comparisons for Fast Online Evaluation

text: Evaluation methods for information retrieval systems come in three types: offline evaluation, using static data sets annotated for relevance by human judges; user studies, usually conducted in a lab-based setting; and online evaluation, using implicit signals such as clicks from actual users. For the latter, preferences between rankers are typically inferred from implicit signals via interleaved comparison methods, which combine a pair of rankings and display the result to the user. We propose a new approach to online evaluation called multileaved comparisons that is useful in the prevalent case where designers are interested in the relative performance of more than two rankers. Rather than combining only a pair of rankings, multileaved comparisons combine an arbitrary number of rankings. The resulting user clicks then give feedback about how all these rankings compare to each other. We propose two specific multileaved comparison methods. The first, called team draft multileave, is an extension of team draft interleave. The second, called optimized multileave, is an extension of optimized interleave and is designed to handle cases where a large number of rankers must be multileaved. We present experimental results that demonstrate that both team draft multileave and optimized multileave can accurately determine all pairwise preferences among a set of rankers using far less data than the interleaving methods that they extend.


title: A tensorized logic programming language for large-scale data

text: We introduce a new logic programming language T-PRISM based on tensor embeddings. Our embedding scheme is a modification of the distribution semantics in PRISM, one of the state-of-the-art probabilistic logic programming languages, by replacing distribution functions with multidimensional arrays, i.e., tensors. T-PRISM consists of two parts: logic programming part and numerical computation part. The former provides flexible and interpretable modeling at the level of first order logic, and the latter part provides scalable computation utilizing parallelization and hardware acceleration with GPUs. Combing these two parts provides a remarkably wide range of high-level declarative modeling from symbolic reasoning to deep learning. To embody this programming language, we also introduce a new semantics, termed tensorized semantics, which combines the traditional least model semantics in logic programming with the embeddings of tensors. In T-PRISM, we first derive a set of equations related to tensors from a given program using logical inference, i.e., Prolog execution in a symbolic space and then solve the derived equations in a continuous space by TensorFlow. Using our preliminary implementation of T-PRISM, we have successfully dealt with a wide range of modeling. We have succeeded in dealing with real large-scale data in the declarative modeling. This paper presents a DistMult model for knowledge graphs using the FB15k and WN18 datasets.


title: X-band microstrip narrowband BPF composed of split ring resonator

text: The paper deals with the development of X-band microstrip narrowband bandpass filter (BPF) composed of split ring resonator (SRR). The proposed filter is designed on a grounded 0.508mm thick Roger RT/Duroid® 5880 dielectric substrate with the dimension of 25mm length and 20mm width. Some parametric studies to achieve an optimum design of microstrip narrowband BPF are investigated prior realization by varying the physical parameters of SRR including the width of rings and the gap between rings. From the experimental characterization, it shows that the realized microstrip narrowband BPF has a center frequency of 9.02 GHz with the values of return loss and insertion loss of 15.231 dB and 2.768 dB, respectively. The measured result is 20MHz lower than the simulated one which has center frequency of 9 GHz with the values of return loss and insertion loss of 15.025 dB and 2.242 dB, respectively.


title: Enhanced Modelling and Performance in Braided Pneumatic Muscle Actuators

text: Pneumatic technology has been successfully applied for over two millennia. Even today, pneumatic cylinder based technology forms the keystone of many manufacturing processes where there is a need for simple, high-speed, low-cost, reliable motion. But when the system requires accurate control of position, velocity or acceleration profiles, these actuators form a far from satisfactory solution. Braided pneumatic muscle actuators (pMAs) form an interesting development of the pneumatic principle offering even higher power/weight performance, operation in a wide range of environments and accurate control of position, motion and force. This technology provides an interesting and potentially very successful alternative actuation source for robots as well as other applications. However, there are difficulties with this approach due to the following. (i) Modeling errors. Models of the force response are still nonoptimal and for good results these models are highly complex, which makes accurate design difficult. (ii) Low bandwidth—the bandwidth of the actuator—link assemblies are often considered to be too low for practical success in many applications, particularly robotics. In this paper we address these limitations and show how the performance in each area can be enhanced with overall improvements in the response and utility of the braided pMAs. KEY WORDS—actuators, braided pneumatic muscle actuators, McKibben muscles


title: High Dimensional Semiparametric Gaussian Copula Graphical Models

text: We propose a semiparametric approach called the nonparanormal SKEPTIC for efficiently and robustly estimating high-dimensional undirected graphical models. To achieve modeling flexibility, we consider the nonparanormal graphical models proposed by Liu, Lafferty and Wasserman [J. Mach. Learn. Res. 10 (2009) 2295–2328]. To achieve estimation robustness, we exploit nonparametric rank-based correlation coefficient estimators, including Spearman’s rho and Kendall’s tau. We prove that the nonparanormal SKEPTIC achieves the optimal parametric rates of convergence for both graph recovery and parameter estimation. This result suggests that the nonparanormal graphical models can be used as a safe replacement of the popular Gaussian graphical models, even when the data are truly Gaussian. Besides theoretical analysis, we also conduct thorough numerical simulations to compare the graph recovery performance of different estimators under both ideal and noisy settings. The proposed methods are then applied on a large-scale genomic data set to illustrate their empirical usefulness. The R package huge implementing the proposed methods is available on the Comprehensive R Archive Network: http://cran.r-project.org/.


title: Chapter 3 Recent Developments in Auxiliary Particle Filtering

text: State space models (SSMs; sometimes termed hidden Markov models, particularly in the discrete case) are very popular statistical models for time series. Such models describe the trajectory of some system of interest as an unobserved E-valued Markov chain, known as the signal process. Let X1 ∼ ν and Xn|(Xn−1 = xn−1) ∼ f(·|xn−1) denote this process. Indirect observations are available via an observation process, {Yn}n∈N. Conditional upon Xn, Yn is independent of the remainder of the observation and signal processes, with Yn|(Xn = xn) ∼ g(·|xn). For any sequence {zn}n∈N, we write zi:j = (zi, zi+1, ..., zj). In numerous applications, we are interested in estimating, recursively in time, an analytically intractable sequence of posterior distributions {p (x1:n| y1:n)}n∈N, of the form:


title: Fast time series classification using numerosity reduction

text: Many algorithms have been proposed for the problem of time series classification. However, it is clear that one-nearest-neighbor with Dynamic Time Warping (DTW) distance is exceptionally difficult to beat. This approach has one weakness, however; it is computationally too demanding for many realtime applications. One way to mitigate this problem is to speed up the DTW calculations. Nonetheless, there is a limit to how much this can help. In this work, we propose an additional technique, numerosity reduction, to speed up one-nearest-neighbor DTW. While the idea of numerosity reduction for nearest-neighbor classifiers has a long history, we show here that we can leverage off an original observation about the relationship between dataset size and DTW constraints to produce an extremely compact dataset with little or no loss in accuracy. We test our ideas with a comprehensive set of experiments, and show that it can efficiently produce extremely fast accurate classifiers.


title: Blind Source Separation in nonminimum-phase systems based on filter decomposition

text: This paper focuses on the causality problem in the task of Blind Source Separation (BSS) of speech signals in nonminimum-phase mixing channels. We propose a new algorithm for solving this problem using filter decomposition approach. Our proposed algorithm uses an integrated cost function in which independence criterion is defined in frequency-domain. The parameters of demixing system are derived in time-domain, so the algorithm has the benefits of both time and frequency-domain approaches. Compared to the previous work in this framework, our proposed algorithm is the extension of filter decomposition idea in multi-channel blind deconvolution to the problem of blind source separation of speech signals. The proposed method is capable of dealing with both minimum-phase and nonminimum-phase mixing situations. Simulation results show considerable improvement in separating speech signals specially when the mixing system is nonminimum-phase.


title: CSI Neural Network: Using Side-channels to Recover Your Artificial Neural Network Information

text: Machine learning has become mainstream across industries. Numerous examples proved the validity of it for security applications. In this work, we investigate how to reverse engineer a neural network by using only power side-channel information. To this end, we consider a multilayer perceptron as the machine learning architecture of choice and assume a non-invasive and eavesdropping attacker capable of measuring only passive side-channel leakages like power consumption, electromagnetic radiation, and reaction time. We conduct all experiments on real data and common neural net architectures in order to properly assess the applicability and extendability of those attacks. Practical results are shown on an ARM CORTEX-M3 microcontroller. Our experiments show that the side-channel attacker is capable of obtaining the following information: the activation functions used in the architecture, the number of layers and neurons in the layers, the number of output classes, and weights in the neural network. Thus, the attacker can effectively reverse engineer the network using sidechannel information. Next, we show that once the attacker has the knowledge about the neural network architecture, he/she could also recover the inputs to the network with only a single-shot measurement. Finally, we discuss several mitigations one could use to thwart such attacks.


title: Parking Guidance System Based on ZigBee and Geomagnetic Sensor Technology

text: Concerning the phenomenon that common parking service could not satisfy the increasing demand of the private vehicle owners, an intelligent parking guidance system based on Zig Bee network and geomagnetic sensors was designed. Real-time vehicle position and related traffic information were collected by geomagnetic sensors around parking lots and updated to center server via Zig Bee network. On the other hand, out-door Liquid Crystal Display screens controlled by center server can display information of available parking places. In this paper, guidance strategy was divided into four levels, which could provide clear and effective information to drivers. The experimental results prove that the distance detection accuracy of geomagnetic sensors was within 0.4m, and the lowest package loss rate of the wireless network in the range of 150m is 0%. This system can provide solution for better parking service in intelligent cities.


title: Normalized ( Pointwise ) Mutual Information in Collocation Extraction

text: In this paper, we discuss the related information theoretical association measures of mutual information and pointwise mutual information, in the context of collocation extraction. We introduce normalized variants of these measures in order to make them more easily interpretable and at the same time less sensitive to occurrence frequency. We also provide a small empirical study to give more insight into the behaviour of these new measures in a collocation extraction setup.


title: Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs

text: Most analysis of web search relevance and performance takes a single query as the unit of search engine interaction. When studies attempt to group queries together by task or session, a timeout is typically used to identify the boundary. However, users query search engines in order to accomplish tasks at a variety of granularities, issuing multiple queries as they attempt to accomplish tasks. In this work we study real sessions manually labeled into hierarchical tasks, and show that timeouts, whatever their length, are of limited utility in identifying task boundaries, achieving a maximum precision of only 70%. We report on properties of this search task hierarchy, as seen in a random sample of user interactions from a major web search engine's log, annotated by human editors, learning that 17% of tasks are interleaved, and 20% are hierarchically organized. No previous work has analyzed or addressed automatic identification of interleaved and hierarchically organized search tasks. We propose and evaluate a method for the automated segmentation of users' query streams into hierarchical units. Our classifiers can improve on timeout segmentation, as well as other previously published approaches, bringing the accuracy up to 92% for identifying fine-grained task boundaries, and 89-97% for identifying pairs of queries from the same task when tasks are interleaved hierarchically. This is the first work to identify, measure and automatically segment sequences of user queries into their hierarchical structure. The ability to perform this kind of segmentation paves the way for evaluating search engines in terms of user task completion.


title: Query segmentation revisited

text:
We address the problem of query segmentation: given a keyword query, the task is to group the keywords into phrases, if possible. Previous approaches to the problem achieve reasonable segmentation performance but are tested only against a small corpus of manually segmented queries. In addition, many of the previous approaches are fairly intricate as they use expensive features and are difficult to be reimplemented.
 The main contribution of this paper is a new method for query segmentation that is easy to implement, fast, and that comes with a segmentation accuracy comparable to current state-of-the-art techniques. Our method uses only raw web n-gram frequencies and Wikipedia titles that are stored in a hash table. At the same time, we introduce a new evaluation corpus for query segmentation. With about 50,000 human-annotated queries, it is two orders of magnitude larger than the corpus being used up to now.


title: Exploratory search: from finding to understanding

text: Research tools critical for exploratory search success involve the creation of new interfaces that move the process beyond predictable fact retrieval.


title: Delphi method: techniques and applications

text: Cross-impact analysis is a method for revising estimated probabilities of future events in terms of estimated interactions among those events. This Report presents an elementary cross-impact model where the cross-impacts are formulated as relative probabilities. Conditions are derived for the consistency of the matrix of relative probabilities of n events. An extension also provides a necessary condition for the vector of absolute probabilities to be consistent with the relative probability matrix. An averaging technique is formulated for resolving inconsistencies in the matrix, and a nearest-point computation derived for resolving inconsistencies between the set of absolute probabilities and the matrix. Although elementary, the present model clarifies some of the conceptual problems associated with cross-impact analysis, and supplies a relatively sound basis for revising probability estimates in the limited case where interactions can be approximated by relative probabilities.


title: Phishing e-mail detection by using deep learning algorithms

text: Phishing e-mails are considered as spam e-mails, which aim to collect sensitive personal information about the users via network. Since the main purpose of this behavior is mostly to harm users financially, it is vital to detect these phishing or spam e-mails immediately to prevent unauthorized access to users' vital information. To detect phishing e-mails, using a quicker and robust classification method is important. Considering the billions of e-mails on the Internet, this classification process is supposed to be done in a limited time to analyze the results. In this work, we present some of the early results on the classification of spam email using deep learning and machine methods. We utilize word2vec to represent emails instead of using the popular keyword or other rule-based methods. Vector representations are then fed into a neural network to create a learning model. We have tested our method on an open dataset and found over 96% accuracy levels with the deep learning classification methods in comparison to the standard machine learning algorithms.


title: Bundle Adjustment in the Large

text: We present the design and implementation of a new inexact Newton type algorithm for solving large-scale bundle adjustment problems with tens of thousands of images. We explore the use of Conjugate Gradients for calculating the Newton step and its performance as a function of some simple and computationally efficient preconditioners. We show that the common Schur complement trick is not limited to factorization-based methods and that it can be interpreted as a form of preconditioning. Using photos from a street-side dataset and several community photo collections, we generate a variety of bundle adjustment problems and use them to evaluate the performance of six different bundle adjustment algorithms. Our experiments show that truncated Newton methods, when paired with relatively simple preconditioners, offer state of the art performance for large-scale bundle adjustment. The code, test problems and detailed performance data are available at http://grail.cs.washington.edu/projects/bal.


title: Building Caring Healthcare Systems in the Internet of Things

text: The nature of healthcare and the computational and physical technologies and constraints present a number of challenges to systems designers and implementers. In spite of the challenges, there is a significant market for systems and products to support caregivers in their tasks as the number of people needing assistance grows substantially. In this paper, we present a structured approach for describing Internet of Things (IoT) for healthcare systems. We illustrate the approach for three use cases and discuss relevant quality issues that arise, in particular, the need to consider caring as a requirement.


title: Mining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain

text: Posting reviews online has become an increasingly popular way for people to express opinions and sentiments toward the products bought or services received. Analyzing the large volume of online reviews available would produce useful actionable knowledge that could be of economic values to vendors and other interested parties. In this paper, we conduct a case study in the movie domain, and tackle the problem of mining reviews for predicting product sales performance. Our analysis shows that both the sentiments expressed in the reviews and the quality of the reviews have a significant impact on the future sales performance of products in question. For the sentiment factor, we propose Sentiment PLSA (S-PLSA), in which a review is considered as a document generated by a number of hidden sentiment factors, in order to capture the complex nature of sentiments. Training an S-PLSA model enables us to obtain a succinct summary of the sentiment information embedded in the reviews. Based on S-PLSFA, we propose ARSA, an Autoregressive Sentiment-Aware model for sales prediction. We then seek to further improve the accuracy of prediction by considering the quality factor, with a focus on predicting the quality of a review in the absence of user-supplied indicators, and present ARSQA, an Autoregressive Sentiment and Quality Aware model, to utilize sentiments and quality for predicting product sales performance. Extensive experiments conducted on a large movie data set confirm the effectiveness of the proposed approach.


title: Entity Retrieval via Entity Factoid Hierarchy

text: We propose that entity queries are generated via a two-step process: users first select entity facts that can distinguish target entities from the others; and then choose words to describe each selected fact. Based on this query generation paradigm, we propose a new entity representation model named as entity factoid hierarchy. An entity factoid hierarchy is a tree structure composed of factoid nodes. A factoid node describes one or more facts about the entity in different information granularities. The entity factoid hierarchy is constructed via a factor graph model, and the inference on the factor graph is achieved by a modified variant of Multiple-try Metropolis algorithm. Entity retrieval is performed by decomposing entity queries and computing the query likelihood on the entity factoid hierarchy. Using an array of benchmark datasets, we demonstrate that our proposed framework significantly improves the retrieval performance over existing models.


title: A Foray into Conficker's Logic and Rendezvous Points

text: We present an in depth static analysis of the Conficker worm, primarily through the exploration of the client-side binary logic. In this paper, we summarize various aspects of the inner workings of binary variants A and B,1 which were the first in a chain of recent revisions aimed to keep this epidemic resistant to ongoing eradication attempts. These first two variants have combined to produce a multi-million node population of infected hosts, whose true main purpose has yet to be fully understood. We further validate aspects of our analysis through in-situ network analyses, and discuss some attribution links about its origins.


title: Information Security Threats Classification Pyramid

text: Threat classification is extremely important for organizations, as it is an important step towards implementation of information security. Most of the existing threat classifications listed threats in static ways without linking threats to information system areas. The aim of this paper is to design a methodology that can classify deliberate threats in a dynamic way to represent each threat in different areas of the information system. This technique is based on the following factors: the attacker's prior knowledge (i. e. the knowledge hold by the source of the threat) about the system, loss of security information and the criticality of the area that might be affected by that threat.


title: Collaborative privacy management: mobile privacy beyond your own devices

text: As the development of mobile devices and applications, mobile privacy has become a very important issue. Current researches on mobile privacy mainly focus on potential leakages on a particular device. However, leakage of sensitive data on a mobile device not only violates the privacy of the phone (or data) owner, but also violates the privacy of many other people whose information are contained in the data directly or indirectly (they are called data involvers). To address such problems, we introduce a collaborative privacy management framework, which aims to provide fine-grained data privacy protection for both data owners and data involvers in a distributed manner. Based on individual privacy policies specified by each user, a collaborative privacy policy is generated and enforced on different devices automatically. As a proof-of-concept prototype, we implement the proposed framework on Android and demonstrate its applicability with two case studies.


title: Adding nesting structure to words

text:
We propose the model of nested words for representation of data with both a linear ordering and a hierarchically nested matching of items. Examples of data with such dual linear-hierarchical structure include executions of structured programs, annotated linguistic data, and HTML/XML documents. Nested words generalize both words and ordered trees, and allow both word and tree operations. We define nested word automata—finite-state acceptors for nested words, and show that the resulting class of regular languages of nested words has all the appealing theoretical properties that the classical regular word languages enjoys: deterministic nested word automata are as expressive as their nondeterministic counterparts; the class is closed under union, intersection, complementation, concatenation, Kleene-*, prefixes, and language homomorphisms; membership, emptiness, language inclusion, and language equivalence are all decidable; and definability in monadic second order logic corresponds exactly to finite-state recognizability. We also consider regular languages of infinite nested words and show that the closure properties, MSO-characterization, and decidability of decision problems carry over.
 The linear encodings of nested words give the class of visibly pushdown languages of words, and this class lies between balanced languages and deterministic context-free languages. We argue that for algorithmic verification of structured programs, instead of viewing the program as a context-free language over words, one should view it as a regular language of nested words (or equivalently, a visibly pushdown language), and this would allow model checking of many properties (such as stack inspection, pre-post conditions) that are not expressible in existing specification logics.
 We also study the relationship between ordered trees and nested words, and the corresponding automata: while the analysis complexity of nested word automata is the same as that of classical tree automata, they combine both bottom-up and top-down traversals, and enjoy expressiveness and succinctness benefits over tree automata.


title: Smart Refrigerator Based on Internet of Things (IoT): An Approach to Efficient Food Management

text: This paper focuses on the technology of the smart refrigerator connected through the Internet of Things (IoT) platform. It deals with the issue of food wastage and efficient food distribution through a network of connected refrigerators within a defined neighborhood. This paper defines the three-layer architecture: front-end layer, gateway layer and the back-end layer that can allow the implementation of the system. This low-cost network can be created through a microcontroller and wireless sensors at the front-end architecture. The process was discussed to determine: the stock item below a defined quantity or threshold limit, determining the product expiration date and eventually determining the purchase or exchange of food items across the network. It also includes the proof of concept technology by allowing connection of an ultrasonic sensor to an IoT platform that can allow the exchange of information on the positioning of the food items inside the refrigerator. This eventually can allow for a large-scale commercial implementation of the project to deal with the current issue of food distribution.


title: 1.3 μm, 56-Gbit/s EML module target to 400GbE

text: We developed 1.3 μm, EML module built in EML driver IC for both 50 and 56 Gbit/s. 40-km SMF transmission with clear eye openings under 56 Gbit/s operation were demonstrated for the first time.


title: Hybrid digital and analog beamforming design for large-scale MIMO systems

text: Large-scale multiple-input multiple-output (MIMO) systems enable high spectral efficiency by employing large antenna arrays at both the transmitter and the receiver of a wireless communication link. In traditional MIMO systems, full digital beamforming is done at the baseband; one distinct radio-frequency (RF) chain is required for each antenna, which for large-scale MIMO systems can be prohibitive from either cost or power consumption point of view. This paper considers a two-stage hybrid beamforming structure to reduce the number of RF chains for large-scale MIMO systems. The overall beamforming matrix consists of analog RF beamforming implemented using phase shifters and baseband digital beamforming of much smaller dimension. This paper considers precoder and receiver design for maximizing the spectral efficiency when the hybrid structure is used at both the transmitter and the receiver. On the theoretical front, bounds on the minimum number of transmit and receive RF chains that are required to realize the theoretical capacity of the large-scale MIMO system are presented. It is shown that the hybrid structure can achieve the same performance as the fully-digital beamforming scheme if the number of RF chains at each end is greater than or equal to twice the number of data streams. On the practical design front, this paper proposes a heuristic hybrid beamforming design strategy for the critical case where the number of RF chains is equal to the number of data streams, and shows that the performance of the proposed hybrid beamforming design can achieve spectral efficiency close to that of the fully-digital solution.


title: Design and implementation of embedded Web server based on arm and Linux

text: This paper achieves the design of an embedded Web server, which takes ARM920T-S3c2410s chip as its core and Linux as its operating system. This is because Linux can be reduced and transplanted. The method used to transplant Web server Boa on the embedded Linux platform is also discussed in detail, and through CGI technology functions of dynamic Web page is successfully realized. Relevant experiments show that after the Web server is embedded into the network video monitoring system, dynamic page interaction can be achieved between the Web server and the embedded system via the browser in the Windows environment.


title: Machine Learning Strategies for Time Series Forecasting

text: The increasing availability of large amounts of historical data and the need of performing accurate forecasting of future behavior in several scientific and applied domains demands the definition of robust and efficient techniques able to infer from observations the stochastic dependency between past and future. The forecasting domain has been influenced, from the 1960s on, by linear statistical methods such as ARIMA models. More recently, machine learning models have drawn attention and have established themselves as serious contenders to classical statistical models in the forecasting community. This chapter presents an overview of machine learning techniques in time series forecasting by focusing on three aspects: the formalization of one-step forecasting problems as supervised learning tasks, the discussion of local learning techniques as an effective tool for dealing with temporal data and the role of the forecasting strategy when we move from one-step to multiple-step forecasting.


title: A qualitative study on factors that influence women’s choice of delivery in health facilities in Addis Ababa, Ethiopia

text:
BACKGROUND
Facility based delivery for mothers is one of the proven interventions to reduce maternal and neonatal morbidity and mortality. This study identified women's reasons for seeking to give birth in a health facility and captured their perceptions of the quality of care they received during their most recent birth, in a population with high utilization of facility based deliveries.

METHODS
This qualitative study was conducted in eight health centers in Addis Ababa. Women bringing their index child for first vaccinations were invited to participate in an in-depth interview about their last delivery. Sixteen in-depth interviews were conducted. Interviews were conducted by trained researchers using a semi-structured interview guide. The data were transcribed verbatim in Amharic and translated into English. A thematic analysis was conducted to answer specific study questions.

RESULTS
All research participants expressed a preference for facility based delivery because of their awareness of obstetric complications, and related perceptions that facility-birth is safer for the mother and child. Dimensions of quality of care and the cost of services were identified as influencing decisions about whether to seek care in the public or private sector. Media campaigns, information from social networks and women's experiences with healthcare providers and facilities influenced care-seeking decisions.

CONCLUSIONS
The universal preference for facility-based birth by women in this study indicates that, in Addis Ababa, facility based delivery has become a preferred norm. Sources of information for decision-making and the dimensions of quality prioritized by women should be taken into account to develop interventions to promote facility-based births in other settings.


title: Compressive Sensing Image Sensors-Hardware Implementation

text: The compressive sensing (CS) paradigm uses simultaneous sensing and compression to provide an efficient image acquisition technique. The main advantages of the CS method include high resolution imaging using low resolution sensor arrays and faster image acquisition. Since the imaging philosophy in CS imagers is different from conventional imaging systems, new physical structures have been developed for cameras that use the CS technique. In this paper, a review of different hardware implementations of CS encoding in optical and electrical domains is presented. Considering the recent advances in CMOS (complementary metal-oxide-semiconductor) technologies and the feasibility of performing on-chip signal processing, important practical issues in the implementation of CS in CMOS sensors are emphasized. In addition, the CS coding for video capture is discussed.


title: Partitioning Well-Clustered Graphs with k-Means and Heat Kernel

text: We study a suitable class of well-clustered graphs that admit good k-way partitions and present the first almost-linear time algorithm for with almost-optimal approximation guarantees partitioning such graphs. A good k-way partition is a partition of the vertices of a graph into disjoint clusters (subsets) {Si}i=1, such that each cluster is better connected on the inside than towards the outside. This problem is a key building block in algorithm design, and has wide applications in community detection and network analysis. Key to our result is a theorem on the multi-cut and eigenvector structure of the graph Laplacians of these well-clustered graphs. Based on this theorem, we give the first rigorous guarantees on the approximation ratios of the widely used k-means clustering algorithms. We also give an almost-linear time algorithm based on heat kernel embeddings and approximate nearest neighbor data structures.


title: Approximate Computing for Low Power and Security in the Internet of Things

text: To save resources for Internet of Things (IoT) devices, a proposed approach segments operands and corresponding basic arithmetic operations that can be carried out by approximate function units for almost all applications. The approach also increases the security of IoT devices by hiding information for IP watermarking, digital fingerprinting, and lightweight encryption.


title: Speaker identification on the SCOTUS corpus

text: This paper reports the results of our experiments on speaker identification in the SCOTUS corpus, which includes oral arguments from the Supreme Court of the United States. Our main findings are as follows: 1) a combination of Gaussian mixture models and monophone HMM models attains near-100% textindependent identification accuracy on utterances that are longer than one second; 2) the sampling rate of 11025 Hz achieves the best performance (higher sampling rates are harmful); and a sampling rate as low as 2000 Hz still achieves more than 90% accuracy; 3) a distance score based on likelihood numbers was used to measure the variability of phones among speakers; we found that the most variable phone is the phone UH (as in good), and the velar nasal NG is more variable than the other two nasal sounds M and N; 4.) our models achieved “perfect” forced alignment on very long speech segments (40 minutes). These findings and their significance are discussed.