Query: Action Recognition and Video Description using Visual Attention

Relevant passages:
Unsupervised Learning of Video Representations using LSTMs <=SEP=> We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences – patches of image pixels and high-level representations (“percepts”) of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem – human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.

Spatial Transformer Networks <=SEP=> Convolutional Neural Networks define an exceptionally powerful class of models, but are still limited by the lack of ability to be spatially invariant to the input data in a computationally and parameter efficient manner. In this work we introduce a new learnable module, the Spatial Transformer, which explicitly allows the spatial manipulation of data within the network. This differentiable module can be inserted into existing convolutional architectures, giving neural networks the ability to actively spatially transform feature maps, conditional on the feature map itself, without any extra training supervision or modification to the optimisation process. We show that the use of spatial transformers results in models which learn invariance to translation, scale, rotation and more generic warping, resulting in state-of-the-art performance on several benchmarks, and for a number of classes of transformations.

Going deeper with convolutions <=SEP=> We propose a deep convolutional neural network architecture codenamed Inception that achieves the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC14). The main hallmark of this architecture is the improved utilization of the computing resources inside the network. By a carefully crafted design, we increased the depth and width of the network while keeping the computational budget constant. To optimize quality, the architectural decisions were based on the Hebbian principle and the intuition of multi-scale processing. One particular incarnation used in our submission for ILSVRC14 is called GoogLeNet, a 22 layers deep network, the quality of which is assessed in the context of classification and detection.

Describing Videos by Exploiting Temporal Structure <=SEP=> Recent progress in using recurrent neural networks (RNNs) for image description has motivated the exploration of their application for video description. However, while images are static, working with videos requires modeling their dynamic temporal structure and then properly integrating that information into a natural language description model. In this context, we propose an approach that successfully takes into account both the local and global temporal structure of videos to produce descriptions. First, our approach incorporates a spatial temporal 3-D convolutional neural network (3-D CNN) representation of the short temporal dynamics. The 3-D CNN representation is trained on video action recognition tasks, so as to produce a representation that is tuned to human motion and behavior. Second we propose a temporal attention mechanism that allows to go beyond local temporal modeling and learns to automatically select the most relevant temporal segments given the text-generating RNN. Our approach exceeds the current state-of-art for both BLEU and METEOR metrics on the Youtube2Text dataset. We also present results on a new, larger and more challenging dataset of paired video and natural language descriptions.

How to Construct Deep Recurrent Neural Networks <=SEP=> In this paper, we explore different ways to extend a recurrent neural network (RNN) to a deep RNN. We start by arguing that the concept of depth in an RNN is not as clear as it is in feedforward neural networks. By carefully analyzing and understanding the architecture of an RNN, however, we find three points of an RNN which may be made deeper; (1) input-to-hidden function, (2) hidden-tohidden transition and (3) hidden-to-output function. Based on this observation, we propose two novel architectures of a deep RNN which are orthogonal to an earlier attempt of stacking multiple recurrent layers to build a deep RNN (Schmidhuber, 1992; El Hihi and Bengio, 1996). We provide an alternative interpretation of these deep RNNs using a novel framework based on neural operators. The proposed deep RNNs are empirically evaluated on the tasks of polyphonic music prediction and language modeling. The experimental result supports our claim that the proposed deep RNNs benefit from the depth and outperform the conventional, shallow RNNs.

A new approach to developing and implementing eager database replication protocols <=SEP=> Database replication is traditionally seen as a way to increase the availability and performance of distributed databases. Although a large number of protocols providing data consistency and fault-tolerance have been proposed, few of these ideas have ever been used in commercial products due to their complexity and performance implications. Instead, current products allow inconsistencies and often resort to centralized approaches which eliminates some of the advantages of replication. As an alternative, we propose a suite of replication protocols that addresses the main problems related to database replication. On the one hand, our protocols maintain data consistency and the same transactional semantics found in centralized systems. On the other hand, they provide flexibility and reasonable performance. To do so, our protocols take advantage of the rich semantics of group communication primitives and the relaxed isolation guarantees provided by most databases. This allows us to eliminate the possibility of deadlocks, reduce the message overhead and increase performance. A detailed simulation study shows the feasibility of the approach and the flexibility with which different types of bottlenecks can be circumvented.

Job performance prediction in a call center using a naive Bayes classifier <=SEP=> This study presents an approach to predict the performance of sales agents of a call center dedicated exclusively to sales and telemarketing activities. This approach is based on a naive Bayesian classifier. The objective is to know what levels of the attributes are indicative of individuals who perform well. A sample of 1037 sales agents was taken during the period between March and September of 2009 on campaigns related to insurance sales and service pre-paid phone services, to build the naive Bayes network. It has been shown that, socio-demographic attributes are not suitable for predicting performance. Alternatively, operational records were used to predict production of sales agents, achieving satisfactory results. In this case, the classifier training and testing is done through a stratified tenfold cross-validation. It classified the instances correctly 80.60% of times, with the proportion of false positives of 18.1% for class no (does not achieve minimum) and 20.8% for the class yes (achieves equal or above minimum acceptable). These results suggest that socio-demographic attributes has no predictive power on performance, while the operational information of the activities of the sale agent can predict the future performance of the

TUCH: Turning Cross-view Hashing into Single-view Hashing via Generative Adversarial Nets <=SEP=> Cross-view retrieval, which focuses on searching images as response to text queries or vice versa, has received increasing attention recently. Crossview hashing is to efficiently solve the cross-view retrieval problem with binary hash codes. Most existing works on cross-view hashing exploit multiview embedding method to tackle this problem, which inevitably causes the information loss in both image and text domains. Inspired by the Generative Adversarial Nets (GANs), this paper presents a new model that is able to Turn Crossview Hashing into single-view hashing (TUCH), thus enabling the information of image to be preserved as much as possible. TUCH is a novel deep architecture that integrates a language model network T for text feature extraction, a generator network G to generate fake images from text feature and a hashing network H for learning hashing functions to generate compact binary codes. Our architecture effectively unifies joint generative adversarial learning and cross-view hashing. Extensive empirical evidence shows that our TUCH approach achieves state-of-the-art results, especially on text to image retrieval, based on imagesentences datasets, i.e. standard IAPRTC-12 and large-scale Microsoft COCO.

Application of Machine Learning Algorithms to an online Recruitment System <=SEP=> In this work, we present a novel approach for evaluating job applicants in online recruitment systems, leveraging machine learning algorithms to solve the candidate ranking problem. An application of our approach is implemented in the form of a prototype system, whose functionality is showcased and evaluated in a real-world recruitment scenario. The proposed system extracts a set of objective criteria from the applicants’ LinkedIn profile, and infers their personality characteristics using linguistic analysis on their blog posts. Our system was found to perform consistently compared to human recruiters; thus, it can be trusted for the automation of applicant ranking and

Aggression in the Laboratory : Problems with the Validity of the Modified Taylor Competitive Reaction Time Test as a Measure of Aggression in Media Violence Studies <=SEP=> Many laboratory studies of aggression use a measure known as the modified Taylor Competitive Reaction Time Test (TCRTT), for which validation studies are lacking. Using sound blasts administered by the participant against a fictional human opponent, the TCRTT also allows for multiple methods of measuring aggression. The validity of the TCRTT was tested in 53 college student participants. Participants took a self-report measure of aggressiveness as well as neuropsychological measures of frontal lobe functioning predictive of aggression. Results were not supportive of the TCRTT’s validity and indicated concerns regarding the use of the TCRTT as a measure of aggression. Results suggest that labaratory studies of media violence using the TCRTT are of questionable validity.

Understanding consumers' continuance intention towards mobile purchase: A theoretical framework and empirical study - A case of China <=SEP=> Although mobile purchase is convenient in the age of mobile commerce, many consumers still do not utilize mobile purchase to its full potential. From the mobile vendor’s perspective, retaining current customers and facilitating their continued purchase are crucial to create profitability and achieve a sustainable development. An understanding of the continuance intention towards mobile purchase can provide insights into mobile vendors’ marketing campaigns. Therefore, it is important to examine the determinants that impact continuance intentions of consumers for mobile purchase. Drawing upon information success model, flow theory and trust, this study proposed and empirically tested an integrated model to better understand the determinants of consumers’ continued intention to purchase on mobile sites. Empirical data from 462 users who had experience with mobile purchase were tested against the proposed research model by using structural equation modelling (SEM). The results indicated that information quality, and privacy and security concerns are the main factors affecting trust, whereas service quality is the main factor affecting flow. System quality, and privacy and security concerns affect satisfaction. Trust affects flow, which in turn affects satisfaction. These three factors together affect continued intention towards mobile purchase. The findings of this study provide several important implications for mobile commerce research and practice. 2015 Elsevier Ltd. All rights reserved.

A Hybrid Word-Character Model for Abstractive Summarization <=SEP=> Automatic abstractive text summarization is an important and challenging research topic of natural language processing. Among many widely used languages, the Chinese language has a special property that a Chinese character contains rich information comparable to a word. Existing Chinese text summarization methods, either adopt totally character-based or word-based representations, fail to fully exploit the information carried by both representations. To accurately capture the essence of articles, we propose a hybrid word-character approach (HWC) which preserves the advantages of both wordbased and character-based representations. We evaluate the advantage of the proposed HWC approach by applying it to two existing methods, and discover that it generates state-of-the-art performance with a margin of 24 ROUGE points on a widely used dataset LCSTS. In addition, we find an issue contained in the LCSTS dataset and offer a script to remove overlapping pairs (a summary and a short text) to create a clean dataset for the community. The proposed HWC approach also generates the best performance on the new, clean LCSTS dataset.

Open Information Extraction with Meta-pattern Discovery in Biomedical Literature <=SEP=> Biomedical open information extraction (BioOpenIE) is a novel paradigm to automatically extract structured information from unstructured text with no or little supervision. It does not require any pre-specified relation types but aims to extract all the relation tuples from the corpus. A major challenge for open information extraction (OpenIE) is that it produces massive surface-name formed relation tuples that cannot be directly used for downstream applications. We propose a novel framework CPIE (Clause+Pattern-guided Information Extraction) that incorporates clause extraction and meta-pattern discovery to extract structured relation tuples with little supervision. Compared with previous OpenIE methods, CPIE produces massive but more structured output that can be directly used for downstream applications. We first detect short clauses from input sentences. Then we extract quality textual patterns and perform synonymous pattern grouping to identify relation types. Last, we obtain the corresponding relation tuples by matching each quality pattern in the text. Experiments show that CPIE achieves the highest precision in comparison with state-of-the-art OpenIE baselines, and also keeps the distinctiveness and simplicity of the extracted relation tuples. CPIE shows great potential in effectively dealing with real-world biomedical literature with complicated sentence structures and rich information.

Tensegrity II. How structural networks influence cellular information processing networks. <=SEP=> The major challenge in biology today is biocomplexity: the need to explain how cell and tissue behaviors emerge from collective interactions within complex molecular networks. Part I of this two-part article, described a mechanical model of cell structure based on tensegrity architecture that explains how the mechanical behavior of the cell emerges from physical interactions among the different molecular filament systems that form the cytoskeleton. Recent work shows that the cytoskeleton also orients much of the cell's metabolic and signal transduction machinery and that mechanical distortion of cells and the cytoskeleton through cell surface integrin receptors can profoundly affect cell behavior. In particular, gradual variations in this single physical control parameter (cell shape distortion) can switch cells between distinct gene programs (e.g. growth, differentiation and apoptosis), and this process can be viewed as a biological phase transition. Part II of this article covers how combined use of tensegrity and solid-state mechanochemistry by cells may mediate mechanotransduction and facilitate integration of chemical and physical signals that are responsible for control of cell behavior. In addition, it examines how cell structural networks affect gene and protein signaling networks to produce characteristic phenotypes and cell fate transitions during tissue development.

Alternating Directions Dual Decomposition <=SEP=> We propose AD, a new algorithm for approximate maximum a posteriori (MAP) inference on factor graphs based on the alternating directions method of multipliers. Like dual decomposition algorithms, AD uses worker nodes to iteratively solve local subproblems and a controller node to combine these local solutions into a global update. The key characteristic of AD is that each local subproblem has a quadratic regularizer, leading to a faster consensus than subgradient-based dual decomposition, both theoretically and in practice. We provide closed-form solutions for these AD subproblems for binary pairwise factors and factors imposing first-order logic constraints. For arbitrary factors (large or combinatorial), we introduce an active set method which requires only an oracle for computing a local MAP configuration, making AD applicable to a wide range of problems. Experiments on synthetic and realworld problems show that AD compares favorably with the state-of-the-art.

Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach <=SEP=> OBJECTIVE
In the modern healthcare system, rapidly expanding costs/complexity, the growing myriad of treatment options, and exploding information streams that often do not effectively reach the front lines hinder the ability to choose optimal treatment decisions over time. The goal in this paper is to develop a general purpose (non-disease-specific) computational/artificial intelligence (AI) framework to address these challenges. This framework serves two potential functions: (1) a simulation environment for exploring various healthcare policies, payment methodologies, etc., and (2) the basis for clinical artificial intelligence - an AI that can "think like a doctor".


METHODS
This approach combines Markov decision processes and dynamic decision networks to learn from clinical data and develop complex plans via simulation of alternative sequential decision paths while capturing the sometimes conflicting, sometimes synergistic interactions of various components in the healthcare system. It can operate in partially observable environments (in the case of missing observations or data) by maintaining belief states about patient health status and functions as an online agent that plans and re-plans as actions are performed and new observations are obtained. This framework was evaluated using real patient data from an electronic health record.


RESULTS
The results demonstrate the feasibility of this approach; such an AI framework easily outperforms the current treatment-as-usual (TAU) case-rate/fee-for-service models of healthcare. The cost per unit of outcome change (CPUC) was $189 vs. $497 for AI vs. TAU (where lower is considered optimal) - while at the same time the AI approach could obtain a 30-35% increase in patient outcomes. Tweaking certain AI model parameters could further enhance this advantage, obtaining approximately 50% more improvement (outcome change) for roughly half the costs.


CONCLUSION
Given careful design and problem formulation, an AI simulation framework can approximate optimal decisions even in complex and uncertain environments. Future work is described that outlines potential lines of research and integration of machine learning algorithms for personalized medicine.

Seq2seq Fingerprint: An Unsupervised Deep Molecular Embedding for Drug Discovery <=SEP=> Many of today's drug discoveries require expertise knowledge and insanely expensive biological experiments for identifying the chemical molecular properties. However, despite the growing interests of using supervised machine learning algorithms to automatically identify those chemical molecular properties, there is little advancement of the performance and accuracy due to the limited amount of training data. In this paper, we propose a novel unsupervised molecular embedding method, providing a continuous feature vector for each molecule to perform further tasks, e.g., solubility classification. In the proposed method, a multi-layered Gated Recurrent Unit (GRU) network is used to map the input molecule into a continuous feature vector of fixed dimensionality, and then another deep GRU network is employed to decode the continuous vector back to the original molecule. As a result, the continuous encoding vector is expected to contain rigorous and enough information to recover the original molecule and predict its chemical properties. The proposed embedding method could utilize almost unlimited molecule data for the training phase. With sufficient information encoded in the vector, the proposed method is also robust and task-insensitive. The performance and robustness are confirmed and interpreted in our extensive experiments.

Social disconnectedness, perceived isolation, and health among older adults. <=SEP=> Previous research has identified a wide range of indicators of social isolation that pose health risks, including living alone, having a small social network, infrequent participation in social activities, and feelings of loneliness. However multiple forms of isolation are rarely studied together making it difficult to determine which aspects of isolation are most deleterious for health. Using population-based data from the National Social Life, Health, and Aging Project, we combine multiple indicators of social isolation into scales assessing social disconnectedness (e.g., small social network, infrequent participation in social activities) and perceived isolation (e.g., loneliness, perceived lack of social support). We examine the extent to which social disconnectedness and perceived isolation have distinct associations with physical and mental health among older adults. Results indicate that social disconnectedness and perceived isolation are independently associated with lower levels of self-rated physical health. However, the association between disconnectedness and mental health may operate through the strong relationship between perceived isolation and mental health. We conclude that health researchers need to consider social disconnectedness and perceived isolation simultaneously.

FC^4: Fully Convolutional Color Constancy with Confidence-Weighted Pooling <=SEP=> Improvements in color constancy have arisen from the use of convolutional neural networks (CNNs). However, the patch-based CNNs that exist for this problem are faced with the issue of estimation ambiguity, where a patch may contain insufficient information to establish a unique or even a limited possible range of illumination colors. Image patches with estimation ambiguity not only appear with great frequency in photographs, but also significantly degrade the quality of network training and inference. To overcome this problem, we present a fully convolutional network architecture in which patches throughout an image can carry different confidence weights according to the value they provide for color constancy estimation. These confidence weights are learned and applied within a novel pooling layer where the local estimates are merged into a global solution. With this formulation, the network is able to determine what to learn and how to pool automatically from color constancy datasets without additional supervision. The proposed network also allows for end-to-end training, and achieves higher efficiency and accuracy. On standard benchmarks, our network outperforms the previous state-of-the-art while achieving 120x greater efficiency.

Internet addiction among Norwegian adults: a stratified probability sample study. <=SEP=> Most Norwegians are Internet users. We conducted a stratified probability sample study (Norway, 2007, age-group 16-74 years, N= 3,399, response rate 35.3%, 87.1% Internet users) to assess the prevalence of Internet addiction and at-risk Internet use by the Young Diagnostic Questionnaire (YDQ). The prevalence of Internet addiction (YDQ score 5-8) was 1.0% and an additional 5.2% were at-risk Internet users (YDQ score 3-4). Internet addiction and at-risk Internet use was strongly dependent on gender and age with highest prevalences among young males (16-29 years 4.1% and 19.0%, 30-39 years 3.3% and 10.7%). Logistic regression showed that male gender, young age, university level education, and an unsatisfactory financial situation were factors positively associated with "problematic Internet use" (at-risk and addicted use combined). Time spent on the Internet and prevalence of self-reported sleeping disorders, depression, and other psychological impairments increased linearly with YDQ score. Problematic Internet use clearly affects the lives of many people.

Pseudo random number generator and Hash function for embedded microprocessors <=SEP=> Embedded microprocessors are commonly used for future technologies such as Internet of Things(IoT), RFID and Wireless Sensor Networks(WSN). However, the microprocessors have limited computing power and storages so straight-forward implementation of traditional services on resource constrained devices is not recommenced. To overcome this problem, lightweight implementation techniques should be concerned for practical implementations. Among various requirements, security applications should be conducted on microprocessors for secure and robust service environments. In this paper, we presented a light weight implementation techniques for efficient Pseudo Random Number Generator(PRNG) and Hash function. To reduce memory consumption and accelerate performance, we adopted AES accelerator based implementation. This technique is firstly introduced in INDOCRYPT'12, whose idea exploits peripheral devices for efficient hash computations. With this technique, we presented block cipher based light-weight pseudo random number generator and simple hash function on embedded microprocessors.

Toward Rapid Development of Multi-Party Virtual Human Negotiation Scenarios <=SEP=> This paper reports on an ongoing effort to enable the rapid development of multi-party virtual human negotiation scenarios. We present a case study in which a new scenario supporting negotiation between two human role players and two virtual humans was developed over a period of 12 weeks. We discuss the methodology and development process that were employed, from storyline design through role play and iterative development of the virtual humans’ semantic and task representations and natural language processing capabilities. We analyze the effort, expertise, and time required for each development step, and discuss opportunities to further streamline the development process.

Shape driven kernel adaptation in Convolutional Neural Network for robust facial trait recognition <=SEP=> One key challenge of facial trait recognition is the large non-rigid appearance variations due to some irrelevant real world factors, such as viewpoint and expression changes. In this paper, we explore how the shape information, i.e. facial landmark positions, can be explicitly deployed into the popular Convolutional Neural Network (CNN) architecture to disentangle such irrelevant non-rigid appearance variations. First, instead of using fixed kernels, we propose a kernel adaptation method to dynamically determine the convolutional kernels according to the spatial distribution of facial landmarks, which helps learning more robust features. Second, motivated by the intuition that different local facial regions may demand different adaptation functions, we further propose a tree-structured convolutional architecture to hierarchically fuse multiple local adaptive CNN subnetworks. Comprehensive experiments on WebFace, Morph II and MultiPIE databases well validate the effectiveness of the proposed kernel adaptation method and tree-structured convolutional architecture for facial trait recognition tasks, including identity, age and gender recognition. For all the tasks, the proposed architecture consistently achieves the state-of-the-art performances.

Story generation after TALE-SPIN <=SEP=> TALE-SPIN, the laat major AI attempt at atory generation, approached the problem of making up atoriea primarily from the perspective of an impartial world simulator. AUTHOR ia a program (under development) which generates atoriea as a creative reaaoner in purauit of her own narrative goals. It is thus intended to aimulate an author's mind aa ahe makes up a story, rather than the world as things happen in it. The four major forces driving the atory generation process, according to the AUTHOR model, are (1) author intentionality, (2) conceptual reformulation, (3) reminding, and (4) the opportunity enhancement metagoal. 1. World Simulation Based Story Generation TALE-SPIN [Meehan, 1976] is a program which made up Aesop-fable-like conceptual atoriea, which it then expressed in natural language. Each atory TALE-SPIN made up waa based on a model of the storyworld, including the characters in it and their goala, peraonalities, and interperaonal relatione. Storiea were apun by working out consequences of the model. Thus, central to TALE-SPIN waa the idea of world simulation. The three levels TALE-SPIN was most concerned with simulating were: 1. character intentionality-e.g., if Joe Bear was hungry, he would try to get something to eat 2. social conatrainta-e.g., if Joe Bear believed Irving Bird to be hia friend, he could aak an outright favor; if Joe Bear believed their relation to be a bit cooler, he would feel obliged to offer something in return (auch aa a worm) 3. phyaical cauaality-e.g., if Irving Bird ate a worm, the worm would cease to exist; after "fooling around", Aa oppoaed to Sheldon Klein's ayetem which only produced atory texts and which ia incapable, in principle, of understanding the atoriea it "makes up" [Klein et el., 1976]. characters felt "wiped out" World simulation, however, fails to reflect the proctaa that an author goes through in making up a atory-storyworlds are developed by authors aa needed, frequently as post hoc justification for eventa that the author has already decided ahe wants as part of the story. As illustration, let us consider the question of why, in the Star Wars aequel, "The Empire Strikes Back", Princess Leia and Solo go to visit Landeau. If one asks a reader (or viewer) this question, the anawer will be along the lines of, "They needed a place to hide from imperial stormtroopers until they got the hyperdrive fixed, and Landeau was an old buddy of Solo's, and ..." • …

A survey of unmanned aerial vehicles (UAVs) for traffic monitoring <=SEP=> The focus of this paper is on surveying UAV-based systems for traffic monitoring and management. Although there has been voluminous research on the subject, unmanned aerial vehicles (UAVs) are proven to be a viable and less time-consuming alternative to real-time traffic monitoring and management, providing the eye-in-the-sky solution to the problem.

A Multimodal Embedded Sensor System for Scalable Robotic and Prosthetic Fingers <=SEP=> The development of dexterous and robust anthropomorphic hands with rich sensor feedback remains a challenging task for both humanoid robotics as well as prosthetics as of today. The design of hands that are scalable in size and equipped with integrated multimodal sensor systems is a key requirement for advanced control schemes and reactive behaviour. In this paper, we present the design of a scalable and low cost robotic finger with a soft fingertip and position, temperature as well as normal and shear force sensors. All cables and sensors are completely enclosed inside the finger to ensure an anthropometric appearance. The finger is modelled based on a 50th percentile male little finger and can be easily adapted to other dimensions in terms of size and sensor system configuration. We describe the design of the sensor system, provide an experimental analysis for the characterization of the different sensor types in terms of sensor range, resolution, creep, spatial response as well as temperature flux.

A Fuzzy-Neural Intelligent Trading Model for Stock Price Prediction <=SEP=> In this paper, Fuzzy logic and Neural Network approaches for predicting financial stock price are investigated. A study of a knowledge based system for stock price prediction is carried out. We explore Trapezoidal membership function method and Sugeno-type fuzzy inference engine to optimize the estimated result. Our model utilizes the performance of artificial neural networks trained using back propagation and supervised learning methods respectively. The system is developed based on the selection of stock data history obtained from Nigerian Stock Exchange in Nigeria, which are studied and used in training the system. A computer simulation is designed to assist the experimental decision for the best control action. The system is developed using MySQL, NetBeans, Java, and MatLab. The experimental result shows that the model has such properties as fast convergence, high precision and strong function approximation ability. It has shown to perform well in the context of various trading strategies involving stocks.

Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO <=SEP=> Heterogeneous feature representations are widely used in machine learning and pattern recognition, especially for multimedia analysis. The multi-modal, often also high- dimensional , features may contain redundant and irrelevant information that can deteriorate the performance of modeling in classification. It is a challenging problem to select the informative features for a given task from the redundant and heterogeneous feature groups. In this paper, we propose a novel framework to address this problem. This framework is composed of two modules, namely, multi-modal deep neural networks and feature selection with sparse group LASSO. Given diverse groups of discriminative features, the proposed technique first converts the multi-modal data into a unified representation with different branches of the multi-modal deep neural networks. Then, through solving a sparse group LASSO problem, the feature selection component is used to derive a weight vector to indicate the importance of the feature groups. Finally, the feature groups with large weights are considered more relevant and hence are selected. We evaluate our framework on three image classification datasets. Experimental results show that the proposed approach is effective in selecting the relevant feature groups and achieves competitive classification performance as compared with several recent baseline methods.

On the Margin Theory of Feedforward Neural Networks <=SEP=> Past works have shown that, somewhat surprisingly, over-parametrization can help generalization in neural networks. Towards explaining this phenomenon, we adopt a margin-based perspective. We establish: 1) for multilayer feedforward relu networks, the global minimizer of a weakly-regularized cross-entropy loss has the maximum normalized margin among all networks, 2) as a result, increasing the over-parametrization improves the normalized margin and generalization error bounds for two-layer networks. In particular, an infinite-size neural network enjoys the best generalization guarantees. The typical infinite feature methods are kernel methods; we compare the neural net margin with that of kernel methods and construct natural instances where kernel methods have much weaker generalization guarantees. We validate this gap between the two approaches empirically. Finally, this infinite-neuron viewpoint is also fruitful for analyzing optimization. We show that a perturbed gradient flow on infinite-size networks finds a global optimizer in polynomial time.

Social interaction detection using a multi-sensor approach <=SEP=> In the context of a social gathering, such as a cocktail party, the memorable moments are often captured by professional photographers or the participants. The latter case is generally undesirable because many participants would rather enjoy the event instead of being occupied by the tedious photo capturing task. Motivated by this scenario, we propose an automated social event photo-capture framework for which, given the multiple sensor data streams and the information from the Web as input, will output the visually appealing photos of the social event. Our proposal consists of three components: (1) social attribute extraction from both the physical space and the cyberspace; (2) social attribute fusion; and (3) active camera control. Current work is presented and we conclude with expected contributions as well as future direction.