OpenRaiser/Intern-Atlas huggingface dataset:
Foresee: Attentive Future Projections of Chaotic Road Environments with Online Training
Venue: arXiv cs.LG 2018
Year: 2018

In this paper, we train a recurrent neural network to learn dynamics of a chaotic road environment and to project the future of the environment on an image. Future projection can be used to anticipate an unseen environment for example, in autonomous driving. Road environment is highly dynamic and complex due to the interaction among traffic participants such as vehicles and pedestrians. Even in this complex environment, a human driver is efficacious to safely drive on chaotic roads irrespective of the number of traffic participants. The proliferation of deep learning research has shown the efficacy of neural networks in learning this human behavior. In the same direction, we investigate recurrent neural networks to understand the chaotic road environment which is shared by pedestrians, vehicles (cars, trucks, bicycles etc.), and sometimes animals as well. We propose \emph{Foresee}, a unidirectional gated recurrent units (GRUs) network with attention to project future of the environment in the form of images. We have collected several videos on Delhi roads consisting of various traffic participants, background and infrastructure differences (like 3D pedestrian crossing) at various times on various days. We train \emph{Foresee} in an unsupervised way and we use online training to project frames up to $0.5$ seconds in advance. We show that our proposed model performs better than state of the art methods (prednet and Enc. Dec. LSTM) and finally, we show that our trained model generalizes to a public dataset for future projections.
A Corpus of English-Hindi Code-Mixed Tweets for Sarcasm Detection
Venue: arXiv cs.CL 2018
Year: 2018

Social media platforms like twitter and facebook have be- come two of the largest mediums used by people to express their views to- wards different topics. Generation of such large user data has made NLP tasks like sentiment analysis and opinion mining much more important. Using sarcasm in texts on social media has become a popular trend lately. Using sarcasm reverses the meaning and polarity of what is implied by the text which poses challenge for many NLP tasks. The task of sarcasm detection in text is gaining more and more importance for both commer- cial and security services. We present the first English-Hindi code-mixed dataset of tweets marked for presence of sarcasm and irony where each token is also annotated with a language tag. We present a baseline su- pervised classification system developed using the same dataset which achieves an average F-score of 78.4 after using random forest classifier and performing 10-fold cross validation.
RLS Recovery with Asymmetric Penalty: Fundamental Limits and Algorithmic Approaches
Venue: arXiv cs.IT 2018
Year: 2018

This paper studies regularized least square recovery of signals whose samples' prior distributions are nonidentical, e.g., signals with time-variant sparsity. For this model, Bayesian framework suggests to regularize the least squares term with an asymmetric penalty. We investigate this problem in two respects: First, we characterize the asymptotic performance via the replica method and then discuss algorithmic approaches to the problem. Invoking the asymptotic characterization of the performance, we propose a tuning strategy to optimally tune the algorithmic approaches for recovery. To demonstrate applications of the results, the particular example of BPSK recovery is investigated and the efficiency of the proposed strategy is depicted in the shadow of results available in the literature
Capacity bounds for bandlimited Gaussian channels with peak-to-average-power-ratio constraint
Venue: arXiv cs.IT 2018
Year: 2018

We revisit Shannon's problem of bounding the capacity of bandlimited Gaussian channel (BLGC) with peak power constraint, and extend the problem to the peak-to-average-power-ratio (PAPR) constrained case. By lower bounding the achievable information rate of pulse amplitude modulation with independent and identically distributed input under a PAPR constraint, we obtain a general capacity lower bound with respect to the shaping pulse. We then evaluate and optimize the lower bound by employing some parametric pulses, thereby improving the best existing result. Following Shannon's approach, capacity upper bound for PAPR constrained BLGC is also obtained. By combining our upper and lower bounds, the capacity of PAPR constrained BLGC is bounded to within a finite gap which tends to zero as the PAPR constraint tends to infinity. Using the same approach, we also improve existing capacity lower bounds for bandlimited optical intensity channel at high SNR.
PID2018 Benchmark Challenge: learning feedforward control
Venue: arXiv cs.SY 2018
Year: 2018

The design and application of learning feedforward controllers (LFFC) for the one-staged refrigeration cycle model described in the PID2018 Benchmark Challenge is presented, and its effectiveness is evaluated. The control system consists of two components: 1) a preset PID component and 2) a learning feedforward component which is a function approximator that is adapted on the basis of the feedback signal. A B-spline network based LFFC and a low-pass filter based LFFC are designed to track the desired outlet temperature of evaporator secondary flux and the superheating degree of refrigerant at evaporator outlet. Encouraging simulation results are included. Qualitative and quantitative comparison results evaluations show that, with little effort, a high-performance control system can be obtained with this approach. Our initial simple attempt of low-pass filter based LFFC and B-spline network based LFFC give J=0.4902 and J=0.6536 relative to the decentralized PID controller, respectively. Besides, the initial attempt of a combination controller of our optimized PI controller and low-pass filter LFFC gives J=0.6947 relative to the multi-variable PID controller.
Towards Adversarial Configurations for Software Product Lines
Venue: arXiv cs.LG 2018
Year: 2018

Ensuring that all supposedly valid configurations of a software product line (SPL) lead to well-formed and acceptable products is challenging since it is most of the time impractical to enumerate and test all individual products of an SPL. Machine learning classifiers have been recently used to predict the acceptability of products associated with unseen configurations. For some configurations, a tiny change in their feature values can make them pass from acceptable to non-acceptable regarding users' requirements and vice-versa. In this paper, we introduce the idea of leveraging these specific configurations and their positions in the feature space to improve the classifier and therefore the engineering of an SPL. Starting from a variability model, we propose to use Adversarial Machine Learning techniques to create new, adversarial configurations out of already known configurations by modifying their feature values. Using an industrial video generator we show how adversarial configurations can improve not only the classifier, but also the variability model, the variability implementation, and the testing oracle.
Code-Switching Language Modeling using Syntax-Aware Multi-Task Learning
Venue: arXiv cs.CL 2018
Year: 2018

Lack of text data has been the major issue on code-switching language modeling. In this paper, we introduce multi-task learning based language model which shares syntax representation of languages to leverage linguistic information and tackle the low resource data issue. Our model jointly learns both language modeling and Part-of-Speech tagging on code-switched utterances. In this way, the model is able to identify the location of code-switching points and improves the prediction of next word. Our approach outperforms standard LSTM based language model, with an improvement of 9.7% and 7.4% in perplexity on SEAME Phase I and Phase II dataset respectively.
Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks
Venue: arXiv cs.CR 2018
Year: 2018

Deep neural networks (DNNs) provide excellent performance across a wide range of classification tasks, but their training requires high computational resources and is often outsourced to third parties. Recent work has shown that outsourced training introduces the risk that a malicious trainer will return a backdoored DNN that behaves normally on most inputs but causes targeted misclassifications or degrades the accuracy of the network when a trigger known only to the attacker is present. In this paper, we provide the first effective defenses against backdoor attacks on DNNs. We implement three backdoor attacks from prior work and use them to investigate two promising defenses, pruning and fine-tuning. We show that neither, by itself, is sufficient to defend against sophisticated attackers. We then evaluate fine-pruning, a combination of pruning and fine-tuning, and show that it successfully weakens or even eliminates the backdoors, i.e., in some cases reducing the attack success rate to 0% with only a 0.4% drop in accuracy for clean (non-triggering) inputs. Our work provides the first step toward defenses against backdoor attacks in deep neural networks.
Conjoining uncooperative societies facilitates evolution of cooperation
Venue: arXiv cs.SI 2018
Year: 2018

Social structure affects the emergence and maintenance of cooperation. Here we study the evolutionary dynamics of cooperation in fragmented societies, and show that conjoining segregated cooperation-inhibiting groups, if done properly, rescues the fate of collective cooperation. We highlight the essential role of inter-group ties, that sew the patches of the social network together and facilitate cooperation. We point out several examples of this phenomenon in actual settings. We explore random and non-random graphs, as well as empirical networks. In many cases we find a marked reduction of the critical benefit-to-cost ratio needed for sustaining cooperation. Our finding gives hope that the increasing worldwide connectivity, if managed properly, can promote global cooperation.
High-Quality Disjoint and Overlapping Community Structure in Large-Scale Complex Networks
Venue: arXiv cs.SI 2018
Year: 2018

In this paper, we propose an improved version of an agglomerative hierarchical clustering algorithm that performs disjoint community detection in large-scale complex networks. The improved algorithm is achieved after replacing the local structural similarity used in the original algorithm, with the recently proposed Dynamic Structural Similarity. Additionally, the improved algorithm is extended to detect fuzzy and crisp overlapping community structure. The extended algorithm leverages the disjoint community structure generated by itself and the dynamic structural similarity measures, to compute a proposed membership probability function that defines the fuzzy communities. Moreover, an experimental evaluation is performed on reference benchmark graphs in order to compare the proposed algorithms with the state-of-the-art.
On the influence of the interaction graph on a finite dynamical system
Venue: arXiv cs.DM 2018
Year: 2018

A finite dynamical system (FDS) is a system of multivariate functions over a finite alphabet, that is typically used to model a network of interacting entities. The main feature of a finite dynamical system is its interaction graph, which indicates which local functions depend on which variables; the interaction graph is a qualitative representation of the interactions amongst entities on the network. As such, a major problem is to determine the effect of the interaction graph on the dynamics of the FDS. In this paper, we are interested in three main properties of an FDS: the number of images (the so-called rank), the number of periodic points (the so-called periodic rank) and the number of fixed points. In particular, we investigate the minimum, average, and maximum number of images (or periodic points, or fixed points) of FDSs with a prescribed interaction graph and a given alphabet size; thus yielding nine quantities to study. The paper is split into two parts. The first part considers the minimum rank, for which we derive the first meaningful results known so far. In particular, we show that the minimum rank decreases with the alphabet size, thus yielding the definition of an absolute minimum rank. We obtain lower and upper bounds on this absolute minimum rank, and we give classification results for graphs with very low (or highest) rank. The second part is a comprehensive survey of the results obtained on the nine quantities described above. We not only give a review of known results, but we also give a list of relevant open questions.
Least-square based recursive optimization for distance-based source localization
Venue: arXiv cs.SY 2018
Year: 2018

In this paper we study the problem of driving an agent to an unknown source whose location is estimated in real-time by a recursive optimization algorithm. The optimization criterion is subject to a least-square cost function constructed from the distance measurements to the target combined with the agent's self-odometry. In this work, two important issues concerning real world application are directly addressed, which is a discrete-time recursive algorithm for concurrent control and estimation, and consideration for input saturation. It is proven that with proper choices of the system's parameters, stability of all system states, including on-board estimator variables and the agent-target relative position can be achieved. The convergence of the agent's position to the target is also investigated via numerical simulation.
Topology Control for Energy-Efficient Localization in Mobile Underwater Sensor Networks using Stackelberg Game
Venue: arXiv cs.NI 2018
Year: 2018

The characteristics of mobile Underwater Sensor Networks (UWSNs), such as low communication bandwidth, large propagation delay, and sparse deployment, pose challenging issues for successful localization of sensor nodes. In addition, sensor nodes in UWSNs are usually powered by batteries whose replacements introduce high cost and complexity. Thus, the critical problem in UWSNs is to enable each sensor node to find enough anchor nodes in order to localize itself, with minimum energy costs. In this paper, an Energy-Efficient Localization Algorithm (EELA) is proposed to analyze the decentralized interactions among sensor nodes and anchor nodes. A Single-Leader-Multi-Follower Stackelberg game is utilized to formulate the topology control problem of sensor nodes and anchor nodes by exploiting their available communication opportunities. In this game, the sensor node acts as a leader taking into account factors such as 'two-hop' anchor nodes and energy consumption, while anchor nodes act as multiple followers, considering their ability to localize sensor nodes and their energy consumption. We prove that both players select best responses and reach a socially optimal Stackelberg Nash Equilibrium. Simulation results demonstrate that the proposed EELA improves the perfor- mance of localization in UWSNs significantly, and in particular the energy cost of sensor nodes. Compared to the baseline schemes, the energy consumption per node is about 48% lower in EELA, while providing a desirable localization coverage, under reasonable error and delay.
HOPF: Higher Order Propagation Framework for Deep Collective Classification
Venue: arXiv cs.LG 2018
Year: 2018

Given a graph where every node has certain attributes associated with it and some nodes have labels associated with them, Collective Classification (CC) is the task of assigning labels to every unlabeled node using information from the node as well as its neighbors. It is often the case that a node is not only influenced by its immediate neighbors but also by higher order neighbors, multiple hops away. Recent state-of-the-art models for CC learn end-to-end differentiable variations of Weisfeiler-Lehman (WL) kernels to aggregate multi-hop neighborhood information. In this work, we propose a Higher Order Propagation Framework, HOPF, which provides an iterative inference mechanism for these powerful differentiable kernels. Such a combination of classical iterative inference mechanism with recent differentiable kernels allows the framework to learn graph convolutional filters that simultaneously exploit the attribute and label information available in the neighborhood. Further, these iterative differentiable kernels can scale to larger hops beyond the memory limitations of existing differentiable kernels. We also show that existing WL kernel-based models suffer from the problem of Node Information Morphing where the information of the node is morphed or overwhelmed by the information of its neighbors when considering multiple hops. To address this, we propose a specific instantiation of HOPF, called the NIP models, which preserves the node information at every propagation step. The iterative formulation of NIP models further helps in incorporating distant hop information concisely as summaries of the inferred labels. We do an extensive evaluation across 11 datasets from different domains. We show that existing CC models do not provide consistent performance across datasets, while the proposed NIP model with iterative inference is more robust.
How to Simulate It in Isabelle: Towards Formal Proof for Secure Multi-Party Computation
Venue: arXiv cs.CR 2018
Year: 2018

In cryptography, secure Multi-Party Computation (MPC) protocols allow participants to compute a function jointly while keeping their inputs private. Recent breakthroughs are bringing MPC into practice, solving fundamental challenges for secure distributed computation. Just as with classic protocols for encryption and key exchange, precise guarantees are needed for MPC designs and implementations; any flaw will give attackers a chance to break privacy or correctness. In this paper we present the first (as far as we know) formalisation of some MPC security proofs. These proofs provide probabilistic guarantees in the computational model of security, but have a different character to machine proofs and proof tools implemented so far --- MPC proofs use a \emph{simulation} approach, in which security is established by showing indistinguishability between execution traces in the actual protocol execution and an ideal world where security is guaranteed by definition. We show that existing machinery for reasoning about probabilistic programs adapted to this setting, paving the way to precisely check a new class of cryptography arguments. We implement our proofs using the CryptHOL framework inside Isabelle/HOL.
Practical Study of Deterministic Regular Expressions from Large-scale XML and Schema Data
Venue: arXiv cs.DB 2018
Year: 2018

Regular expressions are a fundamental concept in computer science and widely used in various applications. In this paper we focused on deterministic regular expressions (DREs). Considering that researchers didn't have large datasets as evidence before, we first harvested a large corpus of real data from the Web then conducted a practical study to investigate the usage of DREs. One feature of our work is that the data set is sufficiently large compared with previous work, which is obtained using several data collection strategies we proposed. The results show more than 98\% of expressions in Relax NG are DRE, and more than 56\% of expressions from RegExLib are DRE, while both Relax NG and RegExLib do not have the determinism constraint. These observations indicate that DREs are commonly used in practice. The results also show further study of subclasses of DREs is necessary. As far as we know, we are the first to analyze the determinism and the subclasses of DREs of Relax NG and RegExLib, and give these results. Furthermore, we give some discussions and applications of the data set. We obtain a DRE data set from the original data, which will be useful in practice and it has value in its own right. We find current research in new subclasses of DREs is insufficient, therefore it is necessary to do further study. We also analyze the referencing relationships among XSDs and define SchemaRank, which can be used in XML Schema design.
On the Origins of Memes by Means of Fringe Web Communities
Venue: arXiv cs.SI 2018
Year: 2018

Internet memes are increasingly used to sway and manipulate public opinion. This prompts the need to study their propagation, evolution, and influence across the Web. In this paper, we detect and measure the propagation of memes across multiple Web communities, using a processing pipeline based on perceptual hashing and clustering techniques, and a dataset of 160M images from 2.6B posts gathered from Twitter, Reddit, 4chan's Politically Incorrect board (/pol/), and Gab, over the course of 13 months. We group the images posted on fringe Web communities (/pol/, Gab, and The_Donald subreddit) into clusters, annotate them using meme metadata obtained from Know Your Meme, and also map images from mainstream communities (Twitter and Reddit) to the clusters. Our analysis provides an assessment of the popularity and diversity of memes in the context of each community, showing, e.g., that racist memes are extremely common in fringe Web communities. We also find a substantial number of politics-related memes on both mainstream and fringe Web communities, supporting media reports that memes might be used to enhance or harm politicians. Finally, we use Hawkes processes to model the interplay between Web communities and quantify their reciprocal influence, finding that /pol/ substantially influences the meme ecosystem with the number of memes it produces, while \td has a higher success rate in pushing them to other communities.
The Complexity of Splitting Necklaces and Bisecting Ham Sandwiches
Venue: arXiv cs.CC 2018
Year: 2018

We resolve the computational complexity of two problems known as NECKLACE-SPLITTING and DISCRETE HAM SANDWICH, showing that they are PPA-complete. For NECKLACE SPLITTING, this result is specific to the important special case in which two thieves share the necklace. We do this via a PPA-completeness result for an approximate version of the CONSENSUS-HALVING problem, strengthening our recent result that the problem is PPA-complete for inverse-exponential precision. At the heart of our construction is a smooth embedding of the high-dimensional Möbius strip in the CONSENSUS-HALVING problem. These results settle the status of PPA as a class that captures the complexity of "natural" problems whose definitions do not incorporate a circuit.
Decidability results for ATL* with imperfect information and perfect recall
Venue: arXiv cs.LO 2018
Year: 2018

Alternating-time Temporal Logic (ATL*) is a central logic for multiagent systems. Its extension to the imperfect information setting (ATL*i ) is well known to have an undecidable model-checking problem when agents have perfect recall. Studies have thus mostly focused either on agents without memory, or on alternative semantics to retrieve decidability. In this work we establish new decidability results for agents with perfect recall: We first prove a meta-theorem that allows the transfer of decidability results for classes of multiplayer games with imperfect information, such as games with hierarchical observation, to the model-checking problem for ATL*i . We then establish that model checking ATL* with strategy context and imperfect information is decidable when restricted to hierarchical instances.