OpenRaiser/Intern-Atlas huggingface dataset:
Secure Transmit Antenna Selection Protocol for MIMO NOMA Networks over Nakagami-m Channels
Venue: arXiv cs.IT 2019
Year: 2019

In this paper, we studied a multi-input multi-output (MIMO) non-orthogonal multiple access (NOMA) network consisting of one source and two legitimate users (LUs), so-called near and far users according to their distances to the source, and one passive eavesdropper, over Nakagami-\textit{m} fading channel. Specifically, we investigated the scenario that the signals of the far user might or might not be decoded successfully at the eavesdropper and the near user. Thus, we aimed at designing a transmit antenna selection (TAS) secure communication protocol for the network. Then, two TAS solutions, namely Solutions I and II, were proposed. Specifically, solutions I and II focus on maximizing the received signal power between the source and the near user, and between the source and the far user, respectively. Accordingly, the exact and asymptotic closed-form expressions of the secrecy outage probability for the LUs and the overall system were derived. Our analytical results corroborated by Monte Carlo simulation indicate that the secrecy performance could be significantly improved by properly selecting power allocation coefficients and increasing the number of antennas at the source and the LUs. Interestingly, solution II could provide a better overall secrecy performance over solution I.
HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems
Venue: arXiv cs.IR 2019
Year: 2019

This paper investigates the notion of learning user and item representations in non-Euclidean space. Specifically, we study the connection between metric learning in hyperbolic space and collaborative filtering by exploring Mobius gyrovector spaces where the formalism of the spaces could be utilized to generalize the most common Euclidean vector operations. Overall, this work aims to bridge the gap between Euclidean and hyperbolic geometry in recommender systems through metric learning approach. We propose HyperML (Hyperbolic Metric Learning), a conceptually simple but highly effective model for boosting the performance. Via a series of extensive experiments, we show that our proposed HyperML not only outperforms their Euclidean counterparts, but also achieves state-of-the-art performance on multiple benchmark datasets, demonstrating the effectiveness of personalized recommendation in hyperbolic geometry.
MASA: Motif-Aware State Assignment in Noisy Time Series Data
Venue: arXiv cs.LG 2019
Year: 2019

Complex systems, such as airplanes, cars, or financial markets, produce multivariate time series data consisting of a large number of system measurements over a period of time. Such data can be interpreted as a sequence of states, where each state represents a prototype of system behavior. An important problem in this domain is to identify repeated sequences of states, known as motifs. Such motifs correspond to complex behaviors that capture common sequences of state transitions. For example, in automotive data, a motif of "making a turn" might manifest as a sequence of states: slowing down, turning the wheel, and then speeding back up. However, discovering these motifs is challenging, because the individual states and state assignments are unknown, have different durations, and need to be jointly learned from the noisy time series. Here we develop motif-aware state assignment (MASA), a method to discover common motifs in noisy time series data and leverage those motifs to more robustly assign states to measurements. We formulate the problem of motif discovery as a large optimization problem, which we solve using an expectation-maximization type approach. MASA performs well in the presence of noise in the input data and is scalable to very large datasets. Experiments on synthetic data show that MASA outperforms state-of-the-art baselines by up to 38.2%, and two case studies demonstrate how our approach discovers insightful motifs in the presence of noise in real-world time series data.
Smoothed Efficient Algorithms and Reductions for Network Coordination Games
Venue: arXiv cs.CC 2019
Year: 2019

Worst-case hardness results for most equilibrium computation problems have raised the need for beyond-worst-case analysis. To this end, we study the smoothed complexity of finding pure Nash equilibria in Network Coordination Games, a PLS-complete problem in the worst case. This is a potential game where the sequential-better-response algorithm is known to converge to a pure NE, albeit in exponential time. First, we prove polynomial (resp. quasi-polynomial) smoothed complexity when the underlying game graph is a complete (resp. arbitrary) graph, and every player has constantly many strategies. We note that the complete graph case is reminiscent of perturbing all parameters, a common assumption in most known smoothed analysis results. Second, we define a notion of smoothness-preserving reduction among search problems, and obtain reductions from $2$-strategy network coordination games to local-max-cut, and from $k$-strategy games (with arbitrary $k$) to local-max-cut up to two flips. The former together with the recent result of [BCC18] gives an alternate $O(n^8)$-time smoothed algorithm for the $2$-strategy case. This notion of reduction allows for the extension of smoothed efficient algorithms from one problem to another. For the first set of results, we develop techniques to bound the probability that an (adversarial) better-response sequence makes slow improvements on the potential. Our approach combines and generalizes the local-max-cut approaches of [ER14,ABPW17] to handle the multi-strategy case: it requires a careful definition of the matrix which captures the increase in potential, a tighter union bound on adversarial sequences, and balancing it with good enough rank bounds. We believe that the approach and notions developed herein could be of interest in addressing the smoothed complexity of other potential and/or congestion games.
Sub-6GHz Assisted MAC for Millimeter Wave Vehicular Communications
Venue: arXiv cs.NI 2019
Year: 2019

Sub-6GHz vehicular communications (using DSRC, ITS-G5 or C-V2X) have been developed to support active safety applications. Future connected and automated driving applications can require larger bandwidth and higher data rates than currently supported by sub-6GHz V2X technologies. This has triggered the interest in developing mmWave vehicular communications. However, solutions are necessary to solve the challenges resulting from the use of high-frequency bands and the high mobility of vehicles. This paper contributes to this active research area by proposing a sub-6GHz assisted mmWave MAC that decouples the mmWave data and control planes. The proposal offloads mmWave MAC control functions (beam alignment, neighbor identification and scheduling) to a sub-6GHz V2X technology, and reserves the mmWave channel for the data plane. This approach improves the operation of the MAC as the control functions benefit from the longer range, and the broadcast and omnidirectional transmissions of sub-6GHz V2X technologies. This simulation study demonstrates that the proposed sub-6GHz assisted mmWave MAC reduces the control overhead and delay, and increases the spatial sharing compared to a mmWave-only configuration (IEEE 802.11ad tailored to vehicular networks). The proposed MAC is here evaluated for V2V communications using 802.11p for the control plane and 802.11ad for the data plane. However, the proposal is not restricted to these technologies, and can be adapted to other technologies such as C-V2X and 5G NR.
On the Importance of Visual Context for Data Augmentation in Scene Understanding
Venue: arXiv cs.CV 2019
Year: 2019

Performing data augmentation for learning deep neural networks is known to be important for training visual recognition systems. By artificially increasing the number of training examples, it helps reducing overfitting and improves generalization. While simple image transformations can already improve predictive performance in most vision tasks, larger gains can be obtained by leveraging task-specific prior knowledge. In this work, we consider object detection, semantic and instance segmentation and augment the training images by blending objects in existing scenes, using instance segmentation annotations. We observe that randomly pasting objects on images hurts the performance, unless the object is placed in the right context. To resolve this issue, we propose an explicit context model by using a convolutional neural network, which predicts whether an image region is suitable for placing a given object or not. In our experiments, we show that our approach is able to improve object detection, semantic and instance segmentation on the PASCAL VOC12 and COCO datasets, with significant gains in a limited annotation scenario, i.e. when only one category is annotated. We also show that the method is not limited to datasets that come with expensive pixel-wise instance annotations and can be used when only bounding boxes are available, by employing weakly-supervised learning for instance masks approximation.
Optimizing CNN Model Inference on CPUs
Venue: arXiv cs.DC 2019
Year: 2019

The popularity of Convolutional Neural Network (CNN) models and the ubiquity of CPUs imply that better performance of CNN model inference on CPUs can deliver significant gain to a large number of users. To improve the performance of CNN inference on CPUs, current approaches like MXNet and Intel OpenVINO usually treat the model as a graph and use the high-performance libraries such as Intel MKL-DNN to implement the operations of the graph. While achieving reasonable performance on individual operations from the off-the-shelf libraries, this solution makes it inflexible to conduct optimizations at the graph level, as the local operation-level optimizations are predefined. Therefore, it is restrictive and misses the opportunity to optimize the end-to-end inference pipeline as a whole. This paper presents \emph{NeoCPU}, a comprehensive approach of CNN model inference on CPUs that employs a full-stack and systematic scheme of optimizations. \emph{NeoCPU} optimizes the operations as templates without relying on third-parties libraries, which enables further improvement of the performance via operation- and graph-level joint optimization. Experiments show that \emph{NeoCPU} achieves up to 3.45$\times$ lower latency for CNN model inference than the current state-of-the-art implementations on various kinds of popular CPUs.
Exploiting Edge Features in Graph Neural Networks
Venue: arXiv cs.LG 2019
Year: 2019

Edge features contain important information about graphs. However, current state-of-the-art neural network models designed for graph learning, e.g. graph convolutional networks (GCN) and graph attention networks (GAT), adequately utilize edge features, especially multi-dimensional edge features. In this paper, we build a new framework for a family of new graph neural network models that can more sufficiently exploit edge features, including those of undirected or multi-dimensional edges. The proposed framework can consolidate current graph neural network models; e.g. graph convolutional networks (GCN) and graph attention networks (GAT). The proposed framework and new models have the following novelties: First, we propose to use doubly stochastic normalization of graph edge features instead of the commonly used row or symmetric normalization approches used in current graph neural networks. Second, we construct new formulas for the operations in each individual layer so that they can handle multi-dimensional edge features. Third, for the proposed new framework, edge features are adaptive across network layers. As a result, our proposed new framework and new models can exploit a rich source of graph information. We apply our new models to graph node classification on several citation networks, whole graph classification, and regression on several molecular datasets. Compared with the current state-of-the-art methods, i.e. GCNs and GAT, our models obtain better performance, which testify to the importance of exploiting edge features in graph neural networks.
Why Do Adversarial Attacks Transfer? Explaining Transferability of Evasion and Poisoning Attacks
Venue: arXiv cs.LG 2019
Year: 2019

Transferability captures the ability of an attack against a machine-learning model to be effective against a different, potentially unknown, model. Empirical evidence for transferability has been shown in previous work, but the underlying reasons why an attack transfers or not are not yet well understood. In this paper, we present a comprehensive analysis aimed to investigate the transferability of both test-time evasion and training-time poisoning attacks. We provide a unifying optimization framework for evasion and poisoning attacks, and a formal definition of transferability of such attacks. We highlight two main factors contributing to attack transferability: the intrinsic adversarial vulnerability of the target model, and the complexity of the surrogate model used to optimize the attack. Based on these insights, we define three metrics that impact an attack's transferability. Interestingly, our results derived from theoretical analysis hold for both evasion and poisoning attacks, and are confirmed experimentally using a wide range of linear and non-linear classifiers and datasets.
Localization Algorithm with Circular Representation in 2D and its Similarity to Mammalian Brains
Venue: arXiv cs.RO 2019
Year: 2019

Extended Kalman filter (EKF) does not guarantee consistent mean and covariance under linearization, even though it is the main framework for robotic localization. While Lie group improves the modeling of the state space in localization, the EKF on Lie group still relies on the arbitrary Gaussian assumption in face of nonlinear models. We instead use von Mises filter for orientation estimation together with the conventional Kalman filter for position estimation, and thus we are able to characterize the first two moments of the state estimates. Since the proposed algorithm holds a solid probabilistic basis, it is fundamentally relieved from the inconsistency problem. Furthermore, we extend the localization algorithm to fully circular representation even for position, which is similar to grid patterns found in mammalian brains and in recurrent neural networks. The applicability of the proposed algorithms is substantiated not only by strong mathematical foundation but also by the comparison against other common localization methods.
Hybrid Pricing for Mobile Collaborative Internet Access
Venue: arXiv cs.NI 2019
Year: 2019

Mobile Collaborative Internet Access (MCA) enables mobile users to share their Internet through flexible tethering arrangements. This can potentially make better use of network resources. However, from a mobile network operator's (MNO's) viewpoint, it can either reduce revenue or increase congestion, and thus has been blocked by some MNOs in practice. We propose a hybrid pricing framework for MNOs who charge users separately for access and tethering. This scheme serves to coordinate the tethering decisions of mobile users with MNO network management objectives. We analyze the MNOs' equilibrium pricing strategies in both cooperative and competitive scenarios. In the cooperative scenario, at the equilibrium, each user's cost is independent of any chosen tethering links. We then characterize the optimal hybrid pricing strategies of MNOs in this scenario. For the competitive scenario, we formulate the MNOs' competitive interactions as a pricing game, and we show that MNO competition leads to equalized prices for users if an equilibrium exists but does not guarantee its existence. Both insights motivate a quantity competition game, which is shown to guarantee an equilibrium. Simulation results show that in scenarios of interest the proposed hybrid pricing schemes can double both MNOs' profit and users' payoff and such improvements increase with the degree of network heterogeneity.
Keep Rollin' - Whole-Body Motion Control and Planning for Wheeled Quadrupedal Robots
Venue: arXiv cs.RO 2019
Year: 2019

We show dynamic locomotion strategies for wheeled quadrupedal robots, which combine the advantages of both walking and driving. The developed optimization framework tightly integrates the additional degrees of freedom introduced by the wheels. Our approach relies on a zero-moment point based motion optimization which continuously updates reference trajectories. The reference motions are tracked by a hierarchical whole-body controller which computes optimal generalized accelerations and contact forces by solving a sequence of prioritized tasks including the nonholonomic rolling constraints. Our approach has been tested on ANYmal, a quadrupedal robot that is fully torque-controlled including the non-steerable wheels attached to its legs. We conducted experiments on flat and inclined terrains as well as over steps, whereby we show that integrating the wheels into the motion control and planning framework results in intuitive motion trajectories, which enable more robust and dynamic locomotion compared to other wheeled-legged robots. Moreover, with a speed of 4 m/s and a reduction of the cost of transport by 83 % we prove the superiority of wheeled-legged robots compared to their legged counterparts.
Improving Question Answering by Commonsense-Based Pre-Training
Venue: arXiv cs.CL 2019
Year: 2019

Although neural network approaches achieve remarkable success on a variety of NLP tasks, many of them struggle to answer questions that require commonsense knowledge. We believe the main reason is the lack of commonsense \mbox{connections} between concepts. To remedy this, we provide a simple and effective method that leverages external commonsense knowledge base such as ConceptNet. We pre-train direct and indirect relational functions between concepts, and show that these pre-trained functions could be easily added to existing neural network models. Results show that incorporating commonsense-based function improves the baseline on three question answering tasks that require commonsense reasoning. Further analysis shows that our system \mbox{discovers} and leverages useful evidence from an external commonsense knowledge base, which is missing in existing neural network models and help derive the correct answer.
Improved Techniques for Adversarial Discriminative Domain Adaptation
Venue: arXiv cs.CV 2019
Year: 2019

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available for the target domain. We investigate whether we can improve performance of ADDA with a new framework and new loss formulations. Following the framework of semi-supervised GANs, we first extend the discriminator output over the source classes, in order to model the joint distribution over domain and task. We thus leverage on the distribution over the source encoder posteriors (which is fixed during adversarial training) and propose maximum mean discrepancy (MMD) and reconstruction-based loss functions for aligning the target encoder distribution to the source domain. We compare and provide a comprehensive analysis of how our framework and loss formulations extend over simple multi-class extensions of ADDA and other discriminative variants of semi-supervised GANs. In addition, we introduce various forms of regularization for stabilizing training, including treating the discriminator as a denoising autoencoder and regularizing the target encoder with source examples to reduce overfitting under a contraction mapping (i.e., when the target per-class distributions are contracting during alignment with the source). Finally, we validate our framework on standard domain adaptation datasets, such as SVHN and MNIST. We also examine how our framework benefits recognition problems based on modalities that lack training data, by introducing and evaluating on a neuromorphic vision sensing (NVS) sign language recognition dataset, where the source and target domains constitute emulated and real neuromorphic spike events respectively. Our results on all datasets show that our proposal competes or outperforms the state-of-the-art in unsupervised domain adaptation.
Uplink Cooperative NOMA for Cellular-Connected UAV
Venue: arXiv cs.IT 2019
Year: 2019

Aerial-ground interference mitigation is a challenging issue in the cellular-connected unmanned aerial vehicle (UAV) communications. Due to the strong line-of-sight (LoS) air-to-ground (A2G) channels, the UAV may impose/suffer more severe uplink/downlink interference to/from the cellular base stations (BSs) than the ground users. To tackle this challenge, we propose to apply the non-orthogonal multiple access (NOMA) technique to the uplink communication from a UAV to cellular BSs, under spectrum sharing with the existing ground users. However, for our considered system, traditional NOMA with local interference cancellation (IC), termed non-cooperative NOMA, may provide very limited gain compared to the OMA. This is because there are many co-channel BSs due to the LoS A2G channels and thus the UAV's rate performance is severely limited by the BS with the worst channel condition with the UAV. To improve the UAV's achievable rate, a new cooperative NOMA scheme is proposed by exploiting the backhaul links among BSs. Specifically, some BSs with better channel conditions are selected to decode the UAV's signals first, and then forward the decoded signals to their backhaul-connected BSs for IC. To investigate the optimal design of cooperative NOMA, we maximize the weighted sum-rate of the UAV and ground users by jointly optimizing the UAV's rate and power allocations over multiple resource blocks. However, this problem is hard to be solved optimally. To obtain useful insights, we first consider two special cases with egoistic and altruistic transmission strategies of the UAV, respectively, and solve their corresponding problems optimally. Next, we consider the general case and propose an efficient suboptimal solution via the alternating optimization. Numerical results show that the proposed cooperative NOMA yields significant throughput gains than the OMA and the non-cooperative NOMA benchmark.
Neural Rendering and Reenactment of Human Actor Videos
Venue: arXiv cs.CV 2019
Year: 2019

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of the human, but instead rely on a video sequence in conjunction with a (medium-quality) controllable 3D template model of the person. With that, our approach significantly reduces production cost compared to conventional rendering approaches based on production-quality 3D models, and can also be used to realistically edit existing videos. Technically, this is achieved by training a neural network that translates simple synthetic images of a human character into realistic imagery. For training our networks, we first track the 3D motion of the person in the video using the template model, and subsequently generate a synthetically rendered version of the video. These images are then used to train a conditional generative adversarial network that translates synthetic images of the 3D model into realistic imagery of the human. We evaluate our method for the reenactment of another person that is tracked in order to obtain the motion data, and show video results generated from artist-designed skeleton motion. Our results outperform the state-of-the-art in learning-based human image synthesis. Project page: http://gvv.mpi-inf.mpg.de/projects/wxu/HumanReenactment/