OpenRaiser/Intern-Atlas huggingface dataset:
Interference-Alignment and Soft-Space-Reuse Based Cooperative Transmission for Multi-cell Massive MIMO Networks
Venue: arXiv cs.IT 2017
Year: 2017

As a revolutionary wireless transmission strategy, interference alignment (IA) can improve the capacity of the cell-edge users. However, the acquisition of the global channel state information (CSI) for IA leads to unacceptable overhead in the massive MIMO systems. To tackle this problem, in this paper, we propose an IA and soft-space-reuse (IA-SSR) based cooperative transmission scheme under the two-stage precoding framework. Specifically, the cell-center and the cell-edge users are separately treated to fully exploit the spatial degrees of freedoms (DoF). Then, the optimal power allocation policy is developed to maximize the sum-capacity of the network. Next, a low-cost channel estimator is designed for the proposed IA-SSR framework. Some practical issues in IA-SSR implementation are also discussed. Finally, plenty of numerical results are presented to show the efficiency of the proposed algorithm.
Conditions for Unique Reconstruction of Sparse Signals Using Compressive Sensing Methods
Venue: arXiv cs.IT 2017
Year: 2017

A signal is sparse in one of its representation domain if the number of nonzero coefficients in that domain is much smaller than the total number of coefficients. Sparse signals can be reconstructed from a very reduced set of measurements/observations. The topic of this paper are conditions for the unique reconstruction of sparse signals from a reduced set of observations. After the basic definitions are introduced, the unique reconstruction conditions are reviewed using the spark, restricted isometry, and coherence of the measurement matrix. Uniqueness of the reconstruction of signals sparse in the discrete Fourier domain (DFT), as the most important signal transformation domain, is considered as well.
Successive Cancellation Decoding of Single Parity-Check Product Codes
Venue: arXiv cs.IT 2017
Year: 2017

We introduce successive cancellation (SC) decoding of product codes (PCs) with single parity-check (SPC) component codes. Recursive formulas are derived, which resemble the SC decoding algorithm of polar codes. We analyze the error probability of SPC-PCs over the binary erasure channel under SC decoding. A bridge with the analysis of PCs introduced by Elias in 1954 is also established. Furthermore, bounds on the block error probability under SC decoding are provided, and compared to the bounds under the original decoding algorithm proposed by Elias. It is shown that SC decoding of SPC-PCs achieves a lower block error probability than Elias' decoding.
Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network
Venue: arXiv cs.CV 2017
Year: 2017

In this paper, we propose a method using a three dimensional convolutional neural network (3-D-CNN) to fuse together multispectral (MS) and hyperspectral (HS) images to obtain a high resolution hyperspectral image. Dimensionality reduction of the hyperspectral image is performed prior to fusion in order to significantly reduce the computational time and make the method more robust to noise. Experiments are performed on a data set simulated using a real hyperspectral image. The results obtained show that the proposed approach is very promising when compared to conventional methods. This is especially true when the hyperspectral image is corrupted by additive noise.
Concurrent Geometric Multicasting
Venue: arXiv cs.DC 2017
Year: 2017

We present MCFR, a multicasting concurrent face routing algorithm that uses geometric routing to deliver a message from source to multiple targets. We describe the algorithm's operation, prove it correct, estimate its performance bounds and evaluate its performance using simulation. Our estimate shows that MCFR is the first geometric multicast routing algorithm whose message delivery latency is independent of network size and only proportional to the distance between the source and the targets. Our simulation indicates that MCFR has significantly better reliability than existing algorithms.
NOMA in Distributed Antenna System for Max-Min Fairness and Max-Sum-Rate
Venue: arXiv cs.IT 2017
Year: 2017

Distributed antenna system (DAS) has been deployed for over a decade. DAS has advantages in capacity especially for the cell edge users, in both single-cell and multi-cell environments. In this paper, non-orthogonal multiple access (NOMA) is suggested in single-cell DAS to maximize user fairness and sumrate. Two transmission strategies are considered: NOMA with single selection transmission and NOMA with blanket transmission. In a two-user scenario, the center base station (BS) uses NOMA to serve both users and the remote radio units (RRUs) serve only the weak user based on the transmission scheme. The signals sent from the RRUs are not considered as interference at both user sides. At one side, the signals from the RRUs are used to detect the required data and at the other side, the signals are used to perform successive interference cancellation (SIC). The max-min performance is studied when instantaneous channel gain information (CGI) or channel distribution information (CDI) is known at the transmitter. A closed-form expression of the upper bound is derived for the data rate of each user with only CDI. In addition, the sum-rate is studied with a minimum rate constraint when instantaneous CGI known at the transmitter. The results show that NOMA with blanket transmission gives the best performance compared to other schemes; conventional-NOMA, conventional single selection scheme and joint-transmission (JT) NOMA. It is also shown that with less transmit power, NOMA with single selection transmission gives better performance than conventional-NOMA.
Optimal Online Two-way Trading with Bounded Number of Transactions
Venue: arXiv cs.DS 2017
Year: 2017

We consider a two-way trading problem, where investors buy and sell a stock whose price moves within a certain range. Naturally they want to maximize their profit. Investors can perform up to $k$ trades, where each trade must involve the full amount. We give optimal algorithms for three different models which differ in the knowledge of how the price fluctuates. In the first model, there are global minimum and maximum bounds $m$ and $M$. We first show an optimal lower bound of $φ$ (where $φ=M/m$) on the competitive ratio for one trade, which is the bound achieved by trivial algorithms. Perhaps surprisingly, when we consider more than one trade, we can give a better algorithm that loses only a factor of $φ^{2/3}$ (rather than $φ$) per additional trade. Specifically, for $k$ trades the algorithm has competitive ratio $φ^{(2k+1)/3}$. Furthermore we show that this ratio is the best possible by giving a matching lower bound. In the second model, $m$ and $M$ are not known in advance, and just $φ$ is known. We show that this only costs us an extra factor of $φ^{1/3}$, i.e., both upper and lower bounds become $φ^{(2k+2)/3}$. Finally, we consider the bounded daily return model where instead of a global limit, the fluctuation from one day to the next is bounded, and again we give optimal algorithms, and interestingly one of them resembles common trading strategies that involve stop loss limits.
A Survey on Non-Orthogonal Multiple Access for 5G Networks: Research Challenges and Future Trends
Venue: arXiv cs.IT 2017
Year: 2017

Non-orthogonal multiple access (NOMA) is an essential enabling technology for the fifth generation (5G) wireless networks to meet the heterogeneous demands on low latency, high reliability, massive connectivity, improved fairness, and high throughput. The key idea behind NOMA is to serve multiple users in the same resource block, such as a time slot, subcarrier, or spreading code. The NOMA principle is a general framework, and several recently proposed 5G multiple access schemes can be viewed as special cases. This survey provides an overview of the latest NOMA research and innovations as well as their applications. Thereby, the papers published in this special issue are put into the content of the existing literature. Future research challenges regarding NOMA in 5G and beyond are also discussed.
Improving Distributed Gradient Descent Using Reed-Solomon Codes
Venue: arXiv cs.IT 2017
Year: 2017

Today's massively-sized datasets have made it necessary to often perform computations on them in a distributed manner. In principle, a computational task is divided into subtasks which are distributed over a cluster operated by a taskmaster. One issue faced in practice is the delay incurred due to the presence of slow machines, known as \emph{stragglers}. Several schemes, including those based on replication, have been proposed in the literature to mitigate the effects of stragglers and more recently, those inspired by coding theory have begun to gain traction. In this work, we consider a distributed gradient descent setting suitable for a wide class of machine learning problems. We adapt the framework of Tandon et al. (arXiv:1612.03301) and present a deterministic scheme that, for a prescribed per-machine computational effort, recovers the gradient from the least number of machines $f$ theoretically permissible, via an $O(f^2)$ decoding algorithm. We also provide a theoretical delay model which can be used to minimize the expected waiting time per computation by optimally choosing the parameters of the scheme. Finally, we supplement our theoretical findings with numerical results that demonstrate the efficacy of the method and its advantages over competing schemes.
A Large-Scale CNN Ensemble for Medication Safety Analysis
Venue: arXiv cs.IR 2017
Year: 2017

Revealing Adverse Drug Reactions (ADR) is an essential part of post-marketing drug surveillance, and data from health-related forums and medical communities can be of a great significance for estimating such effects. In this paper, we propose an end-to-end CNN-based method for predicting drug safety on user comments from healthcare discussion forums. We present an architecture that is based on a vast ensemble of CNNs with varied structural parameters, where the prediction is determined by the majority vote. To evaluate the performance of the proposed solution, we present a large-scale dataset collected from a medical website that consists of over 50 thousand reviews for more than 4000 drugs. The results demonstrate that our model significantly outperforms conventional approaches and predicts medicine safety with an accuracy of 87.17% for binary and 62.88% for multi-classification tasks.
Performance Bounds for Finite Moving Average Change Detection: Application to Global Navigation Satellite Systems
Venue: arXiv cs.IT 2017
Year: 2017

Due to the widespread deployment of Global Navigation Satellite Systems (GNSSs) for critical road or urban applications, one of the major challenges to be solved is the provision of integrity to terrestrial environments, so that GNSS may be safety used in these applications. To do so, the integrity of the received GNSS signal must be analyzed in order to detect some local effect disturbing the received signal. This is desirable because the presence of some local effect may cause large position errors, and hence compromise the signal integrity. Moreover, the detection of such disturbing effects must be done before some pre-established delay. This kind of detection lies within the field of transient change detection. In this work, a finite moving average stopping time is proposed in order to approach the signal integrity problem with a transient change detection framework. The statistical performance of this stopping time is investigated and compared, in the context of multipath detection, to other different methods available in the literature. Numerical results are presented in order to assess their performance.
Rethinking Atrous Convolution for Semantic Image Segmentation
Venue: arXiv cs.CV 2017
Year: 2017

In this work, we revisit atrous convolution, a powerful tool to explicitly adjust filter's field-of-view as well as control the resolution of feature responses computed by Deep Convolutional Neural Networks, in the application of semantic image segmentation. To handle the problem of segmenting objects at multiple scales, we design modules which employ atrous convolution in cascade or in parallel to capture multi-scale context by adopting multiple atrous rates. Furthermore, we propose to augment our previously proposed Atrous Spatial Pyramid Pooling module, which probes convolutional features at multiple scales, with image-level features encoding global context and further boost performance. We also elaborate on implementation details and share our experience on training our system. The proposed `DeepLabv3' system significantly improves over our previous DeepLab versions without DenseCRF post-processing and attains comparable performance with other state-of-art models on the PASCAL VOC 2012 semantic image segmentation benchmark.
Joint Scheduling and Transmission Power Control in Wireless Ad Hoc Networks
Venue: arXiv cs.NI 2017
Year: 2017

In this paper, we study how to determine concurrent transmissions and the transmission power level of each link to maximize spectrum efficiency and minimize energy consumption in a wireless ad hoc network. The optimal joint transmission packet scheduling and power control strategy are determined when the node density goes to infinity and the network area is unbounded. Based on the asymptotic analysis, we determine the fundamental capacity limits of a wireless network, subject to an energy consumption constraint. We propose a scheduling and transmission power control mechanism to approach the optimal solution to maximize spectrum and energy efficiencies in a practical network. The distributed implementation of the proposed scheduling and transmission power control scheme is presented based on our MAC framework proposed in [1]. Simulation results demonstrate that the proposed scheme achieves 40% higher throughput than existing schemes. Also, the energy consumption using the proposed scheme is about 20% of the energy consumed using existing power saving MAC protocols.
On Problems Dual to Unification
Venue: arXiv cs.LO 2017
Year: 2017

In this paper, we investigate a problem dual to the unification problem, namely the Common Term (CT) problem for string rewriting systems. Our main motivation was in computing fixed points in systems, such as loop invariants in programming languages. We show that the fixed point problem is reducible to the common term problem. We also prove that the common term problem is undecidable for dwindling string rewriting systems.
Learning Sparse Polymatrix Games in Polynomial Time and Sample Complexity
Venue: arXiv cs.LG 2017
Year: 2017

We consider the problem of learning sparse polymatrix games from observations of strategic interactions. We show that a polynomial time method based on $\ell_{1,2}$-group regularized logistic regression recovers a game, whose Nash equilibria are the $ε$-Nash equilibria of the game from which the data was generated (true game), in $\mathcal{O}(m^4 d^4 \log (pd))$ samples of strategy profiles --- where $m$ is the maximum number of pure strategies of a player, $p$ is the number of players, and $d$ is the maximum degree of the game graph. Under slightly more stringent separability conditions on the payoff matrices of the true game, we show that our method learns a game with the exact same Nash equilibria as the true game. We also show that $Ω(d \log (pm))$ samples are necessary for any method to consistently recover a game, with the same Nash-equilibria as the true game, from observations of strategic interactions. We verify our theoretical results through simulation experiments.
3D Convolutional Neural Networks for Cross Audio-Visual Matching Recognition
Venue: arXiv cs.CV 2017
Year: 2017

Audio-visual recognition (AVR) has been considered as a solution for speech recognition tasks when the audio is corrupted, as well as a visual recognition method used for speaker verification in multi-speaker scenarios. The approach of AVR systems is to leverage the extracted information from one modality to improve the recognition ability of the other modality by complementing the missing information. The essential problem is to find the correspondence between the audio and visual streams, which is the goal of this work. We propose the use of a coupled 3D Convolutional Neural Network (3D-CNN) architecture that can map both modalities into a representation space to evaluate the correspondence of audio-visual streams using the learned multimodal features. The proposed architecture will incorporate both spatial and temporal information jointly to effectively find the correlation between temporal information for different modalities. By using a relatively small network architecture and much smaller dataset for training, our proposed method surpasses the performance of the existing similar methods for audio-visual matching which use 3D CNNs for feature representation. We also demonstrate that an effective pair selection method can significantly increase the performance. The proposed method achieves relative improvements over 20% on the Equal Error Rate (EER) and over 7% on the Average Precision (AP) in comparison to the state-of-the-art method.
Histograms of Gaussian normal distribution for feature matching in clutter scenes
Venue: arXiv cs.CV 2017
Year: 2017

3D feature descriptor provide information between corresponding models and scenes. 3D objection recognition in cluttered scenes, however, remains a largely unsolved problem. Practical applications impose several challenges which are not fully addressed by existing methods. Especially in cluttered scenes there are many feature mismatches between scenes and models. We therefore propose Histograms of Gaussian Normal Distribution (HGND) for extracting salient features on a local reference frame (LRF) that enables us to solve this problem. We propose a LRF on each local surface patches using the scatter matrix's eigenvectors. Then the HGND information of each salient point is calculated on the LRF, for which we use both the mesh and point data of the depth image. Experiments on 45 cluttered scenes of the Bologna Dataset and 50 cluttered scenes of the UWA Dataset are made to evaluate the robustness and descriptiveness of our HGND. Experiments carried out by us demonstrate that HGND obtains a more reliable matching rate than state-of-the-art approaches in cluttered situations.
Fusing restricted information
Venue: arXiv cs.CR 2017
Year: 2017

Information fusion deals with the integration and merging of data and information from multiple (heterogeneous) sources. In many cases, the information that needs to be fused has security classification. The result of the fusion process is then by necessity restricted with the strictest information security classification of the inputs. This has severe drawbacks and limits the possible dissemination of the fusion results. It leads to decreased situational awareness: the organization knows information that would enable a better situation picture, but since parts of the information is restricted, it is not possible to distribute the most correct situational information. In this paper, we take steps towards defining fusion and data mining processes that can be used even when all the underlying data that was used cannot be disseminated. The method we propose here could be used to produce a classifier where all the sensitive information has been removed and where it can be shown that an antagonist cannot even in principle obtain knowledge about the classified information by using the classifier or situation picture.
Leveraging web resources for keyword assignment to short text documents
Venue: arXiv cs.IR 2017
Year: 2017

Assigning relevant keywords to documents is very important for efficient retrieval, clustering and management of the documents. Especially with the web corpus deluged with digital documents, automation of this task is of prime importance. Keyword assignment is a broad topic of research which refers to tagging of document with keywords, key-phrases or topics. For text documents, the keyword assignment techniques have been developed under two sub-topics: automatic keyword extraction (AKE) and automatic key-phrase abstraction. However, the approaches developed in the literature for full text documents cannot be used to assign keywords to low text content documents like twitter feeds, news clips, product reviews or even short scholarly text. In this work, we point out several practical challenges encountered in tagging such low text content documents. As a solution to these challenges, we show that the proposed approaches which leverage knowledge from several open source web resources enhance the quality of the tags (keywords) assigned to the low text content documents. The performance of the proposed approach is tested on real world corpus consisting of scholarly documents with text content ranging from only the text in the title of the document (5-10 words) to the summary text/abstract (100- 150 words). We find that the proposed approach not just improves the accuracy of keyword assignment but offer a computationally efficient solution which can be used in real world applications.
Faster Algorithms for Mean-Payoff Parity Games
Venue: arXiv cs.GT 2017
Year: 2017

Graph games provide the foundation for modeling and synthesis of reactive processes. Such games are played over graphs where the vertices are controlled by two adversarial players. We consider graph games where the objective of the first player is the conjunction of a qualitative objective (specified as a parity condition) and a quantitative objective (specified as a mean-payoff condition). There are two variants of the problem, namely, the threshold problem where the quantitative goal is to ensure that the mean-payoff value is above a threshold, and the value problem where the quantitative goal is to ensure the optimal mean-payoff value; in both cases ensuring the qualitative parity objective. The previous best-known algorithms for game graphs with $n$ vertices, $m$ edges, parity objectives with $d$ priorities, and maximal absolute reward value $W$ for mean-payoff objectives, are as follows: $O(n^{d+1} \cdot m \cdot W)$ for the threshold problem, and $O(n^{d+2} \cdot m \cdot W)$ for the value problem. Our main contributions are faster algorithms, and the running times of our algorithms are as follows: $O(n^{d-1} \cdot m \cdot W)$ for the threshold problem, and $O(n^{d} \cdot m \cdot W \cdot \log (n\cdot W))$ for the value problem. For mean-payoff parity objectives with two priorities, our algorithms match the best-known bounds of the algorithms for mean-payoff games (without conjunction with parity objectives). Our results are relevant in synthesis of reactive systems with both functional requirement (given as a qualitative objective) and performance requirement (given as a quantitative objective).
User Intent Classification using Memory Networks: A Comparative Analysis for a Limited Data Scenario
Venue: arXiv cs.AI 2017
Year: 2017

In this report, we provide a comparative analysis of different techniques for user intent classification towards the task of app recommendation. We analyse the performance of different models and architectures for multi-label classification over a dataset with a relative large number of classes and only a handful examples of each class. We focus, in particular, on memory network architectures, and compare how well the different versions perform under the task constraints. Since the classifier is meant to serve as a module in a practical dialog system, it needs to be able to work with limited training data and incorporate new data on the fly. We devise a 1-shot learning task to test the models under the above constraint. We conclude that relatively simple versions of memory networks perform better than other approaches. Although, for tasks with very limited data, simple non-parametric methods perform comparably, without needing the extra training data.