OpenRaiser/Intern-Atlas huggingface dataset:
Infrared and Visible Image Fusion with ResNet and zero-phase component analysis
Venue: arXiv cs.CV 2019
Year: 2019

Feature extraction and processing tasks play a key role in Image Fusion, and the fusion performance is directly affected by the different features and processing methods undertaken. By contrast, most of deep learning-based methods use deep features directly without feature extraction or processing. This leads to the fusion performance degradation in some cases. To solve these drawbacks, we propose a deep features and zero-phase component analysis (ZCA) based novel fusion framework is this paper. Firstly, the residual network (ResNet) is used to extract deep features from source images. Then ZCA is utilized to normalize the deep features and obtain initial weight maps. The final weight maps are obtained by employing a soft-max operation in association with the initial weight maps. Finally, the fused image is reconstructed using a weighted-averaging strategy. Compared with the existing fusion methods, experimental results demonstrate that the proposed framework achieves better performance in both objective assessment and visual quality. The code of our fusion algorithm is available at https://github.com/hli1221/imagefusion_resnet50
Index Modulation for Molecular Communication via Diffusion Systems
Venue: arXiv cs.ET 2019
Year: 2019

Molecular communication via diffusion (MCvD) is a molecular communication method that utilizes the free diffusion of carrier molecules to transfer information at the nano-scale. Due to the random propagation of carrier molecules, inter-symbol interference (ISI) is a major issue in an MCvD system. Alongside ISI, inter-link interference (ILI) is also an issue that increases the total interference for MCvD-based multiple-input-multiple-output (MIMO) approaches. Inspired by the antenna index modulation (IM) concept in traditional communication systems, this paper introduces novel IM-based transmission schemes for MCvD systems. In the paper, molecular space shift keying (MSSK) is proposed as a novel modulation for molecular MIMO systems, and it is found that this method combats ISI and ILI considerably better than existing MIMO approaches. For nano-machines that have access to two different molecules, the direct extension of MSSK, quadrature molecular space shift keying (QMSSK) is also proposed. QMSSK is found to combat ISI considerably well whilst not performing well against ILI-caused errors. In order to combat ILI more effectively, another dual-molecule-based novel modulation scheme called the molecular spatial modulation (MSM) is proposed. Combined with the Gray mapping imposed on the antenna indices, MSM is observed to yield reliable error rates for molecular MIMO systems.
Modeling Word Emotion in Historical Language: Quantity Beats Supposed Stability in Seed Word Selection
Venue: arXiv cs.CL 2019
Year: 2019

To understand historical texts, we must be aware that language -- including the emotional connotation attached to words -- changes over time. In this paper, we aim at estimating the emotion which is associated with a given word in former language stages of English and German. Emotion is represented following the popular Valence-Arousal-Dominance (VAD) annotation scheme. While being more expressive than polarity alone, existing word emotion induction methods are typically not suited for addressing it. To overcome this limitation, we present adaptations of two popular algorithms to VAD. To measure their effectiveness in diachronic settings, we present the first gold standard for historical word emotions, which was created by scholars with proficiency in the respective language stages and covers both English and German. In contrast to claims in previous work, our findings indicate that hand-selecting small sets of seed words with supposedly stable emotional meaning is actually harmful rather than helpful.
Shortest Reconfiguration Sequence for Sliding Tokens on Spiders
Venue: arXiv cs.DS 2019
Year: 2019

Suppose that two independent sets $I$ and $J$ of a graph with $\vert I \vert = \vert J \vert$ are given, and a token is placed on each vertex in $I$. The Sliding Token problem is to determine whether there exists a sequence of independent sets which transforms $I$ into $J$ so that each independent set in the sequence results from the previous one by sliding exactly one token along an edge in the graph. It is one of the representative reconfiguration problems that attract the attention from the viewpoint of theoretical computer science. For a yes-instance of a reconfiguration problem, finding a shortest reconfiguration sequence has a different aspect. In general, even if it is polynomial time solvable to decide whether two instances are reconfigured with each other, it can be $\mathsf{NP}$-hard to find a shortest sequence between them. In this paper, we show that the problem for finding a shortest sequence between two independent sets is polynomial time solvable for spiders (i.e., trees having exactly one vertex of degree at least three).
Spotlight: Scalable Transport Layer Load Balancing for Data Center Networks
Venue: arXiv cs.NI 2019
Year: 2019

Load Balancing plays a vital role in modern data centers to distribute traffic among instances of network functions or services. State-of-the-art load balancers such as Silkroad dispatch traffic obliviously without considering the real-time utilization of service instances and therefore can lead to uneven load distribution and suboptimal performance. In this paper, we design and implement Spotlight, a scalable and distributed load balancing architecture that maintains connection-to-instance mapping consistency at the edge of data center networks. Spotlight uses a new stateful flow dispatcher which periodically polls instances' load and dispatches incoming connections to instances in proportion to their available capacity. Our design utilizes distributed control plane and in-band flow dispatching and thus scales horizontally in data center networks. Through extensive flow-level simulation and packet-level experiments on a testbed, we demonstrate that compared to existing methods Spotlight distributes the traffic more efficiently and has near-optimum performance in terms of overall service utilization. Moreover, Spotlight is not sensitive to utilization polling interval and therefore can be implemented with low polling frequency to reduce the amount of control traffic. Indeed, Spotlight achieves the mentioned performance improvements using O(100ms) polling interval.
Verifying MITL formulae on Timed Automata considering a Continuous Time Semantics
Venue: arXiv cs.LO 2019
Year: 2019

Timed Automata (TA) is de facto a standard modelling formalism to represent systems when the interest is the analysis of their behaviour as time progresses. This modelling formalism is mostly used for checking whether the behaviours of a system satisfy a set of properties of interest. Even if efficient model-checkers for Timed Automata exist, these tools are not easily configurable. First, they are not designed to easily allow adding new Timed Automata constructs, such as new synchronization mechanisms or communication procedures, but they assume a fixed set of Timed Automata constructs. Second, they usually do not support the full Metric Interval Temporal Logic (MITL) and rely on a precise semantics for the logic in which the property of interest is specified which cannot be easily modified and customized. Finally, they do not easily allow using different solvers that may speed up verification in different contexts. This paper presents a novel technique to perform model checking of full Metric Interval Temporal Logic (MITL) properties on TA. The technique relies on the translation of both the TA and the MITL formula into an intermediate Constraint LTL over clocks (CLTLoc) formula which is verified through an available decision procedure. The technique is flexible since the intermediate logic allows the encoding of new semantics as well as new TA constructs, by just adding new CLTLoc formulae. Furthermore, our technique is not bound to a specific solver as the intermediate CLTLoc formula can be verified using different procedures.
VUNet: Dynamic Scene View Synthesis for Traversability Estimation using an RGB Camera
Venue: arXiv cs.CV 2019
Year: 2019

We present VUNet, a novel view(VU) synthesis method for mobile robots in dynamic environments, and its application to the estimation of future traversability. Our method predicts future images for given virtual robot velocity commands using only RGB images at previous and current time steps. The future images result from applying two types of image changes to the previous and current images: 1) changes caused by different camera pose, and 2) changes due to the motion of the dynamic obstacles. We learn to predict these two types of changes disjointly using two novel network architectures, SNet and DNet. We combine SNet and DNet to synthesize future images that we pass to our previously presented method GONet to estimate the traversable areas around the robot. Our quantitative and qualitative evaluation indicate that our approach for view synthesis predicts accurate future images in both static and dynamic environments. We also show that these virtual images can be used to estimate future traversability correctly. We apply our view synthesis-based traversability estimation method to two applications for assisted teleoperation.
Technical Report on Optimal Link Scheduling in Millimeter Wave Multi-hop Networks with Space Division Multiple Access and Multiplexing
Venue: arXiv cs.IT 2019
Year: 2019

In this paper we study the maximum throughput achievable with optimal scheduling in multi-hop networks with highly directive antenna arrays capable of Space Division Multiplexing (SDM) at the transmitter and Space Division Multiple Access (SDMA) at the receiver. This network model is relevant for future millimeter wave (mmWave) systems, which are expected to implement self-backhauled cellular networks with very high data rates, relying on carrier frequencies between 10-300 GHz, channels with a very large bandwidth, and a large number of antenna elements, even in mobile devices. We adapt mmWave channel propagation, antenna array and link rate models to the classic throughput-optimality and Network Utility Maximization (NUM) scheduling framework for multi-hop networks. Directional antenna gains, transmission towards multiple destinations at once, and simultaneous reception of signals from multiple sources, are all new characteristics not featured in the existing NUM literature. We verify that the classic NUM convergence lemmas are still valid under this new set of constraints, and discuss a series of algorithms to achieve or approximate the performance of the optimal Maximum Back Pressure (MBP) solution. Finally, our analysis serves as an estimation of the potential improvement in cellular network throughput capacity due to the integration of SDM/SDMA techniques and multi-hop.
Optimizing Lossy Compression Rate-Distortion from Automatic Online Selection between SZ and ZFP
Venue: arXiv cs.DC 2019
Year: 2019

With ever-increasing volumes of scientific data produced by HPC applications, significantly reducing data size is critical because of limited capacity of storage space and potential bottlenecks on I/O or networks in writing/reading or transferring data. SZ and ZFP are the two leading lossy compressors available to compress scientific data sets. However, their performance is not consistent across different data sets and across different fields of some data sets: for some fields SZ provides better compression performance, while other fields are better compressed with ZFP. This situation raises the need for an automatic online (during compression) selection between SZ and ZFP, with a minimal overhead. In this paper, the automatic selection optimizes the rate-distortion, an important statistical quality metric based on the signal-to-noise ratio. To optimize for rate-distortion, we investigate the principles of SZ and ZFP. We then propose an efficient online, low-overhead selection algorithm that predicts the compression quality accurately for two compressors in early processing stages and selects the best-fit compressor for each data field. We implement the selection algorithm into an open-source library, and we evaluate the effectiveness of our proposed solution against plain SZ and ZFP in a parallel environment with 1,024 cores. Evaluation results on three data sets representing about 100 fields show that our selection algorithm improves the compression ratio up to 70% with the same level of data distortion because of very accurate selection (around 99%) of the best-fit compressor, with little overhead (less than 7% in the experiments).
Transmission Energy Minimization for Heterogeneous Low-Latency NOMA Downlink
Venue: arXiv cs.IT 2019
Year: 2019

This paper investigates the transmission energy minimization problem for the two-user downlink with strictly heterogeneous latency constraints. To cope with the latency constraints and to explicitly specify the trade-off between blocklength (latency) and reliability the normal approximation of the capacity of finite blocklength codes (FBCs) is adopted, in contrast to the classical Shannon capacity formula. We first consider the non-orthogonal multiple access (NOMA) based transmission scheme. However, due to heterogeneous latency constraints and channel conditions at receivers, the conventional successive interference cancellation may be infeasible. We thus study the problem by considering heterogeneous receiver conditions under different interference mitigation schemes and solve the corresponding NOMA design problems. It is shown that, though the energy function is not convex and does not have closed form expression, the studied NOMA problems can be globally solved semi-analytically and with low complexity. Moreover, we propose a hybrid transmission scheme that combines the time division multiple access (TDMA) and NOMA. Specifically, the hybrid scheme can judiciously perform bit and time allocation and take TDMA and NOMA as two special instances. To handle the more challenging hybrid design problem, we propose a concave approximation of the FBC rate/capacity formula, by which we obtain computationally efficient and high-quality solutions. Simulation results show that the hybrid scheme can achieve considerable transmission energy saving compared with both pure NOMA and TDMA schemes.
Millimeter-Wave Massive MIMO Systems Relying on Generalized Sub-Array-Connected Hybrid Precoding
Venue: arXiv cs.IT 2019
Year: 2019

In this paper, we consider a generalized sub-array-connected (GSAC) architecture for arbitrary radio frequency (RF) chain and antenna configurations, where the number of RF chains connected to a sub-array and the number of antennas in each sub-array can be arbitrary. Our design objective is to improve the energy-efficiency of the hybrid precoder of millimeter-wave massive multiple input multiple output (MIMO) systems. We firstly propose a successive interference cancellation based hybrid precoding algorithm to maximize the achievable rate for any given RF chain and antenna configuration. This algorithm firstly decomposes the total achievable rate optimization problem into multiple sub-rate optimization problems, then it successively maximizes these sub-rates. Since the number of RF chains is limited, we can afford using an exhaustive search scheme to evaluate all configurations and identify the one having the best energy efficiency. Moreover, to rely on an attractive limited feedback, we also propose a beamsteering codebook for our hybrid precoding aided GSAC architecture. Our simulation results demonstrate that the proposed scheme achieves a similar rate as the corresponding optimal unconstrained precoder. Furthermore, we show that the energy-efficiency of the proposed scheme is better than that of the existing schemes in the fully-connected and sub-array-connected architectures.
Reliable Transmission of Short Packets through Queues and Noisy Channels under Latency and Peak-Age Violation Guarantees
Venue: arXiv cs.IT 2019
Year: 2019

This work investigates the probability that the delay and the peak-age of information exceed a desired threshold in a point-to-point communication system with short information packets. The packets are generated according to a stationary memoryless Bernoulli process, placed in a single-server queue and then transmitted over a wireless channel. A variable-length stop-feedback coding scheme---a general strategy that encompasses simple automatic repetition request (ARQ) and more sophisticated hybrid ARQ techniques as special cases---is used by the transmitter to convey the information packets to the receiver. By leveraging finite-blocklength results, the delay violation and the peak-age violation probabilities are characterized without resorting to approximations based on large-deviation theory as in previous literature. Numerical results illuminate the dependence of delay and peak-age violation probability on system parameters such as the frame size and the undetected error probability, and on the chosen packet-management policy. The guidelines provided by our analysis are particularly useful for the design of low-latency ultra-reliable communication systems.
A Multi-View Ensemble Classification Model for Clinically Actionable Genetic Mutations
Venue: arXiv cs.LG 2019
Year: 2019

This paper presents details of our winning solutions to the task IV of NIPS 2017 Competition Track entitled Classifying Clinically Actionable Genetic Mutations. The machine learning task aims to classify genetic mutations based on text evidence from clinical literature with promising performance. We develop a novel multi-view machine learning framework with ensemble classification models to solve the problem. During the Challenge, feature combinations derived from three views including document view, entity text view, and entity name view, which complements each other, are comprehensively explored. As the final solution, we submitted an ensemble of nine basic gradient boosting models which shows the best performance in the evaluation. The approach scores 0.5506 and 0.6694 in terms of logarithmic loss on a fixed split in stage-1 testing phase and 5-fold cross validation respectively, which also makes us ranked as a top-1 team out of more than 1,300 solutions in NIPS 2017 Competition Track IV.
Understanding Dropout as an Optimization Trick
Venue: arXiv cs.LG 2019
Year: 2019

As one of standard approaches to train deep neural networks, dropout has been applied to regularize large models to avoid overfitting, and the improvement in performance by dropout has been explained as avoiding co-adaptation between nodes. However, when correlations between nodes are compared after training the networks with or without dropout, one question arises if co-adaptation avoidance explains the dropout effect completely. In this paper, we propose an additional explanation of why dropout works and propose a new technique to design better activation functions. First, we show that dropout can be explained as an optimization technique to push the input towards the saturation area of nonlinear activation function by accelerating gradient information flowing even in the saturation area in backpropagation. Based on this explanation, we propose a new technique for activation functions, {\em gradient acceleration in activation function (GAAF)}, that accelerates gradients to flow even in the saturation area. Then, input to the activation function can climb onto the saturation area which makes the network more robust because the model converges on a flat region. Experiment results support our explanation of dropout and confirm that the proposed GAAF technique improves image classification performance with expected properties.
Compact Drawings of 1-Planar Graphs with Right-Angle Crossings and Few Bends
Venue: arXiv cs.CG 2019
Year: 2019

We study the following classes of beyond-planar graphs: 1-planar, IC-planar, and NIC-planar graphs. These are the graphs that admit a 1-planar, IC-planar, and NIC-planar drawing, respectively. A drawing of a graph is 1-planar if every edge is crossed at most once. A 1-planar drawing is IC-planar if no two pairs of crossing edges share a vertex. A 1-planar drawing is NIC-planar if no two pairs of crossing edges share two vertices. We study the relations of these beyond-planar graph classes (beyond-planar graphs is a collective term for the primary attempts to generalize the planar graphs) to right-angle crossing (RAC) graphs that admit compact drawings on the grid with few bends. We present four drawing algorithms that preserve the given embeddings. First, we show that every $n$-vertex NIC-planar graph admits a NIC-planar RAC drawing with at most one bend per edge on a grid of size $O(n) \times O(n)$. Then, we show that every $n$-vertex 1-planar graph admits a 1-planar RAC drawing with at most two bends per edge on a grid of size $O(n^3) \times O(n^3)$. Finally, we make two known algorithms embedding-preserving; for drawing 1-planar RAC graphs with at most one bend per edge and for drawing IC-planar RAC graphs straight-line.
Clustering Complex Zeros of Triangular Systems of Polynomials
Venue: arXiv cs.CG 2019
Year: 2019

This paper gives the first algorithm for finding a set of natural $ε$-clusters of complex zeros of a triangular system of polynomials within a given polybox in $\mathbb{C}^n$, for any given $ε>0$. Our algorithm is based on a recent near-optimal algorithm of Becker et al (2016) for clustering the complex roots of a univariate polynomial where the coefficients are represented by number oracles. Our algorithm is numeric, certified and based on subdivision. We implemented it and compared it with two well-known homotopy solvers on various triangular systems. Our solver always gives correct answers, is often faster than the homotopy solver that often gives correct answers, and sometimes faster than the one that gives sometimes correct results.
Modular meta-learning
Venue: arXiv cs.LG 2019
Year: 2019

Many prediction problems, such as those that arise in the context of robotics, have a simplifying underlying structure that, if known, could accelerate learning. In this paper, we present a strategy for learning a set of neural network modules that can be combined in different ways. We train different modular structures on a set of related tasks and generalize to new tasks by composing the learned modules in new ways. By reusing modules to generalize we achieve combinatorial generalization, akin to the "infinite use of finite means" displayed in language. Finally, we show this improves performance in two robotics-related problems.