OpenRaiser/Intern-Atlas huggingface dataset:
A modified bond model for describing isotropic linear elastic material behaviour with the particle method
Venue: arXiv cs.CE 2020
Year: 2020

Particle based methods such as the Discrete Element Method and the Lattice Spring Method may be used for describing the behaviour of isotropic linear elastic materials. However, the common bond models employed to describe the interaction between particles restrict the range of Poisson's ratio that can be represented. In this paper, to overcome the restriction, a modified bond model that includes the coupling of shear strain energy of neighbouring bonds is proposed. The coupling is described by a multi-bond term that enables the model to distinguish between shear deformations and rigid-body rotations. The positive definiteness of the strain energy function of the modified bond model is verified. To validate the model, uniaxial tension, pure shear, pure bending and cantilever bending tests are performed. Comparison of the particle displacements with continuum mechanics solution demonstrates the ability of the model to describe the behaviour of isotropic linear elastic material for values of Poisson's ratio in the range $0 \leq ν< 0.5$.
Learn to Bind and Grow Neural Structures
Venue: arXiv cs.LG 2020
Year: 2020

Task-incremental learning involves the challenging problem of learning new tasks continually, without forgetting past knowledge. Many approaches address the problem by expanding the structure of a shared neural network as tasks arrive, but struggle to grow optimally, without losing past knowledge. We present a new framework, Learn to Bind and Grow, which learns a neural architecture for a new task incrementally, either by binding with layers of a similar task or by expanding layers which are more likely to conflict between tasks. Central to our approach is a novel, interpretable, parameterization of the shared, multi-task architecture space, which then enables computing globally optimal architectures using Bayesian optimization. Experiments on continual learning benchmarks show that our framework performs comparably with earlier expansion based approaches and is able to flexibly compute multiple optimal solutions with performance-size trade-offs.
Adversarial Training for EM Classification Networks
Venue: arXiv cs.LG 2020
Year: 2020

We present a novel variant of Domain Adversarial Networks with impactful improvements to the loss functions, training paradigm, and hyperparameter optimization. New loss functions are defined for both forks of the DANN network, the label predictor and domain classifier, in order to facilitate more rapid gradient descent, provide more seamless integration into modern neural networking frameworks, and allow previously unavailable inferences into network behavior. Using these loss functions, it is possible to extend the concept of 'domain' to include arbitrary user defined labels applicable to subsets of the training data, the test data, or both. As such, the network can be operated in either 'On the Fly' mode where features provided by the feature extractor indicative of differences between 'domain' labels in the training data are removed or in 'Test Collection Informed' mode where features indicative of difference between 'domain' labels in the combined training and test data are removed (without needing to know or provide test activity labels to the network). This work also draws heavily from previous works on Robust Training which draws training examples from a L_inf ball around the training data in order to remove fragile features induced by random fluctuations in the data. On these networks we explore the process of hyperparameter optimization for both the domain adversarial and robust hyperparameters. Finally, this network is applied to the construction of a binary classifier used to identify the presence of EM signal emitted by a turbopump. For this example, the effect of the robust and domain adversarial training is to remove features indicative of the difference in background between instances of operation of the device - providing highly discriminative features on which to construct the classifier.
Teaching Key Machine Learning Principles Using Anti-learning Datasets
Venue: arXiv cs.CY 2020
Year: 2020

Much of the teaching of machine learning focuses on iterative hill-climbing approaches and the use of local knowledge to gain information leading to local or global maxima. In this paper we advocate the teaching of alternative methods of generalising to the best possible solution, including a method called anti-learning. By using simple teaching methods, students can achieve a deeper understanding of the importance of validation on data excluded from the training process and that each problem requires its own methods to solve. We also exemplify the requirement to train a model using sufficient data by showing that different granularities of cross-validation can yield very different results.
A General Framework for Distributed Inference with Uncertain Models
Venue: arXiv cs.AI 2020
Year: 2020

This paper studies the problem of distributed classification with a network of heterogeneous agents. The agents seek to jointly identify the underlying target class that best describes a sequence of observations. The problem is first abstracted to a hypothesis-testing framework, where we assume that the agents seek to agree on the hypothesis (target class) that best matches the distribution of observations. Non-Bayesian social learning theory provides a framework that solves this problem in an efficient manner by allowing the agents to sequentially communicate and update their beliefs for each hypothesis over the network. Most existing approaches assume that agents have access to exact statistical models for each hypothesis. However, in many practical applications, agents learn the likelihood models based on limited data, which induces uncertainty in the likelihood function parameters. In this work, we build upon the concept of uncertain models to incorporate the agents' uncertainty in the likelihoods by identifying a broad set of parametric distribution that allows the agents' beliefs to converge to the same result as a centralized approach. Furthermore, we empirically explore extensions to non-parametric models to provide a generalized framework of uncertain models in non-Bayesian social learning.
Iterative Text-based Editing of Talking-heads Using Neural Retargeting
Venue: arXiv cs.CV 2020
Year: 2020

We present a text-based tool for editing talking-head video that enables an iterative editing workflow. On each iteration users can edit the wording of the speech, further refine mouth motions if necessary to reduce artifacts and manipulate non-verbal aspects of the performance by inserting mouth gestures (e.g. a smile) or changing the overall performance style (e.g. energetic, mumble). Our tool requires only 2-3 minutes of the target actor video and it synthesizes the video for each iteration in about 40 seconds, allowing users to quickly explore many editing possibilities as they iterate. Our approach is based on two key ideas. (1) We develop a fast phoneme search algorithm that can quickly identify phoneme-level subsequences of the source repository video that best match a desired edit. This enables our fast iteration loop. (2) We leverage a large repository of video of a source actor and develop a new self-supervised neural retargeting technique for transferring the mouth motions of the source actor to the target actor. This allows us to work with relatively short target actor videos, making our approach applicable in many real-world editing scenarios. Finally, our refinement and performance controls give users the ability to further fine-tune the synthesized results.
Measuring Quadrangle Formation in Complex Networks
Venue: arXiv cs.SI 2020
Year: 2020

The classic clustering coefficient and the lately proposed closure coefficient quantify the formation of triangles from two different perspectives, with the focal node at the centre or at the end in an open triad respectively. As many networks are naturally rich in triangles, they become standard metrics to describe and analyse networks. However, the advantages of applying them can be limited in networks, where there are relatively few triangles but which are rich in quadrangles, such as the protein-protein interaction networks, the neural networks and the food webs. This yields for other approaches that would leverage quadrangles in our journey to better understand local structures and their meaning in different types of networks. Here we propose two quadrangle coefficients, i.e., the i-quad coefficient and the o-quad coefficient, to quantify quadrangle formation in networks, and we further extend them to weighted networks. Through experiments on 16 networks from six different domains, we first reveal the density distribution of the two quadrangle coefficients, and then analyse their correlations with node degree. Finally, we demonstrate that at network-level, adding the average i-quad coefficient and the average o-quad coefficient leads to significant improvement in network classification, while at node-level, the i-quad and o-quad coefficients are useful features to improve link prediction.
MoNet: Motion-based Point Cloud Prediction Network
Venue: arXiv cs.CV 2020
Year: 2020

Predicting the future can significantly improve the safety of intelligent vehicles, which is a key component in autonomous driving. 3D point clouds accurately model 3D information of surrounding environment and are crucial for intelligent vehicles to perceive the scene. Therefore, prediction of 3D point clouds has great significance for intelligent vehicles, which can be utilized for numerous further applications. However, due to point clouds are unordered and unstructured, point cloud prediction is challenging and has not been deeply explored in current literature. In this paper, we propose a novel motion-based neural network named MoNet. The key idea of the proposed MoNet is to integrate motion features between two consecutive point clouds into the prediction pipeline. The introduction of motion features enables the model to more accurately capture the variations of motion information across frames and thus make better predictions for future motion. In addition, content features are introduced to model the spatial content of individual point clouds. A recurrent neural network named MotionRNN is proposed to capture the temporal correlations of both features. Besides, we propose an attention-based motion align module to address the problem of missing motion features in the inference pipeline. Extensive experiments on two large scale outdoor LiDAR datasets demonstrate the performance of the proposed MoNet. Moreover, we perform experiments on applications using the predicted point clouds and the results indicate the great application potential of the proposed method.
Detecting Fake News Spreaders in Social Networks using Inductive Representation Learning
Venue: arXiv cs.SI 2020
Year: 2020

An important aspect of preventing fake news dissemination is to proactively detect the likelihood of its spreading. Research in the domain of fake news spreader detection has not been explored much from a network analysis perspective. In this paper, we propose a graph neural network based approach to identify nodes that are likely to become spreaders of false information. Using the community health assessment model and interpersonal trust we propose an inductive representation learning framework to predict nodes of densely-connected community structures that are most likely to spread fake news, thus making the entire community vulnerable to the infection. Using topology and interaction based trust properties of nodes in real-world Twitter networks, we are able to predict false information spreaders with an accuracy of over 90%.
On-Chip Error-triggered Learning of Multi-layer Memristive Spiking Neural Networks
Venue: arXiv cs.NE 2020
Year: 2020

Recent breakthroughs in neuromorphic computing show that local forms of gradient descent learning are compatible with Spiking Neural Networks (SNNs) and synaptic plasticity. Although SNNs can be scalably implemented using neuromorphic VLSI, an architecture that can learn using gradient-descent in situ is still missing. In this paper, we propose a local, gradient-based, error-triggered learning algorithm with online ternary weight updates. The proposed algorithm enables online training of multi-layer SNNs with memristive neuromorphic hardware showing a small loss in the performance compared with the state of the art. We also propose a hardware architecture based on memristive crossbar arrays to perform the required vector-matrix multiplications. The necessary peripheral circuitry including pre-synaptic, post-synaptic and write circuits required for online training, have been designed in the sub-threshold regime for power saving with a standard 180 nm CMOS process.
Optimal Transaction Queue Waiting in Blockchain Mining
Venue: arXiv cs.PF 2020
Year: 2020

Blockchain systems are being used in a wide range of application domains. They can support trusted transactions in time critical applications. In this paper, we study how miners should pick up transactions from a transaction pool so as to minimize the average waiting time per transaction. We derive an expression for the average transaction waiting time of the proposed mining scheme and determine the optimum decision rule. Numerical results show that the average waiting time per transaction can be reduced by about 10% compared to the traditional no-wait scheme in which miners immediately start the next mining round using all transactions waiting in the pool.
Rank-smoothed Pairwise Learning In Perceptual Quality Assessment
Venue: arXiv cs.CV 2020
Year: 2020

Conducting pairwise comparisons is a widely used approach in curating human perceptual preference data. Typically raters are instructed to make their choices according to a specific set of rules that address certain dimensions of image quality and aesthetics. The outcome of this process is a dataset of sampled image pairs with their associated empirical preference probabilities. Training a model on these pairwise preferences is a common deep learning approach. However, optimizing by gradient descent through mini-batch learning means that the "global" ranking of the images is not explicitly taken into account. In other words, each step of the gradient descent relies only on a limited number of pairwise comparisons. In this work, we demonstrate that regularizing the pairwise empirical probabilities with aggregated rankwise probabilities leads to a more reliable training loss. We show that training a deep image quality assessment model with our rank-smoothed loss consistently improves the accuracy of predicting human preferences.
A Bayesian Account of Measures of Interpretability in Human-AI Interaction
Venue: arXiv cs.AI 2020
Year: 2020

Existing approaches for the design of interpretable agent behavior consider different measures of interpretability in isolation. In this paper we posit that, in the design and deployment of human-aware agents in the real world, notions of interpretability are just some among many considerations; and the techniques developed in isolation lack two key properties to be useful when considered together: they need to be able to 1) deal with their mutually competing properties; and 2) an open world where the human is not just there to interpret behavior in one specific form. To this end, we consider three well-known instances of interpretable behavior studied in existing literature -- namely, explicability, legibility, and predictability -- and propose a revised model where all these behaviors can be meaningfully modeled together. We will highlight interesting consequences of this unified model and motivate, through results of a user study, why this revision is necessary.
Online Maximum $k$-Interval Coverage Problem
Venue: arXiv cs.DS 2020
Year: 2020

We study the online maximum coverage problem on a line, in which, given an online sequence of sub-intervals (which may intersect among each other) of a target large interval and an integer $k$, we aim to select at most $k$ of the sub-intervals such that the total covered length of the target interval is maximized. The decision to accept or reject each sub-interval is made immediately and irrevocably (no preemption) right at the release timestamp of the sub-interval. We comprehensively study different settings of this problem regarding both the length of a released sub-interval and the total number of released sub-intervals. We first present lower bounds on the competitive ratio for the settings concerned in this paper, respectively. For the offline problem where the sequence of all the released sub-intervals is known in advance to the decision-maker, we propose a dynamic-programming-based optimal approach as the benchmark. For the online problem, we first propose a single-threshold-based deterministic algorithm SOA by adding a sub-interval if the added length exceeds a certain threshold, achieving competitive ratios close to the lower bounds, respectively. Then, we extend to a double-thresholds-based algorithm DOA, by using the first threshold for exploration and the second threshold (larger than the first one) for exploitation. With the two thresholds solved by our proposed program, we show that DOA improves SOA in the worst-case performance. Moreover, we prove that a deterministic algorithm that accepts sub-intervals by multi non-increasing thresholds cannot outperform even SOA.
Preimages of $p-$Linearized Polynomials over $\GF{p}$
Venue: arXiv cs.IT 2020
Year: 2020

Linearized polynomials over finite fields have been intensively studied over the last several decades. Interesting new applications of linearized polynomials to coding theory and finite geometry have been also highlighted in recent years. Let $p$ be any prime. Recently, preimages of the $p-$linearized polynomials $\sum_{i=0}^{\frac kl-1} X^{p^{li}}$ and $\sum_{i=0}^{\frac kl-1} (-1)^i X^{p^{li}}$ were explicitly computed over $\GF{p^n}$ for any $n$. This paper extends that study to $p-$linearized polynomials over $\GF{p}$, i.e., polynomials of the shape $$L(X)=\sum_{i=0}^t α_i X^{p^i}, α_i\in\GF{p}.$$ Given a $k$ such that $L(X)$ divides $X-X^{p^k}$, the preimages of $L(X)$ can be explicitly computed over $\GF{p^n}$ for any $n$.
Stacked Graph Filter
Venue: arXiv cs.LG 2020
Year: 2020

We study Graph Convolutional Networks (GCN) from the graph signal processing viewpoint by addressing a difference between learning graph filters with fully connected weights versus trainable polynomial coefficients. We find that by stacking graph filters with learnable polynomial parameters, we can build a highly adaptive and robust vertex classification model. Our treatment here relaxes the low-frequency (or equivalently, high homophily) assumptions in existing vertex classification models, resulting a more ubiquitous solution in terms of spectral properties. Empirically, by using only one hyper-parameter setting, our model achieves strong results on most benchmark datasets across the frequency spectrum.
Algorithmic upper bounds for graph geodetic number
Venue: arXiv cs.DS 2020
Year: 2020

Graph theoretical problems based on shortest paths are at the core of research due to their theoretical importance and applicability. This paper deals with the geodetic number which is a global measure for simple connected graphs and it belongs to the path covering problems: what is the minimal-cardinality set of vertices, such that all shortest paths between its elements cover every vertex of the graph. Inspired by the exact 0-1 integer linear programming formalism from the recent literature, we propose a new methods to obtain upper bounds for the geodetic number in an algorithmic way. The efficiency of these algorithms are demonstrated on a collection of structurally different graphs.
Robust Unsupervised Small Area Change Detection from SAR Imagery Using Deep Learning
Venue: arXiv cs.CV 2020
Year: 2020

Small area change detection from synthetic aperture radar (SAR) is a highly challenging task. In this paper, a robust unsupervised approach is proposed for small area change detection from multi-temporal SAR images using deep learning. First, a multi-scale superpixel reconstruction method is developed to generate a difference image (DI), which can suppress the speckle noise effectively and enhance edges by exploiting local, spatially homogeneous information. Second, a two-stage centre-constrained fuzzy c-means clustering algorithm is proposed to divide the pixels of the DI into changed, unchanged and intermediate classes with a parallel clustering strategy. Image patches belonging to the first two classes are then constructed as pseudo-label training samples, and image patches of the intermediate class are treated as testing samples. Finally, a convolutional wavelet neural network (CWNN) is designed and trained to classify testing samples into changed or unchanged classes, coupled with a deep convolutional generative adversarial network (DCGAN) to increase the number of changed class within the pseudo-label training samples. Numerical experiments on four real SAR datasets demonstrate the validity and robustness of the proposed approach, achieving up to 99.61% accuracy for small area change detection.
Development of Rubrics for Capstone Project Courses: Perspectives from Teachers and Students
Venue: arXiv cs.CY 2020
Year: 2020

This study attempted to develop fair, relevant, and content-valid assessment tools for capstone project courses. Toward this goal, new rating instruments based on the concept of rubrics were proposed. To ensure that the new instruments were valid and fair, several meetings with faculty and students of the computing science departments (i.e., Computer Science and Information Technology) were successively conducted. Eight faculty members and 10 students participated in the study. The final versions of the instruments were completed after a series of careful deliberations with faculty and students. Faculty and students perceived the new instruments fairer than the previous ones. Since the final instruments will be deployed this semester, their strengths and weaknesses are not yet known at this time. Directions for future research are presented.
On Connectivity-Aware Distributed Mobility Models for Area Coverage in Drone Networks
Venue: arXiv cs.NI 2020
Year: 2020

Drone networks are becoming increasingly popular in recent years and they are being used in many applications such as area coverage, delivery systems, military operations, etc. Area coverage is a broad family of applications where a group of connected drones collaboratively visit the whole or parts of an area to fulfill a specific objective and is widely being researched. Accordingly, different mobility models have been designed to define the rules of movements of the participating drones. However, most of them do not consider the network connectivity which is crucial, plus many models lack the priorities and optimization strategies that are important for drone networks. Therefore within this study, three known connectivity-aware mobility models have been analyzed comparatively. Two non-connectivity-aware mobility models have further been implemented to catch the placebo effect if any. Per the detailed experiments on the mobility models, coverage rates, connectivity levels, and message traffic have been evaluated. The study shows that the Distributed Pheromone Repel (DPR) model provides a decent coverage performance, while the Connectivity-based model and the Connected Coverage model provide better connectivity and communication quality.