OpenRaiser/Intern-Atlas huggingface dataset:
Counterfactual harm
Venue: arXiv cs.AI 2022
Year: 2022

To act safely and ethically in the real world, agents must be able to reason about harm and avoid harmful actions. However, to date there is no statistical method for measuring harm and factoring it into algorithmic decisions. In this paper we propose the first formal definition of harm and benefit using causal models. We show that any factual definition of harm must violate basic intuitions in certain scenarios, and show that standard machine learning algorithms that cannot perform counterfactual reasoning are guaranteed to pursue harmful policies following distributional shifts. We use our definition of harm to devise a framework for harm-averse decision making using counterfactual objective functions. We demonstrate this framework on the problem of identifying optimal drug doses using a dose-response model learned from randomized control trial data. We find that the standard method of selecting doses using treatment effects results in unnecessarily harmful doses, while our counterfactual approach allows us to identify doses that are significantly less harmful without sacrificing efficacy.
MovieMat: Context-aware Movie Recommendation with Matrix Factorization by Matrix Fitting
Venue: arXiv cs.IR 2022
Year: 2022

Movie Recommender System is widely applied in commercial environments such as NetFlix and Tubi. Classic recommender models utilize technologies such as collaborative filtering, learning to rank, matrix factorization and deep learning models to achieve lower marketing expenses and higher revenues. However, audience of movies have different ratings of the same movie in different contexts. Important movie watching contexts include audience mood, location, weather, etc. Tobe able to take advantage of contextual information is of great benefit to recommender builders. However, popular techniques such as tensor factorization consumes an impractical amount of storage, which greatly reduces its feasibility in real world environment. In this paper, we take advantage of the MatMat framework, which factorizes matrices by matrix fitting to build a context-aware movie recommender system that is superior to classic matrix factorization and comparable in the fairness metric.
Proto-Quipper with dynamic lifting
Venue: arXiv cs.PL 2022
Year: 2022

Quipper is a functional programming language for quantum computing. Proto-Quipper is a family of languages aiming to provide a formal foundation for Quipper. In this paper, we extend Proto-Quipper-M with a construct called dynamic lifting, which is present in Quipper. By virtue of being a circuit description language, Proto-Quipper has two separate runtimes: circuit generation time and circuit execution time. Values that are known at circuit generation time are called parameters, and values that are known at circuit execution time are called states. Dynamic lifting is an operation that enables a state, such as the result of a measurement, to be lifted to a parameter, where it can influence the generation of the next portion of the circuit. As a result, dynamic lifting enables Proto-Quipper programs to interleave classical and quantum computation. We describe the syntax of a language we call Proto-Quipper-Dyn. Its type system uses a system of modalities to keep track of the use of dynamic lifting. We also provide an operational semantics, as well as an abstract categorical semantics for dynamic lifting based on enriched category theory. We prove that both the type system and the operational semantics are sound with respect to our categorical semantics. Finally, we give some examples of Proto-Quipper-Dyn programs that make essential use of dynamic lifting.
Dropout Inference with Non-Uniform Weight Scaling
Venue: arXiv cs.LG 2022
Year: 2022

Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from the original model. At test time, weight scaling and Monte Carlo approximation are two widely applied approaches to approximate the outputs. Both approaches work well practically when all submodels are low-bias complex learners. However, in this work, we demonstrate scenarios where some submodels behave closer to high-bias models and a non-uniform weight scaling is a better approximation for inference.
Treating Crowdsourcing as Examination: How to Score Tasks and Online Workers?
Venue: arXiv cs.HC 2022
Year: 2022

Crowdsourcing is an online outsourcing mode which can solve the current machine learning algorithm's urge need for massive labeled data. Requester posts tasks on crowdsourcing platforms, which employ online workers over the Internet to complete tasks, then aggregate and return results to requester. How to model the interaction between different types of workers and tasks is a hot spot. In this paper, we try to model workers as four types based on their ability: expert, normal worker, sloppy worker and spammer, and divide tasks into hard, medium and easy task according to their difficulty. We believe that even experts struggle with difficult tasks while sloppy workers can get easy tasks right, and spammers always give out wrong answers deliberately. So, good examination tasks should have moderate degree of difficulty and discriminability to score workers more objectively. Thus, we first score workers' ability mainly on the medium difficult tasks, then reducing the weight of answers from sloppy workers and modifying the answers from spammers when inferring the tasks' ground truth. A probability graph model is adopted to simulate the task execution process, and an iterative method is adopted to calculate and update the ground truth, the ability of workers and the difficulty of the task successively. We verify the rightness and effectiveness of our algorithm both in simulated and real crowdsourcing scenes.
Polynomial Time Algorithm for ARRIVAL on Tree-like Multigraphs
Venue: arXiv cs.GT 2022
Year: 2022

A rotor walk in a directed graph can be thought of as a deterministic version of a Markov Chain, where a pebble moves from vertex to vertex following a simple rule until a terminal vertex, or sink, is reached. The ARRIVAL problem, as defined by Dohrau and al., consists in determining which sink will be reached. While the walk itself can take an exponential number of steps, this problem belongs to the complexity class NP$\cap$co-NP without being known to be in P. Several variants have been studied where we add one or two players to the model, defining deterministic analogs of stochastic models (e.g., Markovian decision processes, Stochastic Games) with rotor-routing rules instead of random transitions. The corresponding decision problem address the existence of strategies for players that ensure some condition on the reached sink. These problems are known to be $NP$-complete for one player and $PSPACE$-complete for two players. In this work, we define a class of directed graphs, namely tree-like multigraphs, which are multigraphs having the global shape of an undirected tree. We prove that the different variants of the reachability problem with zero, one, or two players can be solved in linear time, while the number of steps of rotor walks can still be exponential. To achieve this, we define a notion of return flow, which counts the number of times the pebble will bounce back in subtrees of the graph.
Person Re-Identification
Venue: arXiv cs.CV 2022
Year: 2022

Person Re-Identification (Re-ID) is an important problem in computer vision-based surveillance applications, in which one aims to identify a person across different surveillance photographs taken from different cameras having varying orientations and field of views. Due to the increasing demand for intelligent video surveillance, Re-ID has gained significant interest in the computer vision community. In this work, we experiment on some existing Re-ID methods that obtain state of the art performance in some open benchmarks. We qualitatively and quantitaively analyse their performance on a provided dataset, and then propose methods to improve the results. This work was the report submitted for COL780 final project at IIT Delhi.
ELM: Embedding and Logit Margins for Long-Tail Learning
Venue: arXiv cs.LG 2022
Year: 2022

Long-tail learning is the problem of learning under skewed label distributions, which pose a challenge for standard learners. Several recent approaches for the problem have proposed enforcing a suitable margin in logit space. Such techniques are intuitive analogues of the guiding principle behind SVMs, and are equally applicable to linear models and neural models. However, when applied to neural models, such techniques do not explicitly control the geometry of the learned embeddings. This can be potentially sub-optimal, since embeddings for tail classes may be diffuse, resulting in poor generalization for these classes. We present Embedding and Logit Margins (ELM), a unified approach to enforce margins in logit space, and regularize the distribution of embeddings. This connects losses for long-tail learning to proposals in the literature on metric embedding, and contrastive learning. We theoretically show that minimising the proposed ELM objective helps reduce the generalisation gap. The ELM method is shown to perform well empirically, and results in tighter tail class embeddings.
Quantifying societal emotional resilience to natural disasters from geo-located social media content
Venue: arXiv cs.SI 2022
Year: 2022

Natural disasters can have devastating and long-lasting effects on a community's emotional well-being. These effects may be distributed unequally, affecting some communities more profoundly and possibly over longer time periods than others. Here, we analyze the effects of four major US hurricanes, namely, Irma, Harvey, Florence, and Dorian on the emotional well-being of the affected communities and regions. We show that a community's emotional response to a hurricane event can be measured from the content of social media that its population posted before, during, and after the hurricane. For each hurricane making landfall in the US, we observe a significant decrease in sentiment in the affected areas before and during the hurricane followed by a rapid return to pre-hurricane baseline, often within 1-2 weeks. However, some communities exhibit markedly different rates of decline and return to previous equilibrium levels. This points towards the possibility of measuring the emotional resilience of communities from the dynamics of their online emotional response.
Efficient Autonomous Navigation for Terrestrial Insect-Machine Hybrid Systems
Venue: arXiv cs.RO 2022
Year: 2022

While bio-inspired and biomimetic systems draw inspiration from living materials, biohybrid systems incorporate them with synthetic devices, allowing the exploitation of both organic and artificial advantages inside a single entity. In the challenging development of centimeter-scaled mobile robots serving unstructured territory navigations, biohybrid systems appear as a potential solution in the forms of terrestrial insect-machine hybrid systems, which are the fusion of living ambulatory insects and miniature electronic devices. Although their maneuver can be deliberately controlled via artificial electrical stimulation, these hybrid systems still inherit the insects' outstanding locomotory skills, orchestrated by a sophisticated central nervous system and various sensory organs, favoring their maneuvers in complex terrains. However, efficient autonomous navigation of these hybrid systems is challenging. The struggle to optimize the stimulation parameters for individual insects limits the reliability and accuracy of navigation control. This study overcomes this problem by implementing a feedback control system with an insight view of tunable navigation control for an insect-machine hybrid system based on a living darkling beetle. Via a thrust controller for acceleration and a proportional controller for turning, the system regulates the stimulation parameters based on the instantaneous status of the hybrid robot. While the system can provide an overall success rate of ~71% for path-following navigations, fine-tuning its control parameters could further improve the outcome's reliability and precision to up to ~94% success rate and ~1/2 body length accuracy, respectively. Such tunable performance of the feedback control system provides flexibility to navigation applications of insect-machine hybrid systems.
On the Convergence of Momentum-Based Algorithms for Federated Bilevel Optimization Problems
Venue: arXiv cs.LG 2022
Year: 2022

In this paper, we studied the federated bilevel optimization problem, which has widespread applications in machine learning. In particular, we developed two momentum-based algorithms for optimizing this kind of problem and established the convergence rate of our two algorithms, providing the sample and communication complexities. Importantly, to the best of our knowledge, our convergence rate is the first one achieving the linear speedup with respect to the number of devices for federated bilevel optimization algorithms. At last, our extensive experimental results confirm the effectiveness of our two algorithms.
Enhance Ambiguous Community Structure via Multi-strategy Community Related Link Prediction Method with Evolutionary Process
Venue: arXiv cs.SI 2022
Year: 2022

Most real-world networks suffer from incompleteness or incorrectness, which is an inherent attribute to real-world datasets. As a consequence, those downstream machine learning tasks in complex network like community detection methods may yield less satisfactory results, i.e., a proper preprocessing measure is required here. To address this issue, in this paper, we design a new community attribute based link prediction strategy HAP and propose a two-step community enhancement algorithm with automatic evolution process based on HAP. This paper aims at providing a community enhancement measure through adding links to clarify ambiguous community structures. The HAP method takes the neighbourhood uncertainty and Shannon entropy to identify boundary nodes, and establishes links by considering the nodes' community attributes and community size at the same time. The experimental results on twelve real-world datasets with ground truth community indicate that the proposed link prediction method outperforms other baseline methods and the enhancement of community follows the expected evolution process.
The Effect of Preferences in Abstract Argumentation Under a Claim-Centric View
Venue: arXiv cs.AI 2022
Year: 2022

In this paper, we study the effect of preferences in abstract argumentation under a claim-centric perspective. Recent work has revealed that semantical and computational properties can change when reasoning is performed on claim-level rather than on the argument-level, while under certain natural restrictions (arguments with the same claims have the same outgoing attacks) these properties are conserved. We now investigate these effects when, in addition, preferences have to be taken into account and consider four prominent reductions to handle preferences between arguments. As we shall see, these reductions give rise to different classes of claim-augmented argumentation frameworks, and behave differently in terms of semantic properties and computational complexity. This strengthens the view that the actual choice for handling preferences has to be taken with care.
Improving robustness of language models from a geometry-aware perspective
Venue: arXiv cs.CL 2022
Year: 2022

Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness. However, we observe that a too large number of search steps can hurt accuracy. We aim to obtain strong robustness efficiently using fewer steps. Through a toy experiment, we find that perturbing the clean data to the decision boundary but not crossing it does not degrade the test accuracy. Inspired by this, we propose friendly adversarial data augmentation (FADA) to generate friendly adversarial data. On top of FADA, we propose geometry-aware adversarial training (GAT) to perform adversarial training on friendly adversarial data so that we can save a large number of search steps. Comprehensive experiments across two widely used datasets and three pre-trained language models demonstrate that GAT can obtain stronger robustness via fewer steps. In addition, we provide extensive empirical results and in-depth analyses on robustness to facilitate future studies.
MMRotate: A Rotated Object Detection Benchmark using PyTorch
Venue: arXiv cs.CV 2022
Year: 2022

We present an open-source toolbox, named MMRotate, which provides a coherent algorithm framework of training, inferring, and evaluation for the popular rotated object detection algorithm based on deep learning. MMRotate implements 18 state-of-the-art algorithms and supports the three most frequently used angle definition methods. To facilitate future research and industrial applications of rotated object detection-related problems, we also provide a large number of trained models and detailed benchmarks to give insights into the performance of rotated object detection. MMRotate is publicly released at https://github.com/open-mmlab/mmrotate.
Poly-CAM: High resolution class activation map for convolutional neural networks
Venue: arXiv cs.CV 2022
Year: 2022

The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction. This is because those maps are either low-resolution as for CAM [Zhou et al., 2016], or smooth as for perturbation-based methods [Zeiler and Fergus, 2014], or do correspond to a large number of widespread peaky spots as for gradient-based approaches [Sundararajan et al., 2017, Smilkov et al., 2017]. In contrast, our work proposes to combine the information from earlier network layers with the one from later layers to produce a high resolution Class Activation Map that is competitive with the previous art in term of insertion-deletion faithfulness metrics, while outperforming it in term of precision of class-specific features localization.
Fuzzy Expert System for Stock Portfolio Selection: An Application to Bombay Stock Exchange
Venue: arXiv cs.AI 2022
Year: 2022

Selection of proper stocks, before allocating investment ratios, is always a crucial task for the investors. Presence of many influencing factors in stock performance have motivated researchers to adopt various Artificial Intelligence (AI) techniques to make this challenging task easier. In this paper a novel fuzzy expert system model is proposed to evaluate and rank the stocks under Bombay Stock Exchange (BSE). Dempster-Shafer (DS) evidence theory is used for the first time to automatically generate the consequents of the fuzzy rule base to reduce the effort in knowledge base development of the expert system. Later a portfolio optimization model is constructed where the objective function is considered as the ratio of the difference of fuzzy portfolio return and the risk free return to the weighted mean semi-variance of the assets that has been used. The model is solved by applying Ant Colony Optimization (ACO) algorithm by giving preference to the top ranked stocks. The performance of the model proved to be satisfactory for short-term investment period when compared with the recent performance of the stocks.
Semi-MoreGAN: A New Semi-supervised Generative Adversarial Network for Mixture of Rain Removal
Venue: arXiv cs.CV 2022
Year: 2022

Rain is one of the most common weather which can completely degrade the image quality and interfere with the performance of many computer vision tasks, especially under heavy rain conditions. We observe that: (i) rain is a mixture of rain streaks and rainy haze; (ii) the scene depth determines the intensity of rain streaks and the transformation into the rainy haze; (iii) most existing deraining methods are only trained on synthetic rainy images, and hence generalize poorly to the real-world scenes. Motivated by these observations, we propose a new SEMI-supervised Mixture Of rain REmoval Generative Adversarial Network (Semi-MoreGAN), which consists of four key modules: (I) a novel attentional depth prediction network to provide precise depth estimation; (ii) a context feature prediction network composed of several well-designed detailed residual blocks to produce detailed image context features; (iii) a pyramid depth-guided non-local network to effectively integrate the image context with the depth information, and produce the final rain-free images; and (iv) a comprehensive semi-supervised loss function to make the model not limited to synthetic datasets but generalize smoothly to real-world heavy rainy scenes. Extensive experiments show clear improvements of our approach over twenty representative state-of-the-arts on both synthetic and real-world rainy images.
DOTIN: Dropping Task-Irrelevant Nodes for GNNs
Venue: arXiv cs.LG 2022
Year: 2022

Scalability is an important consideration for deep graph neural networks. Inspired by the conventional pooling layers in CNNs, many recent graph learning approaches have introduced the pooling strategy to reduce the size of graphs for learning, such that the scalability and efficiency can be improved. However, these pooling-based methods are mainly tailored to a single graph-level task and pay more attention to local information, limiting their performance in multi-task settings which often require task-specific global information. In this paper, departure from these pooling-based efforts, we design a new approach called DOTIN (\underline{D}r\underline{o}pping \underline{T}ask-\underline{I}rrelevant \underline{N}odes) to reduce the size of graphs. Specifically, by introducing $K$ learnable virtual nodes to represent the graph embeddings targeted to $K$ different graph-level tasks, respectively, up to 90\% raw nodes with low attentiveness with an attention model -- a transformer in this paper, can be adaptively dropped without notable performance decreasing. Achieving almost the same accuracy, our method speeds up GAT by about 50\% on graph-level tasks including graph classification and graph edit distance (GED) with about 60\% less memory, on D\&D dataset. Code will be made publicly available in https://github.com/Sherrylone/DOTIN.
On tuning a mean-field model for semi-supervised classification
Venue: arXiv cs.LG 2022
Year: 2022

Semi-supervised learning (SSL) has become an interesting research area due to its capacity for learning in scenarios where both labeled and unlabeled data are available. In this work, we focus on the task of transduction - when the objective is to label all data presented to the learner - with a mean-field approximation to the Potts model. Aiming at this particular task we study how classification results depend on $β$ and find that the optimal phase depends highly on the amount of labeled data available. In the same study, we also observe that more stable classifications regarding small fluctuations in $β$ are related to configurations of high probability and propose a tuning approach based on such observation. This method relies on a novel parameter $γ$ and we then evaluate two different values of the said quantity in comparison with classical methods in the field. This evaluation is conducted by changing the amount of labeled data available and the number of nearest neighbors in the similarity graph. Empirical results show that the tuning method is effective and allows NMF to outperform other approaches in datasets with fewer classes. In addition, one of the chosen values for $γ$ also leads to results that are more resilient to changes in the number of neighbors, which might be of interest to practitioners in the field of SSL.