OpenRaiser/Intern-Atlas huggingface dataset:
Uncertainty-Autoencoder-Based Privacy and Utility Preserving Data Type Conscious Transformation
Venue: arXiv cs.LG 2022
Year: 2022

We propose an adversarial learning framework that deals with the privacy-utility tradeoff problem under two types of conditions: data-type ignorant, and data-type aware. Under data-type aware conditions, the privacy mechanism provides a one-hot encoding of categorical features, representing exactly one class, while under data-type ignorant conditions the categorical variables are represented by a collection of scores, one for each class. We use a neural network architecture consisting of a generator and a discriminator, where the generator consists of an encoder-decoder pair, and the discriminator consists of an adversary and a utility provider. Unlike previous research considering this kind of architecture, which leverages autoencoders (AEs) without introducing any randomness, or variational autoencoders (VAEs) based on learning latent representations which are then forced into a Gaussian assumption, our proposed technique introduces randomness and removes the Gaussian assumption restriction on the latent variables, only focusing on the end-to-end stochastic mapping of the input to privatized data. We test our framework on different datasets: MNIST, FashionMNIST, UCI Adult, and US Census Demographic Data, providing a wide range of possible private and utility attributes. We use multiple adversaries simultaneously to test our privacy mechanism -- some trained from the ground truth data and some trained from the perturbed data generated by our privacy mechanism. Through comparative analysis, our results demonstrate better privacy and utility guarantees than the existing works under similar, data-type ignorant conditions, even when the latter are considered under their original restrictive single-adversary model.
Fuzzy Simulations and Bisimulations between Fuzzy Automata
Venue: arXiv cs.FL 2022
Year: 2022

Simulations and bisimulations between two fuzzy automata over a complete residuated lattice were defined by Ćirić et al. (2012) as fuzzy relations between the sets of states of the automata. However, they act as a crisp relationship between the automata. In particular, if there exists a (forward) bisimulation between two fuzzy automata, then the fuzzy languages recognized by them are crisply equal. Approximate simulations and bisimulations introduced by Stanimirović et al. (2020) aim at fuzzifying this phenomenon. However, they are defined only for fuzzy automata over a complete Heyting algebra and do not give the exact relationship between states of the automata. In this article, we introduce and study fuzzy simulations and bisimulations between fuzzy automata over a complete residuated lattice. These notions are novel and have good properties. They are defined for fuzzy automata over any complete residuated lattice. We prove that the fuzzy language recognized by a fuzzy automaton is fuzzily preserved by fuzzy simulations and fuzzily invariant under fuzzy bisimulations. We also prove that the notions of fuzzy simulation and bisimulation have the Hennessy-Milner properties, which are a logical characterization of the greatest fuzzy simulation or bisimulation between two fuzzy automata. In addition, we provide results showing that our notions of fuzzy simulation and bisimulation are more general and refined than the notions of simulation and bisimulation introduced by Ćirić et al. and the notions of approximate simulation and bisimulation introduced by Stanimirović et al.
Positional Accuracy Assessment of Historical Google Earth Imagery
Venue: arXiv cs.CY 2022
Year: 2022

Google Earth is the most popular virtual globe in use today. Given its popularity and usefulness, most users do not pay close attention to the positional accuracy of the imagery, and there is limited information on the subject. This study evaluates the horizontal accuracy of historical GE imagery at four epochs between year 2000 and 2018, and the vertical accuracy of its elevation data within Lagos State in Nigeria, West Africa. The horizontal accuracies of the images were evaluated by comparison with a very high resolution (VHR) digital orthophoto while the vertical accuracy was assessed by comparison with a network of 558 ground control points. The GE elevations were also compared to elevation data from two readily available 30m digital elevation models (DEMs), the Shuttle Radar Topography Mission (SRTM) v3.0 and the Advanced Land Observing Satellite World 3D (AW3D) DEM v2.1. The most recent GE imagery (year 2018) was the most accurate while year 2000 was the least accurate. This shows a continuous enhancement in the accuracy and reliability of satellite imagery data sources which form the source of Google Earth data. In terms of the vertical accuracy, GE elevation data had the highest RMSE of 6.213m followed by AW3D with an RMSE of 4.388m and SRTM with an RMSE of 3.682m. Although the vertical accuracy of SRTM and AW3D are superior, Google Earth still presents clear advantages in terms of its ease of use and contextual awareness.
ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Tasks
Venue: arXiv cs.CL 2022
Year: 2022

This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2022: low-resource and dialect speech translation. For the Tunisian Arabic-English dataset (low-resource and dialect tracks), we build an end-to-end model as our joint primary submission, and compare it against cascaded models that leverage a large fine-tuned wav2vec 2.0 model for ASR. Our results show that in our settings pipeline approaches are still very competitive, and that with the use of transfer learning, they can outperform end-to-end models for speech translation (ST). For the Tamasheq-French dataset (low-resource track) our primary submission leverages intermediate representations from a wav2vec 2.0 model trained on 234 hours of Tamasheq audio, while our contrastive model uses a French phonetic transcription of the Tamasheq audio as input in a Conformer speech translation architecture jointly trained on automatic speech recognition, ST and machine translation losses. Our results highlight that self-supervised models trained on smaller sets of target data are more effective to low-resource end-to-end ST fine-tuning, compared to large off-the-shelf models. Results also illustrate that even approximate phonetic transcriptions can improve ST scores.
Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Loss
Venue: arXiv cs.CV 2022
Year: 2022

Knowledge Distillation (KD) is a strategy for the definition of a set of transferability gangways to improve the efficiency of Convolutional Neural Networks. Feature-based Knowledge Distillation is a subfield of KD that relies on intermediate network representations, either unaltered or depth-reduced via maximum activation maps, as the source knowledge. In this paper, we propose and analyse the use of a 2D frequency transform of the activation maps before transferring them. We pose that\textemdash by using global image cues rather than pixel estimates, this strategy enhances knowledge transferability in tasks such as scene recognition, defined by strong spatial and contextual relationships between multiple and varied concepts. To validate the proposed method, an extensive evaluation of the state-of-the-art in scene recognition is presented. Experimental results provide strong evidences that the proposed strategy enables the student network to better focus on the relevant image areas learnt by the teacher network, hence leading to better descriptive features and higher transferred performance than every other state-of-the-art alternative. We publicly release the training and evaluation framework used along this paper at http://www-vpu.eps.uam.es/publications/DCTBasedKDForSceneRecognition.
DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches
Venue: arXiv cs.CV 2022
Year: 2022

Researchers have explored various ways to generate realistic images from freehand sketches, e.g., for objects and human faces. However, how to generate realistic human body images from sketches is still a challenging problem. It is, first because of the sensitivity to human shapes, second because of the complexity of human images caused by body shape and pose changes, and third because of the domain gap between realistic images and freehand sketches. In this work, we present DeepPortraitDrawing, a deep generative framework for converting roughly drawn sketches to realistic human body images. To encode complicated body shapes under various poses, we take a local-to-global approach. Locally, we employ semantic part auto-encoders to construct part-level shape spaces, which are useful for refining the geometry of an input pre-segmented hand-drawn sketch. Globally, we employ a cascaded spatial transformer network to refine the structure of body parts by adjusting their spatial locations and relative proportions. Finally, we use a global synthesis network for the sketch-to-image translation task, and a face refinement network to enhance facial details. Extensive experiments have shown that given roughly sketched human portraits, our method produces more realistic images than the state-of-the-art sketch-to-image synthesis techniques.
Neuroevolutionary Multi-objective approaches to Trajectory Prediction in Autonomous Vehicles
Venue: arXiv cs.NE 2022
Year: 2022

The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years. The configuration and training of these networks can be posed as optimization problems. Indeed, most of the recent works on neuroevolution have focused their attention on single-objective optimization. Moreover, from the little research that has been done at the intersection of neuroevolution and evolutionary multi-objective optimization (EMO), all the research that has been carried out has focused predominantly on the use of one type of DNN: convolutional neural networks (CNNs), using well-established standard benchmark problems such as MNIST. In this work, we make a leap in the understanding of these two areas (neuroevolution and EMO), regarded in this work as neuroevolutionary multi-objective, by using and studying a rich DNN composed of a CNN and Long-short Term Memory network. Moreover, we use a robust and challenging vehicle trajectory prediction problem. By using the well-known Non-dominated Sorting Genetic Algorithm-II, we study the effects of five different objectives, tested in categories of three, allowing us to show how these objectives have either a positive or detrimental effect in neuroevolution for trajectory prediction in autonomous vehicles.
Two-step Planning of Dynamic UAV Trajectories using Iterative $δ$-Spaces
Venue: arXiv cs.RO 2022
Year: 2022

UAV trajectory planning is often done in a two-step approach, where a low-dimensional path is refined to a dynamic trajectory. The resulting trajectories are only locally optimal, however. On the other hand, direct planning in higher-dimensional state spaces generates globally optimal solutions but is time-consuming and thus infeasible for time-constrained applications. To address this issue, we propose $δ$-Spaces, a pruned high-dimensional state space representation for trajectory refinement. It does not only contain the area around a single lower-dimensional path but consists of the union of multiple near-optimal paths. Thus, it is less prone to local minima. Furthermore, we propose an anytime algorithm using $δ$-Spaces of increasing sizes. We compare our method against state-of-the-art search-based trajectory planning methods and evaluate it in 2D and 3D environments to generate second-order and third-order UAV trajectories.
Semi-Supervised Cascaded Clustering for Classification of Noisy Label Data
Venue: arXiv cs.LG 2022
Year: 2022

The performance of supervised classification techniques often deteriorates when the data has noisy labels. Even the semi-supervised classification approaches have largely focused only on the problem of handling missing labels. Most of the approaches addressing the noisy label data rely on deep neural networks (DNN) that require huge datasets for classification tasks. This poses a serious challenge especially in process and manufacturing industries, where the data is limited and labels are noisy. We propose a semi-supervised cascaded clustering (SSCC) algorithm to extract patterns and generate a cascaded tree of classes in such datasets. A novel cluster evaluation matrix (CEM) with configurable hyperparameters is introduced to localize and eliminate the noisy labels and invoke a pruning criterion on cascaded clustering. The algorithm reduces the dependency on expensive human expertise for assessing the accuracy of labels. A classifier generated based on SSCC is found to be accurate and consistent even when trained on noisy label datasets. It performed better in comparison with the support vector machines (SVM) when tested on multiple noisy-label datasets, including an industrial dataset. The proposed approach can be effectively used for deriving actionable insights in industrial settings with minimal human expertise.
Chasing Streams with Existential Rules
Venue: arXiv cs.AI 2022
Year: 2022

We study reasoning with existential rules to perform query answering over streams of data. On static databases, this problem has been widely studied, but its extension to rapidly changing data has not yet been considered. To bridge this gap, we extend LARS, a well-known framework for rule-based stream reasoning, to support existential rules. For that, we show how to translate LARS with existentials into a semantics-preserving set of existential rules. As query answering with such rules is undecidable in general, we describe how to leverage the temporal nature of streams and present suitable notions of acyclicity that ensure decidability.
Low-Code Programming Models
Venue: arXiv cs.PL 2022
Year: 2022

Traditionally, computer programming has been the prerogative of professional developers using textual programming languages such as C, Java, or Python. Low-code programming promises an alternative: letting citizen developers create programs using visual abstractions, demonstrations, or natural language. While low-code programming is currently getting a lot of attention in industry, the relevant research literature is scattered, and in fact, rarely uses the term "low-code". This article brings together low-code literature from various research fields, explaining how techniques work while providing a unified point of view. Low-code has the potential to empower more people to automate tasks by creating computer programs, making them more productive and less dependent on scarce professional software developers.
Knowledge Distillation of Russian Language Models with Reduction of Vocabulary
Venue: arXiv cs.CL 2022
Year: 2022

Today, transformer language models serve as a core component for majority of natural language processing tasks. Industrial application of such models requires minimization of computation time and memory footprint. Knowledge distillation is one of approaches to address this goal. Existing methods in this field are mainly focused on reducing the number of layers or dimension of embeddings/hidden representations. Alternative option is to reduce the number of tokens in vocabulary and therefore the embeddings matrix of the student model. The main problem with vocabulary minimization is mismatch between input sequences and output class distributions of a teacher and a student models. As a result, it is impossible to directly apply KL-based knowledge distillation. We propose two simple yet effective alignment techniques to make knowledge distillation to the students with reduced vocabulary. Evaluation of distilled models on a number of common benchmarks for Russian such as Russian SuperGLUE, SberQuAD, RuSentiment, ParaPhaser, Collection-3 demonstrated that our techniques allow to achieve compression from $17\times$ to $49\times$, while maintaining quality of $1.7\times$ compressed student with the full-sized vocabulary, but reduced number of Transformer layers only. We make our code and distilled models available.
GitRank: A Framework to Rank GitHub Repositories
Venue: arXiv cs.SE 2022
Year: 2022

Open-source repositories provide wealth of information and are increasingly being used to build artificial intelligence (AI) based systems to solve problems in software engineering. Open-source repositories could be of varying quality levels, and bad-quality repositories could degrade performance of these systems. Evaluating quality of open-source repositories, which is not available directly on code hosting sites such as GitHub, is thus important. In this hackathon, we utilize known code quality measures and GrimoireLab toolkit to implement a framework, named GitRank, to rank open-source repositories on three different criteria. We discuss our findings and preliminary evaluation in this hackathon report.
Cooperative Reflection and Synchronization Design for Distributed Multiple-RIS Communications
Venue: arXiv cs.IT 2022
Year: 2022

To reap the promised gain achieved by distributed reconfigurable intelligent surfaces (RISs)-enhanced communications in a wireless network, timing synchronization among these metasurfaces is an essential prerequisite in practice. This paper proposes a unified framework for the joint estimation of the unknown timing offsets and the RIS channel parameters, as well as the design of cooperative reflection and synchronization algorithm for the distributed multiple-RIS communication. Considering that RIS is usually a passive device with limited capability of signal processing, the individual timing offset and channel gains of each hop of the RIS links cannot be directly estimated. To make the estimation tractable, we propose to estimate the cascaded channels and timing offsets jointly by deriving a maximum likelihood estimator. Furthermore, we theoretically characterize the Cramer-Rao lower bound (CRLB) to evaluate the accuracy of this estimator. By using the proposed estimator and the derived CRLBs, an efficient resynchronization algorithm is devised jointly at the RISs and the destination to compensate the multiple timing offsets. Based on the majorization-minimization framework, the proposed algorithm admits semi-closed and closed form solutions for the RIS reflection matrices and the timing offset equalizer, respectively. Simulation results verify that our theoretical analysis well matches the numerical tests and validate the effectiveness of the proposed resynchronization algorithm.
HARL: A Novel Hierachical Adversary Reinforcement Learning for Automoumous Intersection Management
Venue: arXiv cs.MA 2022
Year: 2022

As an emerging technology, Connected Autonomous Vehicles (CAVs) are believed to have the ability to move through intersections in a faster and safer manner, through effective Vehicle-to-Everything (V2X) communication and global observation. Autonomous intersection management is a key path to efficient crossing at intersections, which reduces unnecessary slowdowns and stops through adaptive decision process of each CAV, enabling fuller utilization of the intersection space. Distributed reinforcement learning (DRL) offers a flexible, end-to-end model for AIM, adapting for many intersection scenarios. While DRL is prone to collisions as the actions of multiple sides in the complicated interactions are sampled from a generic policy, restricting the application of DRL in realistic scenario. To address this, we propose a hierarchical RL framework where models at different levels vary in receptive scope, action step length, and feedback period of reward. The upper layer model accelerate CAVs to prevent them from being clashed, while the lower layer model adjust the trends from upper layer model to avoid the change of mobile state causing new conflicts. And the real action of CAV at each step is co-determined by the trends from both levels, forming a real-time balance in the adversarial process. The proposed model is proven effective in the experiment undertaken in a complicated intersection with 4 branches and 4 lanes each branch, and show better performance compared with baselines.
Learning to Solve Vehicle Routing Problems: A Survey
Venue: arXiv cs.LG 2022
Year: 2022

This paper provides a systematic overview of machine learning methods applied to solve NP-hard Vehicle Routing Problems (VRPs). Recently, there has been a great interest from both machine learning and operations research communities to solve VRPs either by pure learning methods or by combining them with the traditional hand-crafted heuristics. We present the taxonomy of the studies for learning paradigms, solution structures, underlying models, and algorithms. We present in detail the results of the state-of-the-art methods demonstrating their competitiveness with the traditional methods. The paper outlines the future research directions to incorporate learning-based solutions to overcome the challenges of modern transportation systems.
KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learning
Venue: arXiv cs.LG 2022
Year: 2022

While hyper-parameters (HPs) are important for knowledge graph (KG) learning, existing methods fail to search them efficiently. To solve this problem, we first analyze the properties of different HPs and measure the transfer ability from small subgraph to the full graph. Based on the analysis, we propose an efficient two-stage search algorithm KGTuner, which efficiently explores HP configurations on small subgraph at the first stage and transfers the top-performed configurations for fine-tuning on the large full graph at the second stage. Experiments show that our method can consistently find better HPs than the baseline algorithms within the same time budget, which achieves {9.1\%} average relative improvement for four embedding models on the large-scale KGs in open graph benchmark.
Rate-Splitting Multiple Access for 6G -- Part II: Interplay with Integrated Sensing and Communications
Venue: arXiv cs.IT 2022
Year: 2022

This letter is the second part of a three-part tutorial focusing on rate-splitting multiple access (RSMA) for 6G. As Part II of the tutorial, this letter addresses the interplay between RSMA and integrated radar sensing and communications (ISAC). In particular, we introduce a general RSMAassisted ISAC architecture, where the ISAC platform has a dual capability to simultaneously communicate with downlink users and probe detection signals to a moving target. Then, the metrics of radar sensing and communications are respectively introduced, followed by a RSMA-assisted ISAC waveform design example which jointly minimizes the Cramer-Rao bound (CRB) of target estimation and maximizes the minimum fairness rate (MFR) amongst communication users subject to the per-antenna power constraint. The superiority of RSMA-assisted ISAC is verifed through simulation results in both terrestrial and satellite scenarios. RSMA is demonstrated to be a powerful multiple access and interference management strategy for ISAC, and provides a better communication-sensing trade-off compared with the conventional benchmark strategies. Consequently, RSMA is a promising technology for next generation multiple access (NGMA) and future networks such as 6G and beyond.